-- Logs begin at Tue 2022-05-10 13:09:55 UTC, end at Tue 2022-05-10 14:27:12 UTC. -- May 10 13:46:07.447033 dv-cinder-835881-9-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 10 13:46:07.460398 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 10 13:46:07.464557 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 13:46:07 2022] *** May 10 13:46:07.464907 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 13:46:07.465140 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 13:46:07.465385 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: nodename: dv-cinder-835881-9-iscsi May 10 13:46:07.465612 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: machine: x86_64 May 10 13:46:07.465840 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: clock source: unix May 10 13:46:07.466062 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: pcre jit disabled May 10 13:46:07.466318 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: detected number of CPU cores: 4 May 10 13:46:07.466564 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: current working directory: / May 10 13:46:07.466792 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: detected binary path: /usr/bin/uwsgi-core May 10 13:46:07.467066 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: your processes number limit is 47680 May 10 13:46:07.467310 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: your memory page size is 4096 bytes May 10 13:46:07.467538 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: detected max file descriptor number: 2048 May 10 13:46:07.467771 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: lock engine: pthread robust mutexes May 10 13:46:07.468242 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: thunder lock: enabled May 10 13:46:07.469311 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 10 13:46:07.469463 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 13:46:07.522271 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: Python main interpreter initialized at 0x5611917769c0 May 10 13:46:07.522271 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: python threads support enabled May 10 13:46:07.522271 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: your server socket listen backlog is limited to 100 connections May 10 13:46:07.522271 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: your mercy for graceful operations on workers is 90 seconds May 10 13:46:07.522780 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: mapped 403077 bytes (393 KB) for 2 cores May 10 13:46:07.522916 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: *** Operational MODE: preforking *** May 10 13:46:07.523329 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: *** uWSGI is running in multiple interpreter mode *** May 10 13:46:07.523329 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: spawned uWSGI master process (pid: 79925) May 10 13:46:07.523598 dv-cinder-835881-9-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 10 13:46:07.524700 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: spawned uWSGI worker 1 (pid: 79936, cores: 1) May 10 13:46:07.525763 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: spawned uWSGI worker 2 (pid: 79937, cores: 1) May 10 13:46:07.526097 dv-cinder-835881-9-iscsi devstack@keystone.service[79925]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 13:46:14.612428 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 13:46:14.612428 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: from cryptography.utils import int_from_bytes May 10 13:46:14.613859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 13:46:14.613859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: from cryptography.utils import int_from_bytes May 10 13:46:14.664701 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 13:46:14.664899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 13:46:14.665097 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] command line args: [] {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 13:46:14.665321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 13:46:14.665658 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ================================================================================ {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 13:46:14.665757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] admin_token = **** {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.665968 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] config_dir = [] {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.666172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.666360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] config_source = [] {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.666523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] debug = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.666808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.667071 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.667241 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.667489 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.667730 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.667954 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] list_limit = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.668129 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] log_config_append = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.668302 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.668475 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] log_dir = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.668666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] log_file = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.668895 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.669126 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.669365 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.669606 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.669784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.669960 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.670176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.670451 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.670682 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.670910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.671160 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.671402 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.672801 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.672801 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.672801 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.673428 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.673428 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] publish_errors = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.673821 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.673821 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.674182 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.674182 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.674622 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.674820 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] standard_threads = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.674987 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.675157 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.675319 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.675465 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] use_journal = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.675637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] use_json = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.675811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] use_stderr = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.675969 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] use_syslog = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.676195 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.676446 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.676681 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.676937 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.677171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.677414 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.677647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.677914 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.678149 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.678424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.678665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.678916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.679147 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.679389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.679621 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.679866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.680109 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.680338 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.680590 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.680837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.681077 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.681385 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.681541 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.681803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.682052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.682451 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.682605 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.682772 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.682999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.683230 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.683477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.683719 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.683946 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.684174 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.684417 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.684660 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.684891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.685136 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.685365 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.685596 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.685828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.686053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.686302 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.686531 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.686758 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.687021 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.687265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.688061 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.688061 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.688061 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.688465 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.688465 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.688731 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.688865 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.688998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.689240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.689472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.689704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.689934 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.690161 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.690430 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.690659 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.690891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.691116 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.691372 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.691601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.691826 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.692057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.692287 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.692552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.692783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.693024 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.693269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.693499 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.693728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.693957 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.694358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.694597 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.694833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.695074 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.695309 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.695544 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.695777 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.696008 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.696241 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.696499 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.696736 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.696973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.697206 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.697445 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.697678 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.697911 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.698159 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.698395 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.698622 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.698851 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.699080 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.699318 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.699534 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.699773 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.700015 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.700249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.700500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.700757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.700994 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.701246 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] auth.external = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.701463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.701755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.701961 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.702349 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] auth.password = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.702556 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] auth.token = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.702753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.703223 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.703223 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.703762 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.703762 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.704233 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.704233 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.704525 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] credential.caching = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.704666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.704797 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.705260 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.705260 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.705543 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.705708 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.705967 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.706243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.706468 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.706717 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.707000 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.707300 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.707634 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.707874 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.708192 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.708571 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] federation.caching = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.708867 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.709117 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.709368 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.709596 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.709840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.710074 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.710266 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 13:46:14.710266 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: from cryptography.utils import int_from_bytes May 10 13:46:14.710822 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 13:46:14.710822 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: from cryptography.utils import int_from_bytes May 10 13:46:14.711168 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.711549 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.711958 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.713281 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.713281 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.713281 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] identity.caching = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.713281 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.713833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.714181 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.714583 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.714938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.715273 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.715616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.715973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.716331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.716670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.717040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.717388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.717717 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.718060 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.719120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.719523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.719877 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.720261 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.720604 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.720950 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.721356 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.721689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.722053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.722425 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.722767 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.723108 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.723458 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.723792 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.724139 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.724487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.724820 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.725164 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.725509 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.725837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.726175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.726525 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.726865 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.727217 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.727566 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.727911 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.728268 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.728652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.729024 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.729373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.729736 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.730089 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.730478 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.730835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.731454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.731794 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.732150 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.user = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.732513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.732901 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.733233 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.733585 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.733993 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.734394 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.734730 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.735134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.735520 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.735928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.736332 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.736739 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.737148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.737571 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.737982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.738422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.738878 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.739270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.739678 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.740076 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.740471 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.740866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.741270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.741673 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.742085 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.742527 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.742942 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.743349 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.743764 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.744164 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.744557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.744962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.745377 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.745775 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.746165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.746602 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.747011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] resource.caching = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.747427 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.747831 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.748226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.748636 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.749059 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.749466 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.749954 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.750391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.750795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.751189 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] role.caching = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.751600 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] role.driver = sql {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.751998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.752403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.752810 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.753217 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.753629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.754043 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.754482 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.754897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.755311 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.755735 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.756147 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.756565 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.756980 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.757390 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.758036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.758458 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.758898 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.759326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.759483 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 13:46:14.759673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 13:46:14.759821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] command line args: [] {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 13:46:14.760074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 13:46:14.760227 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ================================================================================ {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 13:46:14.760372 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.760513 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] admin_token = **** {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.760726 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] config_dir = [] {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.760910 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.761089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] config_source = [] {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.761267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] debug = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.761454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.761611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.761788 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.761917 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.762099 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.762379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.762519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.762669 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] list_limit = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.762802 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] log_config_append = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.762929 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.763089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] log_dir = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.763264 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] log_file = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.763499 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.763699 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.764003 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.764183 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.764341 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.764518 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.764693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.764831 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.764962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.765763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.766002 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.766146 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.766389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.766625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.766823 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.766964 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.767096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.767327 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.767601 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.767743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.768129 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.768271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.768417 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] publish_errors = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.768558 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.768740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.768917 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.769162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.769301 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.769446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.769612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] standard_threads = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.769842 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.770082 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.770268 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.770406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.770552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] use_journal = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.770680 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] use_json = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.770808 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] use_stderr = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.770936 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] use_syslog = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.771131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:46:14.771390 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.771641 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.771775 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.771905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.772109 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.772339 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.772480 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.772626 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.772810 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.773047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.773291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.773430 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.773558 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.773774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.774006 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.774274 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.774409 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.774539 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.774733 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.774977 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.775212 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.775351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] token.caching = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.775484 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.775705 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.775949 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.776120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.776255 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.776420 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.776684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.776932 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.777085 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.777218 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.777395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.777625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.777854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.777993 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.778137 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.778350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.778601 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.778824 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.778967 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.779099 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.779347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.779530 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.779771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.779985 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.780126 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.780256 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.780458 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.780692 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.781464 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.781605 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.781736 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.781936 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.782167 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.782395 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.782528 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.782659 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.782876 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.783113 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.783342 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.783478 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.783611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.783798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.784057 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.784287 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.784438 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.784719 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.784719 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.784973 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.785191 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.785413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.785573 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.785707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.785876 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.786114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.786363 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.786520 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.786664 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.786882 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.787077 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.787307 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.787446 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.787577 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.787764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.788041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.788246 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.788387 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.788518 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.788743 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.788975 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.789179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.789328 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.789458 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.789659 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.789896 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.790097 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.790298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.790430 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.790605 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.790839 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.791098 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.791257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.791391 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.791551 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.791816 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.792051 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.792187 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.792330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.792509 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.792750 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.792985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.793123 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] database.connection = **** {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.793265 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.793437 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.793670 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.793898 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.794107 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.794292 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.794425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.794596 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.794837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.795068 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.795208 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.795338 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.795532 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.795787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.795996 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.796137 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.796267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.796530 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] auth.external = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.796757 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.796928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.797078 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.797452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.797641 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.797781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] auth.password = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.797990 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] auth.token = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.798274 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.798491 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.798630 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.798760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.798958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.799207 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.799397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.799551 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.799683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.799888 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] credential.caching = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.800134 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.800304 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.800443 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.800610 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.800846 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.801089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.801225 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.801356 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.801573 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.801824 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.802031 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.802172 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.802344 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.802718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.802863 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.803118 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.803386 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.803525 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.803670 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.803869 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.804101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] federation.caching = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.804350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.804483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.804622 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.804808 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.805038 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.805258 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.805410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.805541 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.805742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.805976 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.806215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.806355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.806503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.806760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.806945 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] identity.caching = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.807163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.807304 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.807497 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.807631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.807863 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.808084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.808225 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.808355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.808550 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.808799 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.809017 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.809159 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.809288 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.809482 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.809711 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.809846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 13:46:14.809978 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.810181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.810456 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.810742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.810954 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.811227 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.811464 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.811701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.811931 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.812315 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.812553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.812790 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.813035 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.813272 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.813519 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.813779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.814002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.814283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.814523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.814768 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.815011 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.815241 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.815477 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.815707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.815941 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.816178 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.816423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.816658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.816893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.817142 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.817388 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.817616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.817844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.818095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.818366 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.818600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.818833 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.819065 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.819292 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.user = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.819533 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.819790 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.820018 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.820263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.820505 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.820747 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.820980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.821344 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.821503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.821632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.821875 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.822100 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.822367 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.822612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.822865 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.823108 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.823349 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.823578 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.823824 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.824059 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.824293 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.824527 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.824760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.825003 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.825250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.825484 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.825737 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.825964 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.826226 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.826476 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.826709 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.826944 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.827190 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.827428 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.828560 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.828792 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.829035 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] resource.caching = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.829361 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.829517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.829753 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.830003 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.830303 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.830512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.830756 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.830992 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.831289 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.835068 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] role.caching = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.835068 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] role.driver = sql {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.835068 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.835068 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.835068 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.835068 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.835068 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.835068 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.835068 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.836080 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.836080 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.836080 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.836080 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.836080 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.837291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.837592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.838085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.838445 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.838743 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.838992 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.839258 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.839521 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.839768 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.840036 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.840329 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.840542 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.840782 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.841045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.841252 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.841511 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.841771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.842020 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.842282 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.842525 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.842759 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.842997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] token.caching = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.844159 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.844159 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.844594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.844594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.844828 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.845095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.845342 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.845588 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.845835 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.846072 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.846371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.846607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.846853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.847104 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.847333 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.847577 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.847884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.848145 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] database.connection = **** {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.848413 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.848667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.848904 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.849156 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.849365 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.849599 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.849835 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.850069 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.850339 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.850576 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.850820 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.854331 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.854331 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.854331 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.854331 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.854331 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.854331 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.854331 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:46:14.854331 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 13:46:14.872542 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:14.872818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:14.873038 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:14.881373 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:14.881639 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:14.881804 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:14.882992 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:14.892127 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:14.914597 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:14.914940 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:14.920109 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:14.920351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:14.972259 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:14.974304 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.027584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.028036 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.031524 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.031872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.100025 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.100461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.100461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.100912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.101178 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.101411 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.101641 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.101873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.102111 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.102400 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.102400 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.102400 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.127511 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.127920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.127920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.128433 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.128433 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.128869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.128869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.129291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.129291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.129734 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.129734 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.130181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.130181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.130667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.142136 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.142638 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.156233 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.156627 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.156897 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.157190 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.157190 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.157668 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.157668 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.158129 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.158129 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.158520 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.162637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.163004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.163341 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.163673 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:46:15.176320 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.176522 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 13:46:15.176858 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.177071 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 13:46:15.177308 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.177551 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.177804 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.178058 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.182890 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.183351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 13:46:15.183996 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.184405 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 13:46:15.184945 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.185450 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.185993 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.186542 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.190160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.190479 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.190746 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.191028 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.199415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.202923 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.203198 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.203608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.203888 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.204173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.204433 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.204706 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.204976 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.205245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.205512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.205774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.210889 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.211482 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.212013 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.212563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.225824 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.229481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.229849 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.230241 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.230724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.231334 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.231673 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.232020 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.232367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.232711 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.233063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.233403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.233759 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.235550 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.235816 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.241209 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.241554 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.241759 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.249246 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.250135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.256957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.257403 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.257825 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.258262 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.258666 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.259065 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.259454 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.259856 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.264628 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.267452 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.267788 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.273199 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.273554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.273800 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.281353 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.282190 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.282616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.282616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.286654 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.287363 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.287663 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.287949 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.288230 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.288495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.288774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.289044 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.289314 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.290406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.290709 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.295853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.300377 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.304283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.304567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.304848 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.305130 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.305400 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.305676 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.311070 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.311362 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.317374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.321331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.321665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.327067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.328068 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.328364 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.328596 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.328812 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.331613 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.335692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.336229 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.336615 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.337060 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.337399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.337663 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.338007 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.339090 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.339374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.342553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.342852 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.343092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.343989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.345186 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.358472 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.358821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.359139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.359430 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.359718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.359999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.360289 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.360573 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.360989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.361275 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.361539 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.369714 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.371551 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.371820 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.375762 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.376254 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.376565 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.376846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.377140 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.380884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.384249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.387677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.389353 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.391743 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.392035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.392270 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.392508 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.392743 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.393006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.393006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.393006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.393657 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.393657 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.400066 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.401729 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.405080 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.405413 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.405656 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.405940 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.413279 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.415358 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.415649 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.415932 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.417399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.421250 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.423614 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.424211 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.424510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.424795 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.425041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.425296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.425584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.425861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.426136 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.426448 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.426709 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.426709 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.427168 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.427404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.427404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.427865 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.428099 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.428099 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.435692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.438553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.441938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.442260 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.442549 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.442830 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.452237 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.452623 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.452964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.461644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:46:15.461953 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.462231 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.462501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.462779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.463068 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.463342 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.463626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.463889 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.464159 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.464441 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.464713 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.464988 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.465282 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:46:15.466901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x5611917769c0 pid: 79937 (default app) May 10 13:46:15.471325 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e2439-58c1-438e-a9f7-c6141ec6ccf7 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:15.471628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e2439-58c1-438e-a9f7-c6141ec6ccf7 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:15.471894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e2439-58c1-438e-a9f7-c6141ec6ccf7 None None] PATH_INFO: `/v3` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:15.476854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 791 bytes} [Tue May 10 13:46:15 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:15.509078 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x5611917769c0 pid: 79936 (default app) May 10 13:46:23.926552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67257-12e0-4df7-adb6-2e5363422102 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:23.927072 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67257-12e0-4df7-adb6-2e5363422102 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:23.927268 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67257-12e0-4df7-adb6-2e5363422102 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:23.928542 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 2/2] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:23.941989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111bd94-0200-42cf-a313-36e050500076 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:23.942575 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111bd94-0200-42cf-a313-36e050500076 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:23.942575 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111bd94-0200-42cf-a313-36e050500076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:23.976297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG oslo_db.sqlalchemy.engines [None req-5111bd94-0200-42cf-a313-36e050500076 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79936) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:46:24.176285 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG passlib.handlers.bcrypt [None req-5111bd94-0200-42cf-a313-36e050500076 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79936) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 13:46:24.176616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG passlib.handlers.bcrypt [None req-5111bd94-0200-42cf-a313-36e050500076 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79936) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 13:46:24.238685 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-5111bd94-0200-42cf-a313-36e050500076 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:24.240311 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-5111bd94-0200-42cf-a313-36e050500076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:24.388095 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1/3] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 10 13:46:24.518296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe67257-12e0-4df7-adb6-2e5363422102 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:24.555576 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG oslo_db.sqlalchemy.engines [None req-bbe67257-12e0-4df7-adb6-2e5363422102 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79937) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:46:24.693386 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe67257-12e0-4df7-adb6-2e5363422102 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:24.698309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140dfe2-9a6e-4e83-acf7-39b2c08e5269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:24.699043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140dfe2-9a6e-4e83-acf7-39b2c08e5269 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:24.699349 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140dfe2-9a6e-4e83-acf7-39b2c08e5269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:24.699650 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140dfe2-9a6e-4e83-acf7-39b2c08e5269 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:24.710236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140dfe2-9a6e-4e83-acf7-39b2c08e5269 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:24.767471 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1140dfe2-9a6e-4e83-acf7-39b2c08e5269 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 13:46:24.767922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140dfe2-9a6e-4e83-acf7-39b2c08e5269 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:24.779742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 3/4] 10.222.0.32 () {58 vars in 1324 bytes} [Tue May 10 13:46:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 13:46:24.785855 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111bd94-0200-42cf-a313-36e050500076 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:24.802606 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111bd94-0200-42cf-a313-36e050500076 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:24.807743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a407e-7b43-4529-8646-3727ac96e873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:24.809063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a407e-7b43-4529-8646-3727ac96e873 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:24.809442 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a407e-7b43-4529-8646-3727ac96e873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:24.809797 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a407e-7b43-4529-8646-3727ac96e873 admin admin] PATH_INFO: `/v3/projects/a83c1c4876b14f72a0e3d2113130a776` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:24.811813 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a407e-7b43-4529-8646-3727ac96e873 admin admin] RBAC: Authorizing `identity:get_project(project_id=a83c1c4876b14f72a0e3d2113130a776)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:24.867485 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8d4a407e-7b43-4529-8646-3727ac96e873 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 13:46:24.867830 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a407e-7b43-4529-8646-3727ac96e873 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:24.872717 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 2/5] 10.222.0.32 () {56 vars in 1207 bytes} [Tue May 10 13:46:24 2022] GET /identity/v3/projects/a83c1c4876b14f72a0e3d2113130a776 => generated 344 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:27.245095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2b6fb-e41d-4f9d-a293-79857ec5ef9c None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:27.245616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2b6fb-e41d-4f9d-a293-79857ec5ef9c None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:27.245616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2b6fb-e41d-4f9d-a293-79857ec5ef9c None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:27.250585 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 4/6] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:27.256810 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4b25b-6cfc-4c37-8078-bcf89e7fce28 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:27.257347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4b25b-6cfc-4c37-8078-bcf89e7fce28 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:27.257347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4b25b-6cfc-4c37-8078-bcf89e7fce28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:27.279728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-65c4b25b-6cfc-4c37-8078-bcf89e7fce28 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:27.282515 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-65c4b25b-6cfc-4c37-8078-bcf89e7fce28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:27.290813 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 3/7] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 10 13:46:27.315675 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2b6fb-e41d-4f9d-a293-79857ec5ef9c None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:27.328540 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2b6fb-e41d-4f9d-a293-79857ec5ef9c None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:27.333086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a23a7-7295-4cdf-a65b-6036a93bbe84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:27.333734 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a23a7-7295-4cdf-a65b-6036a93bbe84 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:27.334015 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a23a7-7295-4cdf-a65b-6036a93bbe84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:27.334322 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a23a7-7295-4cdf-a65b-6036a93bbe84 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:27.343443 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a23a7-7295-4cdf-a65b-6036a93bbe84 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:27.345674 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a23a7-7295-4cdf-a65b-6036a93bbe84 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:27.356546 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 5/8] 10.222.0.32 () {58 vars in 1324 bytes} [Tue May 10 13:46:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 13:46:27.363428 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4b25b-6cfc-4c37-8078-bcf89e7fce28 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:27.372641 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4b25b-6cfc-4c37-8078-bcf89e7fce28 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:27.377437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd48bb-54c1-48a2-a0ff-9fea484cae67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:27.378361 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd48bb-54c1-48a2-a0ff-9fea484cae67 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:27.378646 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd48bb-54c1-48a2-a0ff-9fea484cae67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:27.378921 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd48bb-54c1-48a2-a0ff-9fea484cae67 admin admin] PATH_INFO: `/v3/users/2917275ac848431ab364bc258730628d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:27.380411 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd48bb-54c1-48a2-a0ff-9fea484cae67 admin admin] RBAC: Authorizing `identity:get_user(user_id=2917275ac848431ab364bc258730628d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:27.382386 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd48bb-54c1-48a2-a0ff-9fea484cae67 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:27.384042 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 4/9] 10.222.0.32 () {56 vars in 1198 bytes} [Tue May 10 13:46:27 2022] GET /identity/v3/users/2917275ac848431ab364bc258730628d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:29.835022 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad46dfe-4bb5-4da7-8ea8-49c209d69c5f None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:29.835525 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad46dfe-4bb5-4da7-8ea8-49c209d69c5f None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:29.835631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad46dfe-4bb5-4da7-8ea8-49c209d69c5f None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:29.835915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0ca81-3b0a-4c1d-8ec6-96c33d454ae9 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:29.836273 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0ca81-3b0a-4c1d-8ec6-96c33d454ae9 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:29.836477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0ca81-3b0a-4c1d-8ec6-96c33d454ae9 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:29.837118 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 6/10] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:29.838167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 5/11] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:29.843599 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa34d3-5f65-4628-af39-683b2d59cda9 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:29.843896 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa34d3-5f65-4628-af39-683b2d59cda9 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:29.844158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa34d3-5f65-4628-af39-683b2d59cda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:29.844411 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadbf15-f612-4ce7-ac6d-bef5be8ccb89 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:29.845113 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadbf15-f612-4ce7-ac6d-bef5be8ccb89 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:29.845113 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadbf15-f612-4ce7-ac6d-bef5be8ccb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:29.893425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG passlib.handlers.bcrypt [None req-38fa34d3-5f65-4628-af39-683b2d59cda9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79937) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 13:46:29.893848 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG passlib.handlers.bcrypt [None req-38fa34d3-5f65-4628-af39-683b2d59cda9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79937) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 13:46:29.942225 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-38fa34d3-5f65-4628-af39-683b2d59cda9 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:29.943959 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-38fa34d3-5f65-4628-af39-683b2d59cda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:29.977792 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-9dadbf15-f612-4ce7-ac6d-bef5be8ccb89 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:29.979057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-9dadbf15-f612-4ce7-ac6d-bef5be8ccb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:30.089979 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 6/12] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:30.108631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 7/13] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:30.115942 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadbf15-f612-4ce7-ac6d-bef5be8ccb89 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:30.135640 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa34d3-5f65-4628-af39-683b2d59cda9 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:30.274011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadbf15-f612-4ce7-ac6d-bef5be8ccb89 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:30.286860 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa34d3-5f65-4628-af39-683b2d59cda9 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:30.319320 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170524a-66cf-43b5-a55d-7d84367ffe4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:30.320128 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170524a-66cf-43b5-a55d-7d84367ffe4d None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:30.320583 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170524a-66cf-43b5-a55d-7d84367ffe4d None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:30.320948 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170524a-66cf-43b5-a55d-7d84367ffe4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:30.342081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da459a-d82c-4731-bb27-6043fadd9a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:30.343736 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da459a-d82c-4731-bb27-6043fadd9a8c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:30.344016 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da459a-d82c-4731-bb27-6043fadd9a8c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:30.344292 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da459a-d82c-4731-bb27-6043fadd9a8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:30.361407 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da459a-d82c-4731-bb27-6043fadd9a8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:30.381609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-c9da459a-d82c-4731-bb27-6043fadd9a8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:30.381609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:30.381609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:30.381609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:30.381609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:30.381609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:30.381609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:30.381609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:30.381609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:30.381609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:30.381609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:30.381609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:30.381609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:30.381609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:30.381609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:30.381609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:30.383312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:30.383312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:30.383312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:30.383312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:30.383312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:30.383312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:30.383312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:30.383312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:30.383312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:30.383312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:30.383312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:30.383312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:46:30.383312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:30.383312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:30.383312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:30.383312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:30.384406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:30.384406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:30.384406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:30.384406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:30.384406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:30.384406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:30.384406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:30.384406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:30.384406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:30.384406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:30.384406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:30.384406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:46:30.384406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 8/14] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:46:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:30.393191 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da459a-d82c-4731-bb27-6043fadd9a8c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:30.417805 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170524a-66cf-43b5-a55d-7d84367ffe4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:30.419377 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170524a-66cf-43b5-a55d-7d84367ffe4d None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:30.527729 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 7/15] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:46:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 13:46:30.533591 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170524a-66cf-43b5-a55d-7d84367ffe4d None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:30.550178 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da459a-d82c-4731-bb27-6043fadd9a8c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:30.610570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2e289-8de7-4a0a-b80a-7c7f03e4b7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:30.611673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2e289-8de7-4a0a-b80a-7c7f03e4b7aa None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:30.612171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2e289-8de7-4a0a-b80a-7c7f03e4b7aa None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:30.612670 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2e289-8de7-4a0a-b80a-7c7f03e4b7aa None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:30.614129 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2e289-8de7-4a0a-b80a-7c7f03e4b7aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:30.614725 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2e289-8de7-4a0a-b80a-7c7f03e4b7aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:30.617412 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2e289-8de7-4a0a-b80a-7c7f03e4b7aa None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:30.631811 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 9/16] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:46:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:30.637648 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2e289-8de7-4a0a-b80a-7c7f03e4b7aa None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:30.639592 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170524a-66cf-43b5-a55d-7d84367ffe4d None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:30.679568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ceed98-e4b2-4119-b9ec-202cce434b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:30.680388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ceed98-e4b2-4119-b9ec-202cce434b25 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:30.680677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ceed98-e4b2-4119-b9ec-202cce434b25 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:30.680958 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ceed98-e4b2-4119-b9ec-202cce434b25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:30.692271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ceed98-e4b2-4119-b9ec-202cce434b25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:30.693778 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ceed98-e4b2-4119-b9ec-202cce434b25 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:30.716828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-47ceed98-e4b2-4119-b9ec-202cce434b25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:30.716828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:30.716828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:30.716828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:30.716828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:30.716828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:30.716828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:30.716828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:30.716828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:30.716828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:30.716828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:30.716828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:30.716828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:30.716828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:30.716828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:30.717785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:30.717785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:30.717785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:30.717785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:30.717785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:30.717785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:30.717785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:30.717785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:30.717785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:46:30.717785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:30.717785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:30.717785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:30.717785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:30.717785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:30.717785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:30.717785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:30.717785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:30.719292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:30.719292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:30.719292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:30.719292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:46:30.719292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 8/17] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:30.724896 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ceed98-e4b2-4119-b9ec-202cce434b25 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:30.750999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2e289-8de7-4a0a-b80a-7c7f03e4b7aa None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:30.787403 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b9606-7e44-4d88-8897-59902b3b2ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:30.788389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b9606-7e44-4d88-8897-59902b3b2ea3 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:30.788669 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b9606-7e44-4d88-8897-59902b3b2ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:30.788938 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b9606-7e44-4d88-8897-59902b3b2ea3 None admin] PATH_INFO: `/v3/users/2917275ac848431ab364bc258730628d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:30.790719 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b9606-7e44-4d88-8897-59902b3b2ea3 None admin] RBAC: Authorizing `identity:get_user(user_id=2917275ac848431ab364bc258730628d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:30.792209 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b9606-7e44-4d88-8897-59902b3b2ea3 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:30.794132 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 10/18] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:46:30 2022] GET /identity/v3/users/2917275ac848431ab364bc258730628d => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:30.799870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b9606-7e44-4d88-8897-59902b3b2ea3 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:30.853528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ceed98-e4b2-4119-b9ec-202cce434b25 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:30.892869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f71ff8-2c2d-4457-a2bb-2c01d60932f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:30.893451 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f71ff8-2c2d-4457-a2bb-2c01d60932f0 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:30.893734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f71ff8-2c2d-4457-a2bb-2c01d60932f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:30.894010 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f71ff8-2c2d-4457-a2bb-2c01d60932f0 None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:30.894790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f71ff8-2c2d-4457-a2bb-2c01d60932f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:30.895096 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f71ff8-2c2d-4457-a2bb-2c01d60932f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:30.896496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f71ff8-2c2d-4457-a2bb-2c01d60932f0 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:30.915986 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 9/19] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:30.929512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b9606-7e44-4d88-8897-59902b3b2ea3 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:30.969378 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f9cc9-ced5-446e-a4c0-a31adbfbdfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:30.970186 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f9cc9-ced5-446e-a4c0-a31adbfbdfa7 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:30.970496 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f9cc9-ced5-446e-a4c0-a31adbfbdfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:30.970770 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f9cc9-ced5-446e-a4c0-a31adbfbdfa7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:30.972123 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f9cc9-ced5-446e-a4c0-a31adbfbdfa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:30.973641 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f9cc9-ced5-446e-a4c0-a31adbfbdfa7 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:30.975445 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 11/20] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:46:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:30.981917 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f71ff8-2c2d-4457-a2bb-2c01d60932f0 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:31.101469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f71ff8-2c2d-4457-a2bb-2c01d60932f0 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:31.143744 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb7dd1-2a0a-4216-bcb1-a2808ef7f76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:31.144352 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb7dd1-2a0a-4216-bcb1-a2808ef7f76c None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:31.144644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb7dd1-2a0a-4216-bcb1-a2808ef7f76c None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:31.144953 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb7dd1-2a0a-4216-bcb1-a2808ef7f76c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:31.145814 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb7dd1-2a0a-4216-bcb1-a2808ef7f76c None admin] RBAC: Adding query filter params (role.id=17e40821fc444dd0b040dcfce3eb222b, scope.domain.id=default, user.id=2917275ac848431ab364bc258730628d) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:31.146175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb7dd1-2a0a-4216-bcb1-a2808ef7f76c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:31.147801 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb7dd1-2a0a-4216-bcb1-a2808ef7f76c None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:31.156563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 10/21] 10.222.0.32 () {56 vars in 1322 bytes} [Tue May 10 13:46:30 2022] GET /identity/v3/role_assignments?user.id=2917275ac848431ab364bc258730628d&scope.domain.id=default&role.id=17e40821fc444dd0b040dcfce3eb222b => generated 233 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:33.986516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5bbec-fff3-40ce-982c-1f9e5e475b61 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:33.987067 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5bbec-fff3-40ce-982c-1f9e5e475b61 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:33.987067 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5bbec-fff3-40ce-982c-1f9e5e475b61 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:33.988755 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 12/22] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:34.000000 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf02914-bd73-42e6-a374-73a2fce11421 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:34.001010 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf02914-bd73-42e6-a374-73a2fce11421 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:34.002601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf02914-bd73-42e6-a374-73a2fce11421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:34.021271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-acf02914-bd73-42e6-a374-73a2fce11421 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:34.022899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-acf02914-bd73-42e6-a374-73a2fce11421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:34.096148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 11/23] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:34.119590 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5bbec-fff3-40ce-982c-1f9e5e475b61 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:34.167646 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a534da4-af10-44d2-b11d-b3d66e2ca232 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:34.168309 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a534da4-af10-44d2-b11d-b3d66e2ca232 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:34.168807 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a534da4-af10-44d2-b11d-b3d66e2ca232 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:34.170434 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 12/24] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:34.177243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a6083-6af5-41ae-8cfe-72739935192f None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:34.177852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a6083-6af5-41ae-8cfe-72739935192f None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:34.178374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a6083-6af5-41ae-8cfe-72739935192f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:34.207235 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-949a6083-6af5-41ae-8cfe-72739935192f None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:34.209743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-949a6083-6af5-41ae-8cfe-72739935192f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:34.362802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 13/25] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:34.367033 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5bbec-fff3-40ce-982c-1f9e5e475b61 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:34.410254 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e7f57-ec36-46bc-830d-1024215c2046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:34.411465 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e7f57-ec36-46bc-830d-1024215c2046 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:34.411949 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e7f57-ec36-46bc-830d-1024215c2046 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:34.412417 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e7f57-ec36-46bc-830d-1024215c2046 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:34.426125 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a6083-6af5-41ae-8cfe-72739935192f None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:34.434241 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e7f57-ec36-46bc-830d-1024215c2046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:34.440850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-b59e7f57-ec36-46bc-830d-1024215c2046 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:34.440850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:34.440850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:34.440850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:34.440850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:34.440850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:34.440850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:34.440850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:34.440850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:34.440850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:34.440850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:34.440850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:34.440850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:34.440850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:34.440850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:34.440850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:34.442363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:34.442363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:34.442363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:34.442363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:34.442363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:34.442363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:34.442363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:34.442363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:34.442363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:34.442363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:34.442363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:34.442363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:46:34.442363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:34.442363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:34.442363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:34.442363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:34.443625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:34.443625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:34.443625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:34.443625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:34.443625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:34.443625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:34.443625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:34.443625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:34.443625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:34.443625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:34.443625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:34.443625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:46:34.446593 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 13/26] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:46:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:34.458234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e7f57-ec36-46bc-830d-1024215c2046 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:34.701938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a6083-6af5-41ae-8cfe-72739935192f None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:34.729998 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e7f57-ec36-46bc-830d-1024215c2046 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:34.770910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4161bb-091c-432b-be66-32a078e8f349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:34.772109 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4161bb-091c-432b-be66-32a078e8f349 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:34.772397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4161bb-091c-432b-be66-32a078e8f349 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:34.772678 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4161bb-091c-432b-be66-32a078e8f349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:34.785572 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4161bb-091c-432b-be66-32a078e8f349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:34.791851 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4161bb-091c-432b-be66-32a078e8f349 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:34.825167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-0d4161bb-091c-432b-be66-32a078e8f349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:34.825167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:34.825167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:34.825167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:34.825167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:34.825167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:34.825167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:34.825167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:34.825167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:34.825167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:34.825167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:34.825167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:34.825167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:34.825167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:34.825167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:34.826026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:34.826026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:34.826026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:34.826026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:34.826026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:34.826026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:34.826026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:34.826026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:34.826026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:46:34.826026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:34.826026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:34.826026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:34.826026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:34.826026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:34.826026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:34.826026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:34.826026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:34.826883 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:34.826883 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:34.826883 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:34.826883 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:46:34.826883 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 14/27] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:34.829091 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5878b-3c40-4ff1-a01a-2c7a9c5d8cb9 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:34.829091 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5878b-3c40-4ff1-a01a-2c7a9c5d8cb9 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:34.829091 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5878b-3c40-4ff1-a01a-2c7a9c5d8cb9 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:34.830687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 15/28] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:34.835344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5878b-3c40-4ff1-a01a-2c7a9c5d8cb9 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:34.839110 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59999df1-8f23-42a5-9d43-92ca42676858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:34.839825 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59999df1-8f23-42a5-9d43-92ca42676858 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:34.840113 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59999df1-8f23-42a5-9d43-92ca42676858 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:34.840394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59999df1-8f23-42a5-9d43-92ca42676858 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:34.841173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59999df1-8f23-42a5-9d43-92ca42676858 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:34.841483 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59999df1-8f23-42a5-9d43-92ca42676858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:34.843485 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59999df1-8f23-42a5-9d43-92ca42676858 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:34.872576 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 14/29] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:46:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:34.873888 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5730a-1fc3-439c-abc8-97913a95e147 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:34.874225 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5730a-1fc3-439c-abc8-97913a95e147 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:34.874518 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5730a-1fc3-439c-abc8-97913a95e147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:34.911273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-f1a5730a-1fc3-439c-abc8-97913a95e147 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:34.912509 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-f1a5730a-1fc3-439c-abc8-97913a95e147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:34.969637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5878b-3c40-4ff1-a01a-2c7a9c5d8cb9 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:35.007337 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04271b89-2e91-4ab0-b000-3cfd4fe2adc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:35.008095 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04271b89-2e91-4ab0-b000-3cfd4fe2adc5 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:35.008293 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04271b89-2e91-4ab0-b000-3cfd4fe2adc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:35.008576 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04271b89-2e91-4ab0-b000-3cfd4fe2adc5 None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:35.009314 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04271b89-2e91-4ab0-b000-3cfd4fe2adc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:35.009621 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04271b89-2e91-4ab0-b000-3cfd4fe2adc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:35.011051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04271b89-2e91-4ab0-b000-3cfd4fe2adc5 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:35.026496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 16/30] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:35.027386 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04271b89-2e91-4ab0-b000-3cfd4fe2adc5 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:35.045606 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 15/31] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:35.055246 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40c1c5-8488-4f95-b8e0-2da13bf2ae7a None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:35.055536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40c1c5-8488-4f95-b8e0-2da13bf2ae7a None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:35.055808 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40c1c5-8488-4f95-b8e0-2da13bf2ae7a None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:35.057596 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 16/32] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:35 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:35.058393 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40c1c5-8488-4f95-b8e0-2da13bf2ae7a None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:35.134025 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04271b89-2e91-4ab0-b000-3cfd4fe2adc5 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:35.167359 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40c1c5-8488-4f95-b8e0-2da13bf2ae7a None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:35.169005 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26e312-2bce-47ee-9c05-f92e5d9b8592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:35.170090 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26e312-2bce-47ee-9c05-f92e5d9b8592 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:35.170410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26e312-2bce-47ee-9c05-f92e5d9b8592 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:35.170691 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26e312-2bce-47ee-9c05-f92e5d9b8592 None admin] PATH_INFO: `/v3/users/2917275ac848431ab364bc258730628d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:35.172471 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26e312-2bce-47ee-9c05-f92e5d9b8592 None admin] RBAC: Authorizing `identity:get_user(user_id=2917275ac848431ab364bc258730628d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:35.173926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26e312-2bce-47ee-9c05-f92e5d9b8592 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:35.179818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 17/33] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:46:35 2022] GET /identity/v3/users/2917275ac848431ab364bc258730628d => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:35.179818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2875dd-d88f-41b7-9f04-3efb559de4ee None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:35.179818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2875dd-d88f-41b7-9f04-3efb559de4ee None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:35.179818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2875dd-d88f-41b7-9f04-3efb559de4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:35.196143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-aa2875dd-d88f-41b7-9f04-3efb559de4ee None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:35.197259 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-aa2875dd-d88f-41b7-9f04-3efb559de4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:35.207807 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd4230-1599-45ee-8dc1-96712a6ee17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:35.208486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd4230-1599-45ee-8dc1-96712a6ee17c None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:35.208771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd4230-1599-45ee-8dc1-96712a6ee17c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:35.209052 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd4230-1599-45ee-8dc1-96712a6ee17c None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:35.209767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd4230-1599-45ee-8dc1-96712a6ee17c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:35.211316 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd4230-1599-45ee-8dc1-96712a6ee17c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:35.270422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 18/34] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:35.271466 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2875dd-d88f-41b7-9f04-3efb559de4ee None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:35.408208 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2875dd-d88f-41b7-9f04-3efb559de4ee None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:35.454677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73255c6-2b77-4ab7-9713-f6a5fafcff94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:35.455538 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73255c6-2b77-4ab7-9713-f6a5fafcff94 None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:35.455994 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73255c6-2b77-4ab7-9713-f6a5fafcff94 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:35.456424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73255c6-2b77-4ab7-9713-f6a5fafcff94 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:35.457722 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73255c6-2b77-4ab7-9713-f6a5fafcff94 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:35.459825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73255c6-2b77-4ab7-9713-f6a5fafcff94 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:35.485421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 17/35] 10.222.0.32 () {60 vars in 1141 bytes} [Tue May 10 13:46:35 2022] POST /identity/v3/projects => generated 301 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:46:35.485421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ffdbe-e2c7-4462-b2f9-7ecd25c15cbb None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:35.485421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ffdbe-e2c7-4462-b2f9-7ecd25c15cbb None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:35.485421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ffdbe-e2c7-4462-b2f9-7ecd25c15cbb None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:35.485421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 18/36] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:35.485421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ffdbe-e2c7-4462-b2f9-7ecd25c15cbb None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:35.602412 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 19/37] 10.222.0.32 () {60 vars in 1131 bytes} [Tue May 10 13:46:35 2022] POST /identity/v3/roles => generated 219 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:46:35.603591 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73255c6-2b77-4ab7-9713-f6a5fafcff94 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:35.661725 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ffdbe-e2c7-4462-b2f9-7ecd25c15cbb None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:35.708194 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd27fbb-5bfc-4450-96a1-c3c3abc3b4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:35.709022 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd27fbb-5bfc-4450-96a1-c3c3abc3b4a2 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:35.709302 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd27fbb-5bfc-4450-96a1-c3c3abc3b4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:35.709572 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd27fbb-5bfc-4450-96a1-c3c3abc3b4a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:35.711064 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd27fbb-5bfc-4450-96a1-c3c3abc3b4a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:35.712854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd27fbb-5bfc-4450-96a1-c3c3abc3b4a2 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:35.714976 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 19/38] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:46:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:35.716427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9a56c-89c2-4d84-9b9d-e8514b31fdf5 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:35.716777 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9a56c-89c2-4d84-9b9d-e8514b31fdf5 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:35.717052 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9a56c-89c2-4d84-9b9d-e8514b31fdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:35.739364 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-12e9a56c-89c2-4d84-9b9d-e8514b31fdf5 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:35.741074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-12e9a56c-89c2-4d84-9b9d-e8514b31fdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:35.754578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73255c6-2b77-4ab7-9713-f6a5fafcff94 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:35.797573 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcf3d6-0ce9-4e09-a1be-a3021b8319b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:35.798328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcf3d6-0ce9-4e09-a1be-a3021b8319b8 None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:35.798622 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcf3d6-0ce9-4e09-a1be-a3021b8319b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:35.798903 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcf3d6-0ce9-4e09-a1be-a3021b8319b8 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:35.799703 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcf3d6-0ce9-4e09-a1be-a3021b8319b8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:35.801571 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcf3d6-0ce9-4e09-a1be-a3021b8319b8 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:35.819794 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 20/39] 10.222.0.32 () {60 vars in 1131 bytes} [Tue May 10 13:46:35 2022] POST /identity/v3/roles => generated 223 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:46:35.822177 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1e64e-b0ff-4fd2-853c-2f481bf90a5f None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:35.822571 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1e64e-b0ff-4fd2-853c-2f481bf90a5f None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:35.822765 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1e64e-b0ff-4fd2-853c-2f481bf90a5f None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:35.824183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 21/40] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:35.825053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1e64e-b0ff-4fd2-853c-2f481bf90a5f None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:35.866180 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 20/41] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:35.867259 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b224bd-a88f-453a-9513-1d018dc41df0 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:35.867437 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b224bd-a88f-453a-9513-1d018dc41df0 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:35.868266 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b224bd-a88f-453a-9513-1d018dc41df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:35.891706 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-99b224bd-a88f-453a-9513-1d018dc41df0 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:35.893171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-99b224bd-a88f-453a-9513-1d018dc41df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:35.974978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1e64e-b0ff-4fd2-853c-2f481bf90a5f None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:36.006551 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 21/42] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:36.010521 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b224bd-a88f-453a-9513-1d018dc41df0 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:36.030996 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f18047-bdd5-47e3-9112-cd99e79dbaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:36.033200 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f18047-bdd5-47e3-9112-cd99e79dbaa2 None admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:36.033682 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f18047-bdd5-47e3-9112-cd99e79dbaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:36.034341 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f18047-bdd5-47e3-9112-cd99e79dbaa2 None admin] PATH_INFO: `/v3/domains/default/users/2917275ac848431ab364bc258730628d/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:36.037283 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f18047-bdd5-47e3-9112-cd99e79dbaa2 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2917275ac848431ab364bc258730628d, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:36.039803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f18047-bdd5-47e3-9112-cd99e79dbaa2 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:36.060662 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 22/43] 10.222.0.32 () {58 vars in 1361 bytes} [Tue May 10 13:46:35 2022] PUT /identity/v3/domains/default/users/2917275ac848431ab364bc258730628d/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:46:36.060848 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f18047-bdd5-47e3-9112-cd99e79dbaa2 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:36.143077 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b224bd-a88f-453a-9513-1d018dc41df0 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:36.183642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f404f-8798-4896-9fe8-44bbcf0202ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:36.184338 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f404f-8798-4896-9fe8-44bbcf0202ce None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:36.184621 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f404f-8798-4896-9fe8-44bbcf0202ce None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:36.185010 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f404f-8798-4896-9fe8-44bbcf0202ce None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:36.185628 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f18047-bdd5-47e3-9112-cd99e79dbaa2 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:36.185723 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f404f-8798-4896-9fe8-44bbcf0202ce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:36.187709 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f404f-8798-4896-9fe8-44bbcf0202ce None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:36.205283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 22/44] 10.222.0.32 () {60 vars in 1131 bytes} [Tue May 10 13:46:36 2022] POST /identity/v3/roles => generated 225 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:46:36.230159 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764de6d-22b0-41e4-8987-5b340dfd4344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:36.231075 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764de6d-22b0-41e4-8987-5b340dfd4344 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:36.231621 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764de6d-22b0-41e4-8987-5b340dfd4344 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:36.231906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764de6d-22b0-41e4-8987-5b340dfd4344 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:36.233993 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764de6d-22b0-41e4-8987-5b340dfd4344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:36.235631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764de6d-22b0-41e4-8987-5b340dfd4344 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:36.237737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 23/45] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:46:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:36.243532 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f404f-8798-4896-9fe8-44bbcf0202ce None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:36.372219 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f404f-8798-4896-9fe8-44bbcf0202ce None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:36.408931 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b931f-1df3-4f78-bfaa-4ffad5d0c340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:36.409524 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b931f-1df3-4f78-bfaa-4ffad5d0c340 None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:36.409808 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b931f-1df3-4f78-bfaa-4ffad5d0c340 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:36.410385 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b931f-1df3-4f78-bfaa-4ffad5d0c340 None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:36.410899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b931f-1df3-4f78-bfaa-4ffad5d0c340 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:36.412369 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b931f-1df3-4f78-bfaa-4ffad5d0c340 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:36.440429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 23/46] 10.222.0.32 () {60 vars in 1141 bytes} [Tue May 10 13:46:36 2022] POST /identity/v3/projects => generated 312 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:46:38.440496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d43585-8fd9-4787-91de-9949fe546457 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:38.441049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d43585-8fd9-4787-91de-9949fe546457 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:38.441049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d43585-8fd9-4787-91de-9949fe546457 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:38.442466 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 24/47] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:38.448273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc982e6-196d-4853-8d5e-feae187b94ca None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:38.448733 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc982e6-196d-4853-8d5e-feae187b94ca None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:38.448837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc982e6-196d-4853-8d5e-feae187b94ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:38.468248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-6bc982e6-196d-4853-8d5e-feae187b94ca None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:38.469470 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-6bc982e6-196d-4853-8d5e-feae187b94ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:38.578841 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 24/48] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:38.601820 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d43585-8fd9-4787-91de-9949fe546457 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:38.712652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d43585-8fd9-4787-91de-9949fe546457 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:38.734558 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719c259-6ec9-4a3a-9eed-1eb7195575ca None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:38.734948 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719c259-6ec9-4a3a-9eed-1eb7195575ca None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:38.735295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719c259-6ec9-4a3a-9eed-1eb7195575ca None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:38.736760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 25/49] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:38.742531 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a25ad8-0fba-44f5-821a-957be596d18a None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:38.742806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a25ad8-0fba-44f5-821a-957be596d18a None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:38.743082 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a25ad8-0fba-44f5-821a-957be596d18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:38.757732 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5d5fa-73ce-42f1-b7d5-667cf5b74cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:38.758737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5d5fa-73ce-42f1-b7d5-667cf5b74cd6 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:38.759030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5d5fa-73ce-42f1-b7d5-667cf5b74cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:38.759309 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5d5fa-73ce-42f1-b7d5-667cf5b74cd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:38.760362 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-02a25ad8-0fba-44f5-821a-957be596d18a None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:38.761561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-02a25ad8-0fba-44f5-821a-957be596d18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:38.772093 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5d5fa-73ce-42f1-b7d5-667cf5b74cd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:38.781171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-33d5d5fa-73ce-42f1-b7d5-667cf5b74cd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:38.781171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:38.781171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:38.781171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:38.781171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:38.781171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:38.781171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:38.781171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:38.781171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:38.781171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:38.781171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:38.781171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:38.781171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:38.781171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:38.781171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:38.781171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:38.782063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:38.782063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:38.782063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:38.782063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:38.782063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:38.782063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:38.782063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:38.782063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:38.782063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:38.782063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:38.782063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:38.782063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:46:38.782063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:38.782063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:38.782063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:38.782063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:38.782859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:38.782859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:38.782859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:38.782859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:38.782859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:38.782859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:38.782859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:38.782859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:38.782859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:38.782859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:38.782859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:38.782859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:46:38.782859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 25/50] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:46:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:38.790172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5d5fa-73ce-42f1-b7d5-667cf5b74cd6 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:38.836850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 26/51] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:38.861244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a25ad8-0fba-44f5-821a-957be596d18a None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:38.919829 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5d5fa-73ce-42f1-b7d5-667cf5b74cd6 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:38.957747 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598e851-2a7c-4c22-9c14-3926ed8dc3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:38.958472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598e851-2a7c-4c22-9c14-3926ed8dc3d7 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:38.958764 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598e851-2a7c-4c22-9c14-3926ed8dc3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:38.959047 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598e851-2a7c-4c22-9c14-3926ed8dc3d7 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:38.959831 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598e851-2a7c-4c22-9c14-3926ed8dc3d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:38.960143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598e851-2a7c-4c22-9c14-3926ed8dc3d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:38.961579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598e851-2a7c-4c22-9c14-3926ed8dc3d7 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:38.976163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 26/52] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:46:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:38.982485 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598e851-2a7c-4c22-9c14-3926ed8dc3d7 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:38.987273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a25ad8-0fba-44f5-821a-957be596d18a None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:39.025923 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53bbd73-990c-4764-9d01-18f7bbb30848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:39.027313 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bbd73-990c-4764-9d01-18f7bbb30848 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:39.027630 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bbd73-990c-4764-9d01-18f7bbb30848 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:39.027973 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bbd73-990c-4764-9d01-18f7bbb30848 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:39.030349 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53bbd73-990c-4764-9d01-18f7bbb30848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:39.032422 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53bbd73-990c-4764-9d01-18f7bbb30848 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:39.034130 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 27/53] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:46:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:39.040552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53bbd73-990c-4764-9d01-18f7bbb30848 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:39.098834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598e851-2a7c-4c22-9c14-3926ed8dc3d7 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:39.141377 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679558b7-6e32-4c7f-9018-85f7a130fccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:39.142354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679558b7-6e32-4c7f-9018-85f7a130fccf None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:39.142672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679558b7-6e32-4c7f-9018-85f7a130fccf None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:39.142980 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679558b7-6e32-4c7f-9018-85f7a130fccf None admin] PATH_INFO: `/v3/users/2917275ac848431ab364bc258730628d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:39.144444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679558b7-6e32-4c7f-9018-85f7a130fccf None admin] RBAC: Authorizing `identity:get_user(user_id=2917275ac848431ab364bc258730628d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:39.147904 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679558b7-6e32-4c7f-9018-85f7a130fccf None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:39.150131 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 27/54] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:46:38 2022] GET /identity/v3/users/2917275ac848431ab364bc258730628d => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:39.159190 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679558b7-6e32-4c7f-9018-85f7a130fccf None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:39.166688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53bbd73-990c-4764-9d01-18f7bbb30848 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:39.205900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d462b16-a3f8-4f17-8104-d45d8666b93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:39.206626 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d462b16-a3f8-4f17-8104-d45d8666b93c None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:39.207395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d462b16-a3f8-4f17-8104-d45d8666b93c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:39.207395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d462b16-a3f8-4f17-8104-d45d8666b93c None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:39.207906 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d462b16-a3f8-4f17-8104-d45d8666b93c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:39.209379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d462b16-a3f8-4f17-8104-d45d8666b93c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:39.237874 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 28/55] 10.222.0.32 () {60 vars in 1140 bytes} [Tue May 10 13:46:39 2022] POST /identity/v3/projects => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:46:39.297539 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679558b7-6e32-4c7f-9018-85f7a130fccf None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:39.361359 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2f3ad-5f86-4f0a-bf9b-7de8d7ea9118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:39.362814 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2f3ad-5f86-4f0a-bf9b-7de8d7ea9118 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:39.363327 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2f3ad-5f86-4f0a-bf9b-7de8d7ea9118 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:39.363826 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2f3ad-5f86-4f0a-bf9b-7de8d7ea9118 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:39.366108 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc2f3ad-5f86-4f0a-bf9b-7de8d7ea9118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:39.368356 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc2f3ad-5f86-4f0a-bf9b-7de8d7ea9118 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:39.370999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 28/56] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:46:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:39.381490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d462b16-a3f8-4f17-8104-d45d8666b93c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:39.513686 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d462b16-a3f8-4f17-8104-d45d8666b93c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:39.553225 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e2ee3-a02b-414a-bbc5-b5cdc8f8dde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:39.553891 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e2ee3-a02b-414a-bbc5-b5cdc8f8dde0 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:39.554174 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e2ee3-a02b-414a-bbc5-b5cdc8f8dde0 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:39.554481 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e2ee3-a02b-414a-bbc5-b5cdc8f8dde0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:39.555333 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e2ee3-a02b-414a-bbc5-b5cdc8f8dde0 None admin] RBAC: Adding query filter params (role.id=17e40821fc444dd0b040dcfce3eb222b, scope.domain.id=default, user.id=2917275ac848431ab364bc258730628d) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:39.555644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e2ee3-a02b-414a-bbc5-b5cdc8f8dde0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:39.557115 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e2ee3-a02b-414a-bbc5-b5cdc8f8dde0 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:39.568074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 29/57] 10.222.0.32 () {56 vars in 1322 bytes} [Tue May 10 13:46:39 2022] GET /identity/v3/role_assignments?user.id=2917275ac848431ab364bc258730628d&scope.domain.id=default&role.id=17e40821fc444dd0b040dcfce3eb222b => generated 530 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:41.582940 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432222cd-ad56-4ef8-b576-360f1cd348c9 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:41.583452 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432222cd-ad56-4ef8-b576-360f1cd348c9 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:41.583557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432222cd-ad56-4ef8-b576-360f1cd348c9 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:41.584870 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 29/58] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:41.590122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4aa23f-c0cf-4189-834f-5cdea0644f1e None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:41.590562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4aa23f-c0cf-4189-834f-5cdea0644f1e None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:41.590705 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4aa23f-c0cf-4189-834f-5cdea0644f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:41.607397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-9c4aa23f-c0cf-4189-834f-5cdea0644f1e None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:41.608812 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-9c4aa23f-c0cf-4189-834f-5cdea0644f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:41.674646 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 30/59] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:41.698571 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432222cd-ad56-4ef8-b576-360f1cd348c9 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:41.796812 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432222cd-ad56-4ef8-b576-360f1cd348c9 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:41.828979 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3554d-da86-4c80-8d25-8548a7a39682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:41.829773 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3554d-da86-4c80-8d25-8548a7a39682 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:41.830056 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3554d-da86-4c80-8d25-8548a7a39682 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:41.830359 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3554d-da86-4c80-8d25-8548a7a39682 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:41.831535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3554d-da86-4c80-8d25-8548a7a39682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:41.833048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3554d-da86-4c80-8d25-8548a7a39682 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:41.834676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 30/60] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:46:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:41.840110 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4aa23f-c0cf-4189-834f-5cdea0644f1e None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:41.941956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4aa23f-c0cf-4189-834f-5cdea0644f1e None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:41.975083 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf4abd-33ba-4058-af0b-b60612e39909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:41.975754 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf4abd-33ba-4058-af0b-b60612e39909 None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:41.976033 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf4abd-33ba-4058-af0b-b60612e39909 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:41.976306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf4abd-33ba-4058-af0b-b60612e39909 None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:41.977015 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf4abd-33ba-4058-af0b-b60612e39909 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:41.978496 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf4abd-33ba-4058-af0b-b60612e39909 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:42.004857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 31/61] 10.222.0.32 () {60 vars in 1132 bytes} [Tue May 10 13:46:41 2022] POST /identity/v3/users => generated 275 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:46:45.445594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa98fd8-2294-4352-b50f-20be2e37c40c None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:45.446179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa98fd8-2294-4352-b50f-20be2e37c40c None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:45.446179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa98fd8-2294-4352-b50f-20be2e37c40c None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:45.447580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 31/62] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:45.453649 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16230f1d-bc8c-423e-9a94-198cc4e96867 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:45.454165 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16230f1d-bc8c-423e-9a94-198cc4e96867 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:45.454289 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16230f1d-bc8c-423e-9a94-198cc4e96867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:45.477206 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-16230f1d-bc8c-423e-9a94-198cc4e96867 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:45.478459 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-16230f1d-bc8c-423e-9a94-198cc4e96867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:45.544849 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06652983-b0dc-4b37-83b1-363f31a0fb5f None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:45.546042 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06652983-b0dc-4b37-83b1-363f31a0fb5f None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:45.547200 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06652983-b0dc-4b37-83b1-363f31a0fb5f None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:45.552700 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 32/63] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:45.554643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb662-7335-4b3a-9f53-a7fb96e92297 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:45.555159 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb662-7335-4b3a-9f53-a7fb96e92297 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:45.555655 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb662-7335-4b3a-9f53-a7fb96e92297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:45.567621 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 32/64] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:45.587255 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-919cb662-7335-4b3a-9f53-a7fb96e92297 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:45.588819 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-919cb662-7335-4b3a-9f53-a7fb96e92297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:45.610509 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16230f1d-bc8c-423e-9a94-198cc4e96867 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:45.695894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 33/65] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:45.718252 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cb662-7335-4b3a-9f53-a7fb96e92297 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:45.797550 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16230f1d-bc8c-423e-9a94-198cc4e96867 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:45.829958 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cb662-7335-4b3a-9f53-a7fb96e92297 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:45.869166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93699933-aa62-4eed-8f01-97cda20b314f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:45.871012 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93699933-aa62-4eed-8f01-97cda20b314f None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:45.872015 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93699933-aa62-4eed-8f01-97cda20b314f None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:45.874444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93699933-aa62-4eed-8f01-97cda20b314f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:45.875989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415abcc-cf1a-464f-a4a7-4bf19ef3bd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:45.877699 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415abcc-cf1a-464f-a4a7-4bf19ef3bd1d None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:45.879767 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415abcc-cf1a-464f-a4a7-4bf19ef3bd1d None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:45.880305 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415abcc-cf1a-464f-a4a7-4bf19ef3bd1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:45.902282 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93699933-aa62-4eed-8f01-97cda20b314f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:45.911838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-93699933-aa62-4eed-8f01-97cda20b314f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:45.911838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:45.911838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:45.911838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:45.911838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:45.911838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:45.911838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:45.911838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:45.911838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:45.911838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:45.911838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:45.911838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:45.911838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:45.911838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:45.911838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:45.911838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:45.912815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:45.912815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:45.912815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:45.912815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:45.912815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:45.912815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:45.912815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:45.912815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:45.912815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:45.912815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:45.912815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:45.912815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:46:45.912815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:45.912815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:45.912815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:45.912815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:45.913580 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:45.913580 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:45.913580 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:45.913580 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:45.913580 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:45.913580 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:45.913580 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:45.913580 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:45.913580 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:45.913580 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:45.913580 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:45.913580 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:46:45.915336 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415abcc-cf1a-464f-a4a7-4bf19ef3bd1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:45.923635 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 33/66] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:46:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:45.924519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-5415abcc-cf1a-464f-a4a7-4bf19ef3bd1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:45.924519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:45.924519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:45.924519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:45.924519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:45.924519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:45.924519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:45.924519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:45.924519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:45.924519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:45.924519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:45.924519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:45.924519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:45.924519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:45.924519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:45.924519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:45.925426 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:45.925426 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:45.925426 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:45.925426 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:45.925426 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:45.925426 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:45.925426 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:45.925426 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:45.925426 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:45.925426 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:45.925426 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:45.925426 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:46:45.925426 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:45.925426 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:45.925426 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:45.925426 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:45.926175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:45.926175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:45.926175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:45.926175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:45.926175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:45.926175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:45.926175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:45.926175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:45.926175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:45.926175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:45.926175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:45.926175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:46:45.928868 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 34/67] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:46:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:45.929932 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93699933-aa62-4eed-8f01-97cda20b314f None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:45.939213 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415abcc-cf1a-464f-a4a7-4bf19ef3bd1d None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:46.047832 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93699933-aa62-4eed-8f01-97cda20b314f None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:46.086405 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dedfe-3b3c-4c32-a726-34c94f119b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:46.087205 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dedfe-3b3c-4c32-a726-34c94f119b57 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:46.087493 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dedfe-3b3c-4c32-a726-34c94f119b57 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:46.087770 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dedfe-3b3c-4c32-a726-34c94f119b57 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:46.088698 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dedfe-3b3c-4c32-a726-34c94f119b57 None admin] RBAC: Adding query filter params (name=member) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:46.089007 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dedfe-3b3c-4c32-a726-34c94f119b57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:46.090562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dedfe-3b3c-4c32-a726-34c94f119b57 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:46.101645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 34/68] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:46:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:46.107440 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415abcc-cf1a-464f-a4a7-4bf19ef3bd1d None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:46.108026 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd39e02-f93e-45f5-b414-2f56aa56587b None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:46.108295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd39e02-f93e-45f5-b414-2f56aa56587b None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:46.108572 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd39e02-f93e-45f5-b414-2f56aa56587b None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:46.110026 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 35/69] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:46.110873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd39e02-f93e-45f5-b414-2f56aa56587b None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:46.153287 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b17c65-ebeb-4dbc-bc0c-13709fc4ad36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:46.154276 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b17c65-ebeb-4dbc-bc0c-13709fc4ad36 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:46.154711 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b17c65-ebeb-4dbc-bc0c-13709fc4ad36 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:46.155842 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b17c65-ebeb-4dbc-bc0c-13709fc4ad36 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:46.156860 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b17c65-ebeb-4dbc-bc0c-13709fc4ad36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:46.157343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b17c65-ebeb-4dbc-bc0c-13709fc4ad36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:46.158944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b17c65-ebeb-4dbc-bc0c-13709fc4ad36 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:46.167876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 35/70] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:46:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:46.169559 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f18dd-b649-4244-81d5-bb765f7ae997 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:46.170002 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f18dd-b649-4244-81d5-bb765f7ae997 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:46.170694 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f18dd-b649-4244-81d5-bb765f7ae997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:46.189959 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-027f18dd-b649-4244-81d5-bb765f7ae997 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:46.191440 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-027f18dd-b649-4244-81d5-bb765f7ae997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:46.220284 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd39e02-f93e-45f5-b414-2f56aa56587b None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:46.256463 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb6778-cb60-4517-8745-7dae79997c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:46.257403 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb6778-cb60-4517-8745-7dae79997c10 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:46.257728 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb6778-cb60-4517-8745-7dae79997c10 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:46.258141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb6778-cb60-4517-8745-7dae79997c10 None admin] PATH_INFO: `/v3/users/a1d7a40db9484e8d8f3167ff53fb5b8a` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:46.266493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 36/71] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:46.275538 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f18dd-b649-4244-81d5-bb765f7ae997 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:46.276107 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb6778-cb60-4517-8745-7dae79997c10 None admin] RBAC: Authorizing `identity:get_user(user_id=a1d7a40db9484e8d8f3167ff53fb5b8a)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:46.277632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb6778-cb60-4517-8745-7dae79997c10 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:46.279621 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 36/72] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:46:46 2022] GET /identity/v3/users/a1d7a40db9484e8d8f3167ff53fb5b8a => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:46.288027 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb6778-cb60-4517-8745-7dae79997c10 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:46.399289 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f18dd-b649-4244-81d5-bb765f7ae997 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:46.406826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb6778-cb60-4517-8745-7dae79997c10 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:46.435144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3ccc2-2acd-4a9f-b028-76a433451c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:46.436024 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3ccc2-2acd-4a9f-b028-76a433451c48 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:46.436340 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3ccc2-2acd-4a9f-b028-76a433451c48 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:46.436683 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3ccc2-2acd-4a9f-b028-76a433451c48 None admin] PATH_INFO: `/v3/users/2917275ac848431ab364bc258730628d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:46.437862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3ccc2-2acd-4a9f-b028-76a433451c48 None admin] RBAC: Authorizing `identity:get_user(user_id=2917275ac848431ab364bc258730628d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:46.439353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3ccc2-2acd-4a9f-b028-76a433451c48 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:46.440961 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 37/73] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:46:46 2022] GET /identity/v3/users/2917275ac848431ab364bc258730628d => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:46.441712 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3ccc2-2acd-4a9f-b028-76a433451c48 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:46.447909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da66419-d737-4108-9dea-05224d6f9913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:46.448573 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da66419-d737-4108-9dea-05224d6f9913 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:46.448859 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da66419-d737-4108-9dea-05224d6f9913 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:46.449141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da66419-d737-4108-9dea-05224d6f9913 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:46.532791 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da66419-d737-4108-9dea-05224d6f9913 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:46.534299 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da66419-d737-4108-9dea-05224d6f9913 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:46.588737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3ccc2-2acd-4a9f-b028-76a433451c48 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:46.626260 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbb3f9-f171-4290-aba0-fbe6e3fccd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:46.627090 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbb3f9-f171-4290-aba0-fbe6e3fccd4e None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:46.627367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbb3f9-f171-4290-aba0-fbe6e3fccd4e None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:46.627640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbb3f9-f171-4290-aba0-fbe6e3fccd4e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:46.638159 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 37/74] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:46:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:46.638349 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbb3f9-f171-4290-aba0-fbe6e3fccd4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:46.639479 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d9c14-344f-4010-96f5-212df6bab1ef None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:46.639851 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d9c14-344f-4010-96f5-212df6bab1ef None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:46.640130 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d9c14-344f-4010-96f5-212df6bab1ef None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:46.642565 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 38/75] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:46.642565 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d9c14-344f-4010-96f5-212df6bab1ef None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:46.647003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-aacbb3f9-f171-4290-aba0-fbe6e3fccd4e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:46.647003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:46.647003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:46.647003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:46.647003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:46.647003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:46.647003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:46.647003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:46.647003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:46.647003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:46.647003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:46.647003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:46.647003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:46.647003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:46.647003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:46.647003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:46.647882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:46.647882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:46.647882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:46.647882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:46.647882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:46.647882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:46.647882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:46.647882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:46.647882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:46.647882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:46.647882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:46.647882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:46:46.647882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:46.647882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:46.647882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:46.647882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:46.648629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:46.648629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:46.648629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:46.648629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:46.648629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:46.648629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:46.648629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:46.648629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:46.648629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:46.648629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:46.648629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:46.648629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:46:46.648629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 38/76] 10.222.0.32 () {56 vars in 1114 bytes} [Tue May 10 13:46:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:46.650903 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492fb28-4753-4116-90d2-d2a9602542fa None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:46.651261 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492fb28-4753-4116-90d2-d2a9602542fa None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:46.651594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492fb28-4753-4116-90d2-d2a9602542fa None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:46.653356 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 39/77] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:46.654107 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492fb28-4753-4116-90d2-d2a9602542fa None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:46.784438 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d9c14-344f-4010-96f5-212df6bab1ef None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:46.797239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492fb28-4753-4116-90d2-d2a9602542fa None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:46.838113 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe1c8f-a0a7-41e4-9072-01904621d6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:46.839186 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe1c8f-a0a7-41e4-9072-01904621d6db None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:46.839648 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe1c8f-a0a7-41e4-9072-01904621d6db None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:46.840038 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe1c8f-a0a7-41e4-9072-01904621d6db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:46.851444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fca9a-ddc6-4091-b973-ab2b12a5be31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:46.852830 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fca9a-ddc6-4091-b973-ab2b12a5be31 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:46.853331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fca9a-ddc6-4091-b973-ab2b12a5be31 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:46.853740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fca9a-ddc6-4091-b973-ab2b12a5be31 None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:46.855647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9fca9a-ddc6-4091-b973-ab2b12a5be31 None admin] RBAC: Authorizing `identity:get_project(project_id=03067c95202a44bbae7686a1a4886b44)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:46.859124 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9fca9a-ddc6-4091-b973-ab2b12a5be31 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:46.866590 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 40/78] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:46:46 2022] GET /identity/v3/projects/03067c95202a44bbae7686a1a4886b44 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:46.866590 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf344b3d-2f7c-4406-b9ff-4cec650d6cb4 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:46.866590 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf344b3d-2f7c-4406-b9ff-4cec650d6cb4 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:46.866590 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf344b3d-2f7c-4406-b9ff-4cec650d6cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:46.881645 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-cf344b3d-2f7c-4406-b9ff-4cec650d6cb4 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:46.882864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-cf344b3d-2f7c-4406-b9ff-4cec650d6cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:46.919961 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe1c8f-a0a7-41e4-9072-01904621d6db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:46.921965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe1c8f-a0a7-41e4-9072-01904621d6db None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:46.950412 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 41/79] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:46.951266 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf344b3d-2f7c-4406-b9ff-4cec650d6cb4 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:47.019582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 39/80] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:46:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:47.020885 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90266b5c-3695-4740-a239-633e48e75cee None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:47.021205 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90266b5c-3695-4740-a239-633e48e75cee None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:47.021451 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90266b5c-3695-4740-a239-633e48e75cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:47.037836 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-90266b5c-3695-4740-a239-633e48e75cee None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:47.039070 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-90266b5c-3695-4740-a239-633e48e75cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:47.060946 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf344b3d-2f7c-4406-b9ff-4cec650d6cb4 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:47.095882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02bc4a-f896-4631-b94a-bdf463be192b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:47.096568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02bc4a-f896-4631-b94a-bdf463be192b None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:47.096854 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02bc4a-f896-4631-b94a-bdf463be192b None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:47.097137 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02bc4a-f896-4631-b94a-bdf463be192b None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:47.097895 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02bc4a-f896-4631-b94a-bdf463be192b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:47.098227 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02bc4a-f896-4631-b94a-bdf463be192b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:47.099632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02bc4a-f896-4631-b94a-bdf463be192b None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:47.107663 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 42/81] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:46:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:47.108789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02bc4a-f896-4631-b94a-bdf463be192b None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:47.109331 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 40/82] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:47.110163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90266b5c-3695-4740-a239-633e48e75cee None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:47.209835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02bc4a-f896-4631-b94a-bdf463be192b None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:47.212512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90266b5c-3695-4740-a239-633e48e75cee None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:47.250769 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09bb9d-1a1c-4b24-9fae-d8de981271dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:47.251096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6777f-6251-4e2d-bc52-83228af7e001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:47.251597 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09bb9d-1a1c-4b24-9fae-d8de981271dc None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:47.251773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6777f-6251-4e2d-bc52-83228af7e001 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:47.251991 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09bb9d-1a1c-4b24-9fae-d8de981271dc None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:47.252147 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6777f-6251-4e2d-bc52-83228af7e001 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:47.252303 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6777f-6251-4e2d-bc52-83228af7e001 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:47.252445 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09bb9d-1a1c-4b24-9fae-d8de981271dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:47.253365 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09bb9d-1a1c-4b24-9fae-d8de981271dc None admin] RBAC: Adding query filter params (role.id=34ef75b7c6d54c5e81edbfee2f4b362d, scope.project.id=03067c95202a44bbae7686a1a4886b44, user.id=a1d7a40db9484e8d8f3167ff53fb5b8a) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:47.253743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09bb9d-1a1c-4b24-9fae-d8de981271dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:47.255604 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09bb9d-1a1c-4b24-9fae-d8de981271dc None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:47.263536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 43/83] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:46:47 2022] GET /identity/v3/role_assignments?user.id=a1d7a40db9484e8d8f3167ff53fb5b8a&scope.project.id=03067c95202a44bbae7686a1a4886b44&role.id=34ef75b7c6d54c5e81edbfee2f4b362d => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:47.265276 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09bb9d-1a1c-4b24-9fae-d8de981271dc None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:47.271551 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6777f-6251-4e2d-bc52-83228af7e001 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:47.283512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-1ba6777f-6251-4e2d-bc52-83228af7e001 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:47.283512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:47.283512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:47.283512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:47.283512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:47.283512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:47.283512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:47.283512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:47.283512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:47.283512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:47.283512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:47.283512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:47.283512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:47.283512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:47.283512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:47.283512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:47.284965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:47.284965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:47.284965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:47.284965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:47.284965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:47.284965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:47.284965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:47.284965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:47.284965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:47.284965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:47.284965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:47.284965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:46:47.284965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:47.284965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:47.284965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:47.284965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:47.285783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:47.285783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:47.285783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:47.285783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:47.285783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:47.285783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:47.285783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:47.285783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:47.285783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:47.285783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:47.285783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:47.285783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:46:47.286969 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 41/84] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:46:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:47.287924 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6777f-6251-4e2d-bc52-83228af7e001 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:47.428512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09bb9d-1a1c-4b24-9fae-d8de981271dc None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:47.448811 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6777f-6251-4e2d-bc52-83228af7e001 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:47.484140 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc02b9-c585-446c-895c-57c25240b8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:47.485600 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc02b9-c585-446c-895c-57c25240b8f8 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:47.486084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc02b9-c585-446c-895c-57c25240b8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:47.486595 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc02b9-c585-446c-895c-57c25240b8f8 None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:47.488777 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc02b9-c585-446c-895c-57c25240b8f8 None admin] RBAC: Authorizing `identity:get_project(project_id=03067c95202a44bbae7686a1a4886b44)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:47.491576 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc02b9-c585-446c-895c-57c25240b8f8 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:47.495206 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 44/85] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:46:47 2022] GET /identity/v3/projects/03067c95202a44bbae7686a1a4886b44 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:47.496503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc02b9-c585-446c-895c-57c25240b8f8 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:47.503869 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4c2ea-0269-427d-872d-8a6c21bedc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:47.504971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4c2ea-0269-427d-872d-8a6c21bedc99 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:47.505397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4c2ea-0269-427d-872d-8a6c21bedc99 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:47.505797 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4c2ea-0269-427d-872d-8a6c21bedc99 None admin] PATH_INFO: `/v3/users/a1d7a40db9484e8d8f3167ff53fb5b8a` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:47.507704 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4c2ea-0269-427d-872d-8a6c21bedc99 None admin] RBAC: Authorizing `identity:get_user(user_id=a1d7a40db9484e8d8f3167ff53fb5b8a)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:47.509420 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4c2ea-0269-427d-872d-8a6c21bedc99 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:47.511386 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 42/86] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:46:47 2022] GET /identity/v3/users/a1d7a40db9484e8d8f3167ff53fb5b8a => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:47.512782 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4c2ea-0269-427d-872d-8a6c21bedc99 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:47.658667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4c2ea-0269-427d-872d-8a6c21bedc99 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:47.666657 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc02b9-c585-446c-895c-57c25240b8f8 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:47.710141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904086c-f1f5-433e-996c-034ce70b44b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:47.711381 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904086c-f1f5-433e-996c-034ce70b44b7 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:47.711888 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904086c-f1f5-433e-996c-034ce70b44b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:47.712387 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904086c-f1f5-433e-996c-034ce70b44b7 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:47.714049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904086c-f1f5-433e-996c-034ce70b44b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:47.714445 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904086c-f1f5-433e-996c-034ce70b44b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:47.715498 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433794f-b835-4102-a25d-c1e8a1624979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:47.716785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433794f-b835-4102-a25d-c1e8a1624979 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:47.717258 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904086c-f1f5-433e-996c-034ce70b44b7 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:47.718077 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433794f-b835-4102-a25d-c1e8a1624979 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:47.718629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433794f-b835-4102-a25d-c1e8a1624979 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:47.720213 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433794f-b835-4102-a25d-c1e8a1624979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:47.722041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433794f-b835-4102-a25d-c1e8a1624979 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:47.732717 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 45/87] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:46:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:47.732717 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433794f-b835-4102-a25d-c1e8a1624979 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:47.743095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 43/88] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:46:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:47.744024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904086c-f1f5-433e-996c-034ce70b44b7 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:47.895046 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433794f-b835-4102-a25d-c1e8a1624979 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:47.916264 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904086c-f1f5-433e-996c-034ce70b44b7 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:47.938593 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72599fc-9855-4cd1-a526-b7c02dc84b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:47.939528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72599fc-9855-4cd1-a526-b7c02dc84b88 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:47.939983 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72599fc-9855-4cd1-a526-b7c02dc84b88 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:47.940444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72599fc-9855-4cd1-a526-b7c02dc84b88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:47.941306 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72599fc-9855-4cd1-a526-b7c02dc84b88 None admin] RBAC: Adding query filter params (role.id=17e40821fc444dd0b040dcfce3eb222b, scope.project.id=03067c95202a44bbae7686a1a4886b44, user.id=2917275ac848431ab364bc258730628d) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:47.941621 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72599fc-9855-4cd1-a526-b7c02dc84b88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:47.943154 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72599fc-9855-4cd1-a526-b7c02dc84b88 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:47.949899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 46/89] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:46:47 2022] GET /identity/v3/role_assignments?user.id=2917275ac848431ab364bc258730628d&scope.project.id=03067c95202a44bbae7686a1a4886b44&role.id=17e40821fc444dd0b040dcfce3eb222b => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:47.950781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72599fc-9855-4cd1-a526-b7c02dc84b88 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:47.978434 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bad486-de34-46ca-ada1-78f8681a8c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:47.979540 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bad486-de34-46ca-ada1-78f8681a8c17 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:47.980147 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bad486-de34-46ca-ada1-78f8681a8c17 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:47.980715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bad486-de34-46ca-ada1-78f8681a8c17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:48.109553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72599fc-9855-4cd1-a526-b7c02dc84b88 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:48.110785 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bad486-de34-46ca-ada1-78f8681a8c17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:48.114077 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bad486-de34-46ca-ada1-78f8681a8c17 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:48.157787 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882844e2-5c23-4380-aee0-713076cfe4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:48.158544 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882844e2-5c23-4380-aee0-713076cfe4d8 None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:48.158834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882844e2-5c23-4380-aee0-713076cfe4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:48.159116 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882844e2-5c23-4380-aee0-713076cfe4d8 None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:48.159871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882844e2-5c23-4380-aee0-713076cfe4d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:48.161691 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882844e2-5c23-4380-aee0-713076cfe4d8 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:48.206502 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 47/90] 10.222.0.32 () {60 vars in 1132 bytes} [Tue May 10 13:46:47 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:46:48.211320 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882844e2-5c23-4380-aee0-713076cfe4d8 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:48.339569 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 44/91] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:46:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:48.350248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bad486-de34-46ca-ada1-78f8681a8c17 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:48.459600 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882844e2-5c23-4380-aee0-713076cfe4d8 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:48.542437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af730318-5c54-44a2-8404-5b3283959e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:48.544396 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af730318-5c54-44a2-8404-5b3283959e5b None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:48.545211 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af730318-5c54-44a2-8404-5b3283959e5b None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:48.546040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af730318-5c54-44a2-8404-5b3283959e5b None admin] PATH_INFO: `/v3/users/a1d7a40db9484e8d8f3167ff53fb5b8a` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:48.548804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af730318-5c54-44a2-8404-5b3283959e5b None admin] RBAC: Authorizing `identity:get_user(user_id=a1d7a40db9484e8d8f3167ff53fb5b8a)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:48.551532 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bad486-de34-46ca-ada1-78f8681a8c17 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:48.552123 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af730318-5c54-44a2-8404-5b3283959e5b None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:48.555623 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 48/92] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:46:48 2022] GET /identity/v3/users/a1d7a40db9484e8d8f3167ff53fb5b8a => generated 275 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:48.563329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af730318-5c54-44a2-8404-5b3283959e5b None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:48.590461 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6043d-ed48-4480-86c2-f2fe90f2def4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:48.592030 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6043d-ed48-4480-86c2-f2fe90f2def4 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:48.593161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6043d-ed48-4480-86c2-f2fe90f2def4 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:48.593603 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6043d-ed48-4480-86c2-f2fe90f2def4 None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:48.595946 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6043d-ed48-4480-86c2-f2fe90f2def4 None admin] RBAC: Authorizing `identity:get_project(project_id=03067c95202a44bbae7686a1a4886b44)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:48.597516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6043d-ed48-4480-86c2-f2fe90f2def4 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:48.599735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 45/93] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:46:48 2022] GET /identity/v3/projects/03067c95202a44bbae7686a1a4886b44 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:48.610189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6043d-ed48-4480-86c2-f2fe90f2def4 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:48.683844 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af730318-5c54-44a2-8404-5b3283959e5b None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:48.722234 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5986b9-dba9-4a22-8bff-710a834fe538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:48.722814 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5986b9-dba9-4a22-8bff-710a834fe538 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:48.723102 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5986b9-dba9-4a22-8bff-710a834fe538 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:48.723386 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5986b9-dba9-4a22-8bff-710a834fe538 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:48.771823 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6043d-ed48-4480-86c2-f2fe90f2def4 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:48.812555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5986b9-dba9-4a22-8bff-710a834fe538 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:48.813551 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b80398-4af3-41cc-96d5-a59f20a45b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:48.814105 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5986b9-dba9-4a22-8bff-710a834fe538 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:48.814388 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b80398-4af3-41cc-96d5-a59f20a45b28 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:48.814644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b80398-4af3-41cc-96d5-a59f20a45b28 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:48.814893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b80398-4af3-41cc-96d5-a59f20a45b28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:48.815697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b80398-4af3-41cc-96d5-a59f20a45b28 None admin] RBAC: Adding query filter params (role.id=316da37136b4425f9ae486ae1e2bf4b4, scope.project.id=03067c95202a44bbae7686a1a4886b44, user.id=a1d7a40db9484e8d8f3167ff53fb5b8a) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:48.816008 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b80398-4af3-41cc-96d5-a59f20a45b28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:48.817619 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b80398-4af3-41cc-96d5-a59f20a45b28 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:48.824894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 46/94] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:46:48 2022] GET /identity/v3/role_assignments?user.id=a1d7a40db9484e8d8f3167ff53fb5b8a&scope.project.id=03067c95202a44bbae7686a1a4886b44&role.id=316da37136b4425f9ae486ae1e2bf4b4 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:48.940922 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 49/95] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:46:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:48.947419 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b80398-4af3-41cc-96d5-a59f20a45b28 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:49.086851 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b80398-4af3-41cc-96d5-a59f20a45b28 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:49.129611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cef4ce-d903-4a82-9fc7-d238e924f34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:49.130538 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cef4ce-d903-4a82-9fc7-d238e924f34f None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:49.130890 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cef4ce-d903-4a82-9fc7-d238e924f34f None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:49.131169 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cef4ce-d903-4a82-9fc7-d238e924f34f None admin] PATH_INFO: `/v3/projects/477a8d374cd243488078d49785d3ba19` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:49.132459 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cef4ce-d903-4a82-9fc7-d238e924f34f None admin] RBAC: Authorizing `identity:get_project(project_id=477a8d374cd243488078d49785d3ba19)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:49.134107 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cef4ce-d903-4a82-9fc7-d238e924f34f None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:49.135934 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 47/96] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:46:48 2022] GET /identity/v3/projects/477a8d374cd243488078d49785d3ba19 => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:49.142940 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5986b9-dba9-4a22-8bff-710a834fe538 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:49.261982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5986b9-dba9-4a22-8bff-710a834fe538 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:49.309390 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e61db8-dddf-4320-a376-d13757d141fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:49.310072 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e61db8-dddf-4320-a376-d13757d141fe None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:49.310382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e61db8-dddf-4320-a376-d13757d141fe None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:49.310656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e61db8-dddf-4320-a376-d13757d141fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:49.311566 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e61db8-dddf-4320-a376-d13757d141fe None admin] RBAC: Adding query filter params (role.id=34ef75b7c6d54c5e81edbfee2f4b362d, scope.project.id=477a8d374cd243488078d49785d3ba19, user.id=a1d7a40db9484e8d8f3167ff53fb5b8a) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:49.311878 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e61db8-dddf-4320-a376-d13757d141fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:49.313448 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e61db8-dddf-4320-a376-d13757d141fe None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:49.322902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 50/97] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:46:49 2022] GET /identity/v3/role_assignments?user.id=a1d7a40db9484e8d8f3167ff53fb5b8a&scope.project.id=477a8d374cd243488078d49785d3ba19&role.id=34ef75b7c6d54c5e81edbfee2f4b362d => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:51.243451 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86eb49-f5b0-4319-8ab5-9e0dd661c5a3 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:51.243934 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86eb49-f5b0-4319-8ab5-9e0dd661c5a3 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:51.244378 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86eb49-f5b0-4319-8ab5-9e0dd661c5a3 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:51.246937 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 48/98] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:51.255815 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9a639-3b30-497d-817e-49f2597bb6cb None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:51.255815 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9a639-3b30-497d-817e-49f2597bb6cb None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:51.255815 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9a639-3b30-497d-817e-49f2597bb6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:51.283501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-dcf9a639-3b30-497d-817e-49f2597bb6cb None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:51.285201 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-dcf9a639-3b30-497d-817e-49f2597bb6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:51.388036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 51/99] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:51.432060 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86eb49-f5b0-4319-8ab5-9e0dd661c5a3 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:51.567617 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86eb49-f5b0-4319-8ab5-9e0dd661c5a3 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:51.613433 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08243bb5-112d-47cc-87d8-b21f2f53313e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:51.614654 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08243bb5-112d-47cc-87d8-b21f2f53313e None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:51.615143 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08243bb5-112d-47cc-87d8-b21f2f53313e None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:51.615645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08243bb5-112d-47cc-87d8-b21f2f53313e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:51.639358 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08243bb5-112d-47cc-87d8-b21f2f53313e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:51.648085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-08243bb5-112d-47cc-87d8-b21f2f53313e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:51.648085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:51.648085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:51.648085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:51.648085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:51.648085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:51.648085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:51.648085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:51.648085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:51.648085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:51.648085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:51.648085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:51.648085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:51.648085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:51.648085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:51.648085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:51.649024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:51.649024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:51.649024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:51.649024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:51.649024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:51.649024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:51.649024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:51.649024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:51.649024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:51.649024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:51.649024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:51.649024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:46:51.649024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:51.649024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:51.649024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:51.649024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:51.649763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:51.649763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:51.649763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:51.649763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:51.649763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:51.649763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:51.649763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:51.649763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:51.649763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:51.649763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:51.649763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:51.649763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:46:51.652685 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 49/100] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:46:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:51.659704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9a639-3b30-497d-817e-49f2597bb6cb None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:51.790512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9a639-3b30-497d-817e-49f2597bb6cb None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:51.845183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd4c35-2770-4c1a-a91f-0b3e8442dbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:51.846272 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd4c35-2770-4c1a-a91f-0b3e8442dbb9 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:51.846778 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd4c35-2770-4c1a-a91f-0b3e8442dbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:51.847260 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd4c35-2770-4c1a-a91f-0b3e8442dbb9 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:51.848356 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd4c35-2770-4c1a-a91f-0b3e8442dbb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:51.848868 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd4c35-2770-4c1a-a91f-0b3e8442dbb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:51.850558 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd4c35-2770-4c1a-a91f-0b3e8442dbb9 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:51.867634 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 52/101] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:46:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:51.875216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08243bb5-112d-47cc-87d8-b21f2f53313e None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:52.023360 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08243bb5-112d-47cc-87d8-b21f2f53313e None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:52.067851 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec144f-6fcb-433d-a025-3c2785326e04 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:52.068128 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec144f-6fcb-433d-a025-3c2785326e04 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:52.068439 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec144f-6fcb-433d-a025-3c2785326e04 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:52.069975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 53/102] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:52.079452 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbcf0a-c901-4548-ae68-c1f54da1efb8 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:52.079971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbcf0a-c901-4548-ae68-c1f54da1efb8 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:52.080414 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbcf0a-c901-4548-ae68-c1f54da1efb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:52.086041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26753a-a46b-4665-af9e-6b12e1d3cb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:52.088112 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26753a-a46b-4665-af9e-6b12e1d3cb12 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:52.088567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26753a-a46b-4665-af9e-6b12e1d3cb12 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:52.094804 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26753a-a46b-4665-af9e-6b12e1d3cb12 None admin] PATH_INFO: `/v3/users/a1d7a40db9484e8d8f3167ff53fb5b8a` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:52.096992 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26753a-a46b-4665-af9e-6b12e1d3cb12 None admin] RBAC: Authorizing `identity:get_user(user_id=a1d7a40db9484e8d8f3167ff53fb5b8a)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:52.098901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26753a-a46b-4665-af9e-6b12e1d3cb12 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:52.102381 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 50/103] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:46:51 2022] GET /identity/v3/users/a1d7a40db9484e8d8f3167ff53fb5b8a => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:52.111801 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26753a-a46b-4665-af9e-6b12e1d3cb12 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:52.113605 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-f9fbcf0a-c901-4548-ae68-c1f54da1efb8 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:52.115483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f9fbcf0a-c901-4548-ae68-c1f54da1efb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:52.289987 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 54/104] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:52.291707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8bdb1-ca6e-4530-b9e8-cd2dee65d125 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:52.292096 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8bdb1-ca6e-4530-b9e8-cd2dee65d125 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:52.292345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8bdb1-ca6e-4530-b9e8-cd2dee65d125 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:52.296929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 55/105] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:52.313601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d99b7-7b27-4149-a038-e7fe7b3c6818 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:52.314007 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d99b7-7b27-4149-a038-e7fe7b3c6818 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:52.314188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d99b7-7b27-4149-a038-e7fe7b3c6818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:52.333268 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26753a-a46b-4665-af9e-6b12e1d3cb12 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:52.347475 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-7a6d99b7-7b27-4149-a038-e7fe7b3c6818 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:52.348665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-7a6d99b7-7b27-4149-a038-e7fe7b3c6818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:52.407218 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12694aaf-65d7-4523-92aa-793be85ff87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:52.408133 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12694aaf-65d7-4523-92aa-793be85ff87d None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:52.408425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12694aaf-65d7-4523-92aa-793be85ff87d None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:52.408705 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12694aaf-65d7-4523-92aa-793be85ff87d None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:52.411617 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12694aaf-65d7-4523-92aa-793be85ff87d None admin] RBAC: Authorizing `identity:get_project(project_id=03067c95202a44bbae7686a1a4886b44)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:52.413255 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12694aaf-65d7-4523-92aa-793be85ff87d None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:52.415222 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 51/106] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:46:52 2022] GET /identity/v3/projects/03067c95202a44bbae7686a1a4886b44 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:52.418803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12694aaf-65d7-4523-92aa-793be85ff87d None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:52.510473 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 56/107] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:52.511511 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d99b7-7b27-4149-a038-e7fe7b3c6818 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:52.614389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12694aaf-65d7-4523-92aa-793be85ff87d None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:52.656207 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c1b07-437d-4fd9-b5b5-6f9d352001f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:52.657718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c1b07-437d-4fd9-b5b5-6f9d352001f1 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:52.658282 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c1b07-437d-4fd9-b5b5-6f9d352001f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:52.658942 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c1b07-437d-4fd9-b5b5-6f9d352001f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:52.674294 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c1b07-437d-4fd9-b5b5-6f9d352001f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:52.682250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-ad6c1b07-437d-4fd9-b5b5-6f9d352001f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:52.682250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:52.682250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:52.682250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:52.682250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:52.682250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:52.682250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:52.682250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:52.682250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:52.682250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:52.682250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:52.682250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:52.682250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:52.682250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:52.682250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:52.682250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:52.683171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:52.683171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:52.683171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:52.683171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:52.683171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:52.683171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:52.683171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:52.683171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:52.683171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:52.683171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:52.683171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:52.683171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:46:52.683171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:52.683171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:52.683171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:52.683171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:52.683920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:52.683920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:52.683920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:52.683920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:52.683920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:52.683920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:52.683920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:52.683920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:52.683920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:52.683920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:52.683920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:52.683920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:46:52.683920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 52/108] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:46:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:52.684531 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c1b07-437d-4fd9-b5b5-6f9d352001f1 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:52.715834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d99b7-7b27-4149-a038-e7fe7b3c6818 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:52.758385 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75cdfa-253a-43bd-9b79-54e761dc1a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:52.759734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75cdfa-253a-43bd-9b79-54e761dc1a77 None admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:52.760230 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75cdfa-253a-43bd-9b79-54e761dc1a77 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:52.760720 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75cdfa-253a-43bd-9b79-54e761dc1a77 None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44/users/a1d7a40db9484e8d8f3167ff53fb5b8a/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:52.763189 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75cdfa-253a-43bd-9b79-54e761dc1a77 None admin] RBAC: Authorizing `identity:create_grant(project_id=03067c95202a44bbae7686a1a4886b44, user_id=a1d7a40db9484e8d8f3167ff53fb5b8a, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:52.765073 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75cdfa-253a-43bd-9b79-54e761dc1a77 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:52.786088 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 57/109] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:46:52 2022] PUT /identity/v3/projects/03067c95202a44bbae7686a1a4886b44/users/a1d7a40db9484e8d8f3167ff53fb5b8a/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:46:52.788300 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d5cc7-8876-47c9-98c1-fadf2e691fb0 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:52.789126 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d5cc7-8876-47c9-98c1-fadf2e691fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:52.790165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d5cc7-8876-47c9-98c1-fadf2e691fb0 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:52.792347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 58/110] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:52.793599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d5cc7-8876-47c9-98c1-fadf2e691fb0 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:52.824581 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c1b07-437d-4fd9-b5b5-6f9d352001f1 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:52.874629 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcc9a8-81c6-4e95-9403-f7f5aa31454f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:52.876096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcc9a8-81c6-4e95-9403-f7f5aa31454f None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:52.876651 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcc9a8-81c6-4e95-9403-f7f5aa31454f None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:52.877281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcc9a8-81c6-4e95-9403-f7f5aa31454f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:52.901500 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcc9a8-81c6-4e95-9403-f7f5aa31454f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:52.918278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-3dfcc9a8-81c6-4e95-9403-f7f5aa31454f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:52.918278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:52.918278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:52.918278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:52.918278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:52.918278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:52.918278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:52.918278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:52.918278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:52.918278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:52.918278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:52.918278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:52.918278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:52.918278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:52.918278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:52.918278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:52.919817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:52.919817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:52.919817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:52.919817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:52.919817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:52.919817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:52.919817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:52.919817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:52.919817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:52.919817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:52.919817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:52.919817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:46:52.919817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:52.919817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:52.919817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:52.919817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:52.921273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:52.921273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:52.921273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:52.921273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:52.921273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:52.921273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:52.921273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:52.921273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:52.921273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:52.921273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:52.921273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:52.921273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:46:52.921273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 53/111] 10.222.0.32 () {56 vars in 1114 bytes} [Tue May 10 13:46:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:52.923197 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98393970-6c7a-47af-bd84-86b41b5a648e None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:52.923197 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98393970-6c7a-47af-bd84-86b41b5a648e None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:52.923197 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98393970-6c7a-47af-bd84-86b41b5a648e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:52.974976 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-98393970-6c7a-47af-bd84-86b41b5a648e None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:52.976376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-98393970-6c7a-47af-bd84-86b41b5a648e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:53.056138 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d5cc7-8876-47c9-98c1-fadf2e691fb0 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:53.119181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 54/112] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:53.121196 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98393970-6c7a-47af-bd84-86b41b5a648e None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:53.147094 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80547d70-38bd-4d75-a59f-23ee72b66679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:53.147706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80547d70-38bd-4d75-a59f-23ee72b66679 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:53.148016 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80547d70-38bd-4d75-a59f-23ee72b66679 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:53.148260 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80547d70-38bd-4d75-a59f-23ee72b66679 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:53.149046 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80547d70-38bd-4d75-a59f-23ee72b66679 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:53.149359 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80547d70-38bd-4d75-a59f-23ee72b66679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:53.150834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80547d70-38bd-4d75-a59f-23ee72b66679 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:53.164796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 59/113] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:46:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:53.166164 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80547d70-38bd-4d75-a59f-23ee72b66679 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:53.319885 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98393970-6c7a-47af-bd84-86b41b5a648e None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:53.362650 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d612794-b887-4dba-9c90-958bc9c65335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:53.363528 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d612794-b887-4dba-9c90-958bc9c65335 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:53.363689 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d612794-b887-4dba-9c90-958bc9c65335 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:53.364211 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d612794-b887-4dba-9c90-958bc9c65335 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:53.364798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d612794-b887-4dba-9c90-958bc9c65335 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:53.365114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d612794-b887-4dba-9c90-958bc9c65335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:53.366657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d612794-b887-4dba-9c90-958bc9c65335 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:53.374765 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80547d70-38bd-4d75-a59f-23ee72b66679 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:53.376860 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 55/114] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:46:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:53.377752 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d612794-b887-4dba-9c90-958bc9c65335 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:53.440619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e7d9b-24aa-4bbd-83f0-4e4d8f5ae788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:53.442578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e7d9b-24aa-4bbd-83f0-4e4d8f5ae788 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:53.443394 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e7d9b-24aa-4bbd-83f0-4e4d8f5ae788 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:53.444176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e7d9b-24aa-4bbd-83f0-4e4d8f5ae788 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:53.464776 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e7d9b-24aa-4bbd-83f0-4e4d8f5ae788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:53.480971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-768e7d9b-24aa-4bbd-83f0-4e4d8f5ae788 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:46:53.480971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:53.480971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:53.480971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:53.480971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:53.480971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:53.480971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:53.480971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:53.480971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:53.480971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:53.480971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:53.480971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:53.480971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:53.480971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:53.480971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:53.480971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:53.483265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:53.483265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:53.483265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:53.483265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:53.483265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:53.483265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:53.483265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:53.483265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:53.483265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:53.483265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:53.483265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:53.483265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:46:53.483265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:53.483265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:53.483265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:53.483265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:53.484679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:53.484679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:53.484679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:53.484679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:53.484679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:53.484679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:53.484679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:53.484679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:53.484679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:53.484679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:53.484679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:46:53.484679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:46:53.488568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 60/115] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:46:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:53.491357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3783f8-22f6-437b-af28-e6bc86fa9a3c None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:53.492214 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3783f8-22f6-437b-af28-e6bc86fa9a3c None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:53.492880 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3783f8-22f6-437b-af28-e6bc86fa9a3c None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:53.494572 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d612794-b887-4dba-9c90-958bc9c65335 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:53.496123 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 61/116] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:53.497869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3783f8-22f6-437b-af28-e6bc86fa9a3c None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:53.538878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47d51f-a0d5-4bb6-9af0-b3a4beb2e126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:53.540036 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47d51f-a0d5-4bb6-9af0-b3a4beb2e126 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:53.540194 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47d51f-a0d5-4bb6-9af0-b3a4beb2e126 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:53.540450 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47d51f-a0d5-4bb6-9af0-b3a4beb2e126 None admin] PATH_INFO: `/v3/users/2917275ac848431ab364bc258730628d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:53.541840 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47d51f-a0d5-4bb6-9af0-b3a4beb2e126 None admin] RBAC: Authorizing `identity:get_user(user_id=2917275ac848431ab364bc258730628d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:53.543415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47d51f-a0d5-4bb6-9af0-b3a4beb2e126 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:53.545177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 56/117] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:46:53 2022] GET /identity/v3/users/2917275ac848431ab364bc258730628d => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:53.546041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47d51f-a0d5-4bb6-9af0-b3a4beb2e126 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:53.671011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3783f8-22f6-437b-af28-e6bc86fa9a3c None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:53.690253 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47d51f-a0d5-4bb6-9af0-b3a4beb2e126 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:53.723392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da6beb-f8fd-4bb0-985c-3c68d3022a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:53.724835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da6beb-f8fd-4bb0-985c-3c68d3022a5d None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:53.725347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da6beb-f8fd-4bb0-985c-3c68d3022a5d None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:53.725823 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da6beb-f8fd-4bb0-985c-3c68d3022a5d None admin] PATH_INFO: `/v3/users/a1d7a40db9484e8d8f3167ff53fb5b8a` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:53.728106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da6beb-f8fd-4bb0-985c-3c68d3022a5d None admin] RBAC: Authorizing `identity:get_user(user_id=a1d7a40db9484e8d8f3167ff53fb5b8a)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:53.730925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da6beb-f8fd-4bb0-985c-3c68d3022a5d None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:53.735021 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 62/118] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:46:53 2022] GET /identity/v3/users/a1d7a40db9484e8d8f3167ff53fb5b8a => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:53.737328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cba63-e26e-4fc9-bffc-85a68d616c7d None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:53.737843 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cba63-e26e-4fc9-bffc-85a68d616c7d None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:53.738379 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cba63-e26e-4fc9-bffc-85a68d616c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:53.750775 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087c344-0bc6-4b35-a56b-d3023bed8de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:53.752407 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087c344-0bc6-4b35-a56b-d3023bed8de6 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:53.753157 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087c344-0bc6-4b35-a56b-d3023bed8de6 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:53.753873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087c344-0bc6-4b35-a56b-d3023bed8de6 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:53.755597 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087c344-0bc6-4b35-a56b-d3023bed8de6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:53.756522 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087c344-0bc6-4b35-a56b-d3023bed8de6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:53.759642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087c344-0bc6-4b35-a56b-d3023bed8de6 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:53.767376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-312cba63-e26e-4fc9-bffc-85a68d616c7d None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:53.769549 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-312cba63-e26e-4fc9-bffc-85a68d616c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:53.776986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 57/119] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:46:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:53.780039 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f72c6d-ecce-4e10-a6ed-92c670004ab2 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:53.781025 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f72c6d-ecce-4e10-a6ed-92c670004ab2 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:53.781768 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f72c6d-ecce-4e10-a6ed-92c670004ab2 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:53.784534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 58/120] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:53.786366 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f72c6d-ecce-4e10-a6ed-92c670004ab2 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:53.886436 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 63/121] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:53.888055 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cba63-e26e-4fc9-bffc-85a68d616c7d None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:53.957258 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f72c6d-ecce-4e10-a6ed-92c670004ab2 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:53.996599 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac1f85-cea8-41bc-a361-496a0a1bdb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:53.997690 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac1f85-cea8-41bc-a361-496a0a1bdb94 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:53.998062 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac1f85-cea8-41bc-a361-496a0a1bdb94 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:53.998562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac1f85-cea8-41bc-a361-496a0a1bdb94 None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:54.000749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac1f85-cea8-41bc-a361-496a0a1bdb94 None admin] RBAC: Authorizing `identity:get_project(project_id=03067c95202a44bbae7686a1a4886b44)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:54.002597 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac1f85-cea8-41bc-a361-496a0a1bdb94 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:54.005209 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 59/122] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:46:53 2022] GET /identity/v3/projects/03067c95202a44bbae7686a1a4886b44 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:54.006434 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac1f85-cea8-41bc-a361-496a0a1bdb94 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:54.043400 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cba63-e26e-4fc9-bffc-85a68d616c7d None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:54.085529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0924c-7211-4565-90df-333c0345bb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:54.086456 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0924c-7211-4565-90df-333c0345bb71 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:54.086741 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0924c-7211-4565-90df-333c0345bb71 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:54.087064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0924c-7211-4565-90df-333c0345bb71 None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:54.088359 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0924c-7211-4565-90df-333c0345bb71 None admin] RBAC: Authorizing `identity:get_project(project_id=03067c95202a44bbae7686a1a4886b44)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:54.089883 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0924c-7211-4565-90df-333c0345bb71 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:54.098603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 64/123] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:46:53 2022] GET /identity/v3/projects/03067c95202a44bbae7686a1a4886b44 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:54.098603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b7d1b-24ef-4ef0-aa8e-ba7326eb555f None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:54.098603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b7d1b-24ef-4ef0-aa8e-ba7326eb555f None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:54.098603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b7d1b-24ef-4ef0-aa8e-ba7326eb555f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:54.125846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-493b7d1b-24ef-4ef0-aa8e-ba7326eb555f None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:54.127918 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-493b7d1b-24ef-4ef0-aa8e-ba7326eb555f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:54.164046 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac1f85-cea8-41bc-a361-496a0a1bdb94 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:54.225213 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1d481-d704-4ec5-ac36-10bdbe0703da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:54.226383 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1d481-d704-4ec5-ac36-10bdbe0703da None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:54.226808 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1d481-d704-4ec5-ac36-10bdbe0703da None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:54.227241 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1d481-d704-4ec5-ac36-10bdbe0703da None admin] PATH_INFO: `/v3/users/48acc9bcb97f44808ced41b25bd1bdc7` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:54.237153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 65/124] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:54.238825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b7d1b-24ef-4ef0-aa8e-ba7326eb555f None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:54.251261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1d481-d704-4ec5-ac36-10bdbe0703da None admin] RBAC: Authorizing `identity:get_user(user_id=48acc9bcb97f44808ced41b25bd1bdc7)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:54.253991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1d481-d704-4ec5-ac36-10bdbe0703da None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:54.256701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 60/125] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:46:54 2022] GET /identity/v3/users/48acc9bcb97f44808ced41b25bd1bdc7 => generated 289 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:54.257659 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1d481-d704-4ec5-ac36-10bdbe0703da None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:54.372558 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1d481-d704-4ec5-ac36-10bdbe0703da None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:54.408329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b7d1b-24ef-4ef0-aa8e-ba7326eb555f None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:54.415319 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba391f00-a7c7-4d7f-994d-6d1734d2006d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:54.416228 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba391f00-a7c7-4d7f-994d-6d1734d2006d None admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:54.417096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba391f00-a7c7-4d7f-994d-6d1734d2006d None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:54.417382 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba391f00-a7c7-4d7f-994d-6d1734d2006d None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44/users/2917275ac848431ab364bc258730628d/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:54.419583 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba391f00-a7c7-4d7f-994d-6d1734d2006d None admin] RBAC: Authorizing `identity:create_grant(project_id=03067c95202a44bbae7686a1a4886b44, user_id=2917275ac848431ab364bc258730628d, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:54.422130 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba391f00-a7c7-4d7f-994d-6d1734d2006d None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:54.440967 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 61/126] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:46:54 2022] PUT /identity/v3/projects/03067c95202a44bbae7686a1a4886b44/users/2917275ac848431ab364bc258730628d/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:46:54.441853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba391f00-a7c7-4d7f-994d-6d1734d2006d None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:54.465619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba242806-4519-48dd-b992-b6b1be0e9017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:54.468241 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba242806-4519-48dd-b992-b6b1be0e9017 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:54.469143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba242806-4519-48dd-b992-b6b1be0e9017 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:54.470080 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba242806-4519-48dd-b992-b6b1be0e9017 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:54.492444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba242806-4519-48dd-b992-b6b1be0e9017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:54.508419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-ba242806-4519-48dd-b992-b6b1be0e9017 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:54.508419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:54.508419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:54.508419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:54.508419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:54.508419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:54.508419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:54.508419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:54.508419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:54.508419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:54.508419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:54.508419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:54.508419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:54.508419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:54.508419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:54.508419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:54.509876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:54.509876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:54.509876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:54.509876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:54.509876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:54.509876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:54.509876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:54.509876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:54.509876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:54.509876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:54.509876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:54.509876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:46:54.509876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:54.509876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:54.509876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:54.509876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:54.511367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:54.511367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:54.511367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:54.511367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:54.511367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:54.511367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:54.511367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:54.511367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:54.511367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:54.511367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:54.511367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:54.511367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:46:54.517530 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 66/127] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:46:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:54.519621 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba242806-4519-48dd-b992-b6b1be0e9017 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:54.575308 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba391f00-a7c7-4d7f-994d-6d1734d2006d None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:54.620233 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e268e-8396-4bb4-8949-2d99d68dd12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:54.621424 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e268e-8396-4bb4-8949-2d99d68dd12d None admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:54.621795 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e268e-8396-4bb4-8949-2d99d68dd12d None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:54.622151 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e268e-8396-4bb4-8949-2d99d68dd12d None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44/users/a1d7a40db9484e8d8f3167ff53fb5b8a/roles/316da37136b4425f9ae486ae1e2bf4b4` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:54.626047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e268e-8396-4bb4-8949-2d99d68dd12d None admin] RBAC: Authorizing `identity:create_grant(project_id=03067c95202a44bbae7686a1a4886b44, user_id=a1d7a40db9484e8d8f3167ff53fb5b8a, role_id=316da37136b4425f9ae486ae1e2bf4b4)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:54.627803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e268e-8396-4bb4-8949-2d99d68dd12d None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:54.646116 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 62/128] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:46:54 2022] PUT /identity/v3/projects/03067c95202a44bbae7686a1a4886b44/users/a1d7a40db9484e8d8f3167ff53fb5b8a/roles/316da37136b4425f9ae486ae1e2bf4b4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:46:54.647252 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e268e-8396-4bb4-8949-2d99d68dd12d None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:54.733745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba242806-4519-48dd-b992-b6b1be0e9017 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:54.794646 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa266f8-758e-4721-9407-a3999c7305e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:54.796378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa266f8-758e-4721-9407-a3999c7305e4 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:54.797555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa266f8-758e-4721-9407-a3999c7305e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:54.797847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa266f8-758e-4721-9407-a3999c7305e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:54.808897 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e268e-8396-4bb4-8949-2d99d68dd12d None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:54.858309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27edf7e-886c-4c89-ac64-0e677b8e649c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:54.858309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27edf7e-886c-4c89-ac64-0e677b8e649c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:54.859553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27edf7e-886c-4c89-ac64-0e677b8e649c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:54.859553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27edf7e-886c-4c89-ac64-0e677b8e649c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:54.861743 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27edf7e-886c-4c89-ac64-0e677b8e649c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:54.864678 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27edf7e-886c-4c89-ac64-0e677b8e649c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:54.868025 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 63/129] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:46:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:54.869507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27edf7e-886c-4c89-ac64-0e677b8e649c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:54.912301 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa266f8-758e-4721-9407-a3999c7305e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:54.914390 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa266f8-758e-4721-9407-a3999c7305e4 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:55.029989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27edf7e-886c-4c89-ac64-0e677b8e649c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:55.063330 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 67/130] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:46:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:55.064680 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa266f8-758e-4721-9407-a3999c7305e4 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:55.096335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a333df7-2afc-4b6b-baf0-cce73958a2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:55.097039 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a333df7-2afc-4b6b-baf0-cce73958a2df None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:55.097325 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a333df7-2afc-4b6b-baf0-cce73958a2df None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:55.097603 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a333df7-2afc-4b6b-baf0-cce73958a2df None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:55.100200 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a333df7-2afc-4b6b-baf0-cce73958a2df None admin] RBAC: Adding query filter params (name=member) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:55.100517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a333df7-2afc-4b6b-baf0-cce73958a2df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:55.101974 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a333df7-2afc-4b6b-baf0-cce73958a2df None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:55.113315 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 64/131] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:46:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:55.114438 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a333df7-2afc-4b6b-baf0-cce73958a2df None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:55.277601 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a333df7-2afc-4b6b-baf0-cce73958a2df None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:55.293824 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa266f8-758e-4721-9407-a3999c7305e4 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:55.341160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fa08f-e346-4f67-b921-8cb180f14e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:55.343227 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fa08f-e346-4f67-b921-8cb180f14e9c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:55.343945 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fa08f-e346-4f67-b921-8cb180f14e9c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:55.344680 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fa08f-e346-4f67-b921-8cb180f14e9c None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:55.347074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fa08f-e346-4f67-b921-8cb180f14e9c None admin] RBAC: Authorizing `identity:get_project(project_id=03067c95202a44bbae7686a1a4886b44)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:55.349867 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fa08f-e346-4f67-b921-8cb180f14e9c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:55.353393 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 65/132] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:46:55 2022] GET /identity/v3/projects/03067c95202a44bbae7686a1a4886b44 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:55.355522 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fa08f-e346-4f67-b921-8cb180f14e9c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:55.359104 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c1a21-9465-44ba-a21b-65b4e3581ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:55.359813 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c1a21-9465-44ba-a21b-65b4e3581ae0 None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:55.360093 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c1a21-9465-44ba-a21b-65b4e3581ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:55.360373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c1a21-9465-44ba-a21b-65b4e3581ae0 None admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:55.361112 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c1a21-9465-44ba-a21b-65b4e3581ae0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:55.362684 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c1a21-9465-44ba-a21b-65b4e3581ae0 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:55.417460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 68/133] 10.222.0.32 () {60 vars in 1141 bytes} [Tue May 10 13:46:55 2022] POST /identity/v3/projects => generated 302 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:46:55.418603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c1a21-9465-44ba-a21b-65b4e3581ae0 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:55.537571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fa08f-e346-4f67-b921-8cb180f14e9c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:55.578872 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92eec4-3dc1-46dd-bd1e-3dc3fa573a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:55.580196 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92eec4-3dc1-46dd-bd1e-3dc3fa573a89 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:55.580693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92eec4-3dc1-46dd-bd1e-3dc3fa573a89 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:55.581213 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92eec4-3dc1-46dd-bd1e-3dc3fa573a89 None admin] PATH_INFO: `/v3/users/a1d7a40db9484e8d8f3167ff53fb5b8a` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:55.583055 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92eec4-3dc1-46dd-bd1e-3dc3fa573a89 None admin] RBAC: Authorizing `identity:get_user(user_id=a1d7a40db9484e8d8f3167ff53fb5b8a)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:55.585029 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92eec4-3dc1-46dd-bd1e-3dc3fa573a89 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:55.587268 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 66/134] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:46:55 2022] GET /identity/v3/users/a1d7a40db9484e8d8f3167ff53fb5b8a => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:55.593457 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92eec4-3dc1-46dd-bd1e-3dc3fa573a89 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:55.683676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c1a21-9465-44ba-a21b-65b4e3581ae0 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:55.737824 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035ace5-8832-435e-b2fd-e33b0be1cbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:55.738552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035ace5-8832-435e-b2fd-e33b0be1cbb6 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:55.738842 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035ace5-8832-435e-b2fd-e33b0be1cbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:55.739174 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035ace5-8832-435e-b2fd-e33b0be1cbb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:55.740053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035ace5-8832-435e-b2fd-e33b0be1cbb6 None admin] RBAC: Adding query filter params (role.id=27bc06df3c7b4654b71935efdaca22aa, scope.project.id=03067c95202a44bbae7686a1a4886b44, user.id=48acc9bcb97f44808ced41b25bd1bdc7) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:55.740421 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035ace5-8832-435e-b2fd-e33b0be1cbb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:55.742008 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035ace5-8832-435e-b2fd-e33b0be1cbb6 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:55.750272 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 69/135] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:46:55 2022] GET /identity/v3/role_assignments?user.id=48acc9bcb97f44808ced41b25bd1bdc7&scope.project.id=03067c95202a44bbae7686a1a4886b44&role.id=27bc06df3c7b4654b71935efdaca22aa => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:55.781602 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92eec4-3dc1-46dd-bd1e-3dc3fa573a89 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:55.861518 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188362a7-b88a-4cc2-a474-5fb127a94d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:55.861518 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188362a7-b88a-4cc2-a474-5fb127a94d4b None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:55.861518 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188362a7-b88a-4cc2-a474-5fb127a94d4b None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:55.861518 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188362a7-b88a-4cc2-a474-5fb127a94d4b None admin] PATH_INFO: `/v3/projects/477a8d374cd243488078d49785d3ba19` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:55.864356 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188362a7-b88a-4cc2-a474-5fb127a94d4b None admin] RBAC: Authorizing `identity:get_project(project_id=477a8d374cd243488078d49785d3ba19)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:55.865437 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188362a7-b88a-4cc2-a474-5fb127a94d4b None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:55.869047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 67/136] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:46:55 2022] GET /identity/v3/projects/477a8d374cd243488078d49785d3ba19 => generated 312 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:55.875461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035ace5-8832-435e-b2fd-e33b0be1cbb6 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:55.985881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dce465-a738-4172-ba24-cae4a48ea1bd None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:55.986452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dce465-a738-4172-ba24-cae4a48ea1bd None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:55.986983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dce465-a738-4172-ba24-cae4a48ea1bd None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:55.989845 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 68/137] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:55.998814 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d35822-7465-4cf4-93c1-f9be33f890d4 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:55.999548 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d35822-7465-4cf4-93c1-f9be33f890d4 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:55.999672 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d35822-7465-4cf4-93c1-f9be33f890d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:56.034462 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035ace5-8832-435e-b2fd-e33b0be1cbb6 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:56.044218 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-70d35822-7465-4cf4-93c1-f9be33f890d4 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:56.046393 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-70d35822-7465-4cf4-93c1-f9be33f890d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:56.082487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aeb72-930e-4920-8931-a6b544c30a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:56.083421 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aeb72-930e-4920-8931-a6b544c30a0c None admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:56.084396 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aeb72-930e-4920-8931-a6b544c30a0c None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:56.084700 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aeb72-930e-4920-8931-a6b544c30a0c None admin] PATH_INFO: `/v3/projects/477a8d374cd243488078d49785d3ba19/users/a1d7a40db9484e8d8f3167ff53fb5b8a/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:56.086991 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aeb72-930e-4920-8931-a6b544c30a0c None admin] RBAC: Authorizing `identity:create_grant(project_id=477a8d374cd243488078d49785d3ba19, user_id=a1d7a40db9484e8d8f3167ff53fb5b8a, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:56.088884 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aeb72-930e-4920-8931-a6b544c30a0c None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:56.114439 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 70/138] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:46:55 2022] PUT /identity/v3/projects/477a8d374cd243488078d49785d3ba19/users/a1d7a40db9484e8d8f3167ff53fb5b8a/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:46:56.205778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 69/139] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:56.248777 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aeb72-930e-4920-8931-a6b544c30a0c None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:56.459605 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aeb72-930e-4920-8931-a6b544c30a0c None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:56.527127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e67a4-687f-4e39-91a2-13a2b52144a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:56.528393 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e67a4-687f-4e39-91a2-13a2b52144a2 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:56.528857 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e67a4-687f-4e39-91a2-13a2b52144a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:56.529325 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e67a4-687f-4e39-91a2-13a2b52144a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:56.551283 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e67a4-687f-4e39-91a2-13a2b52144a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:56.567415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-fd2e67a4-687f-4e39-91a2-13a2b52144a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:56.567415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:56.567415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:56.567415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:56.567415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:56.567415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:56.567415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:56.567415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:56.567415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:56.567415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:56.567415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:56.567415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:56.567415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:56.567415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:56.567415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:56.567415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:56.569574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:56.569574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:56.569574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:56.569574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:56.569574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:56.569574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:56.569574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:56.569574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:56.569574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:56.569574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:56.569574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:56.569574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:46:56.569574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:56.569574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:56.569574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:56.569574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:56.571644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:56.571644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:56.571644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:56.571644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:56.571644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:56.571644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:56.571644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:56.571644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:56.571644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:56.571644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:56.571644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:56.571644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:46:56.571644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 71/140] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:46:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:56.578645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d35822-7465-4cf4-93c1-f9be33f890d4 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:56.761003 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d35822-7465-4cf4-93c1-f9be33f890d4 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:56.837266 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479671d3-085b-4a37-bb56-3a9b9d52a974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:56.837648 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479671d3-085b-4a37-bb56-3a9b9d52a974 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:56.839923 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479671d3-085b-4a37-bb56-3a9b9d52a974 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:56.839923 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479671d3-085b-4a37-bb56-3a9b9d52a974 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:56.840272 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479671d3-085b-4a37-bb56-3a9b9d52a974 None admin] RBAC: Adding query filter params (name=member) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:56.840680 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479671d3-085b-4a37-bb56-3a9b9d52a974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:56.849675 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479671d3-085b-4a37-bb56-3a9b9d52a974 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:56.875574 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 70/141] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:46:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:56.880906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e67a4-687f-4e39-91a2-13a2b52144a2 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:57.004136 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e67a4-687f-4e39-91a2-13a2b52144a2 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:57.046873 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35f5d4-6cab-46fa-8ce2-0617b445563a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:57.047274 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35f5d4-6cab-46fa-8ce2-0617b445563a None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:57.047560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35f5d4-6cab-46fa-8ce2-0617b445563a None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:57.047834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35f5d4-6cab-46fa-8ce2-0617b445563a None admin] PATH_INFO: `/v3/users/a1d7a40db9484e8d8f3167ff53fb5b8a` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:57.049141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35f5d4-6cab-46fa-8ce2-0617b445563a None admin] RBAC: Authorizing `identity:get_user(user_id=a1d7a40db9484e8d8f3167ff53fb5b8a)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:57.050661 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35f5d4-6cab-46fa-8ce2-0617b445563a None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:57.052672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 72/142] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:46:56 2022] GET /identity/v3/users/a1d7a40db9484e8d8f3167ff53fb5b8a => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:57.058607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479671d3-085b-4a37-bb56-3a9b9d52a974 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:57.289104 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479671d3-085b-4a37-bb56-3a9b9d52a974 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:57.335334 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f76c58-4932-44a4-afa2-190bed6636be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:57.335948 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f76c58-4932-44a4-afa2-190bed6636be None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:57.336235 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f76c58-4932-44a4-afa2-190bed6636be None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:57.336517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f76c58-4932-44a4-afa2-190bed6636be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:57.434625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f76c58-4932-44a4-afa2-190bed6636be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:57.437488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f76c58-4932-44a4-afa2-190bed6636be None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:57.569998 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 71/143] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:46:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:57.575288 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35f5d4-6cab-46fa-8ce2-0617b445563a None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:57.760288 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35f5d4-6cab-46fa-8ce2-0617b445563a None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:57.819767 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396f4a2-e60b-46b4-afd6-f5986d00b088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:57.821040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396f4a2-e60b-46b4-afd6-f5986d00b088 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:57.821496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396f4a2-e60b-46b4-afd6-f5986d00b088 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:57.821928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396f4a2-e60b-46b4-afd6-f5986d00b088 None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:57.823782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396f4a2-e60b-46b4-afd6-f5986d00b088 None admin] RBAC: Authorizing `identity:get_project(project_id=03067c95202a44bbae7686a1a4886b44)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:57.826066 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396f4a2-e60b-46b4-afd6-f5986d00b088 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:57.829520 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 73/144] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:46:57 2022] GET /identity/v3/projects/03067c95202a44bbae7686a1a4886b44 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:57.842270 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f76c58-4932-44a4-afa2-190bed6636be None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:58.021324 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f76c58-4932-44a4-afa2-190bed6636be None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:58.068604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f680998-8e1b-4f81-85ba-fd27743bd28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:58.069324 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f680998-8e1b-4f81-85ba-fd27743bd28d None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:58.069609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f680998-8e1b-4f81-85ba-fd27743bd28d None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:58.069923 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f680998-8e1b-4f81-85ba-fd27743bd28d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:58.070792 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f680998-8e1b-4f81-85ba-fd27743bd28d None admin] RBAC: Adding query filter params (role.id=34ef75b7c6d54c5e81edbfee2f4b362d, scope.project.id=03067c95202a44bbae7686a1a4886b44, user.id=a1d7a40db9484e8d8f3167ff53fb5b8a) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:58.071108 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f680998-8e1b-4f81-85ba-fd27743bd28d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:58.072608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f680998-8e1b-4f81-85ba-fd27743bd28d None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:58.079835 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 72/145] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:46:57 2022] GET /identity/v3/role_assignments?user.id=a1d7a40db9484e8d8f3167ff53fb5b8a&scope.project.id=03067c95202a44bbae7686a1a4886b44&role.id=34ef75b7c6d54c5e81edbfee2f4b362d => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:58.222714 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4766af-3a9f-4df0-b3de-99c390658117 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:58.223085 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4766af-3a9f-4df0-b3de-99c390658117 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:58.223255 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4766af-3a9f-4df0-b3de-99c390658117 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:58.224737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 74/146] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:58.236404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255e01f-bce1-4089-889e-b8f80eec2d9e None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:58.236727 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255e01f-bce1-4089-889e-b8f80eec2d9e None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:58.236960 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255e01f-bce1-4089-889e-b8f80eec2d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:58.263750 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-d255e01f-bce1-4089-889e-b8f80eec2d9e None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:58.265739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-d255e01f-bce1-4089-889e-b8f80eec2d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:58.364927 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 73/147] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:58.411824 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4766af-3a9f-4df0-b3de-99c390658117 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:58.468132 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77322fa-bed7-4a94-8c84-9cc21439adf5 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:58.468467 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77322fa-bed7-4a94-8c84-9cc21439adf5 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:58.468741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77322fa-bed7-4a94-8c84-9cc21439adf5 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:58.472042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 74/148] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:58.477978 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0275551-81fe-49d5-a2d5-76efbbe838a4 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:58.478297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0275551-81fe-49d5-a2d5-76efbbe838a4 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:58.478567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0275551-81fe-49d5-a2d5-76efbbe838a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:58.509019 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-a0275551-81fe-49d5-a2d5-76efbbe838a4 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:58.510293 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a0275551-81fe-49d5-a2d5-76efbbe838a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:58.560173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4766af-3a9f-4df0-b3de-99c390658117 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:58.609037 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e536509-2466-4a53-8b1b-3dc99b17b877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:58.609968 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e536509-2466-4a53-8b1b-3dc99b17b877 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:58.610288 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e536509-2466-4a53-8b1b-3dc99b17b877 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:58.610457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e536509-2466-4a53-8b1b-3dc99b17b877 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:58.622332 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e536509-2466-4a53-8b1b-3dc99b17b877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:58.630443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-8e536509-2466-4a53-8b1b-3dc99b17b877 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:58.630443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:58.630443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:58.630443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:58.630443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:58.630443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:58.630443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:58.630443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:58.630443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:58.630443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:58.630443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:58.630443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:58.630443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:58.630443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:58.630443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:58.630443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:58.631989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:58.631989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:58.631989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:58.631989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:58.631989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:58.631989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:58.631989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:58.631989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:58.631989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:58.631989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:58.631989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:58.631989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:46:58.631989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:58.631989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:58.631989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:58.631989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:58.633335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:58.633335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:58.633335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:58.633335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:58.633335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:58.633335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:58.633335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:58.633335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:58.633335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:58.633335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:58.633335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:58.633335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:46:58.633335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 75/149] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:46:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:58.637915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e536509-2466-4a53-8b1b-3dc99b17b877 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:58.681994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 75/150] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:58.726884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0275551-81fe-49d5-a2d5-76efbbe838a4 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:58.754240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e536509-2466-4a53-8b1b-3dc99b17b877 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:58.786156 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b3eea-6cb2-4259-8b66-69088ab62ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:58.786875 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b3eea-6cb2-4259-8b66-69088ab62ecd None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:58.787159 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b3eea-6cb2-4259-8b66-69088ab62ecd None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:58.787444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b3eea-6cb2-4259-8b66-69088ab62ecd None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:58.788223 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b3eea-6cb2-4259-8b66-69088ab62ecd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:58.788534 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b3eea-6cb2-4259-8b66-69088ab62ecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:58.789966 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b3eea-6cb2-4259-8b66-69088ab62ecd None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:58.800191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 76/151] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:46:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:58.806183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b3eea-6cb2-4259-8b66-69088ab62ecd None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:58.987311 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0275551-81fe-49d5-a2d5-76efbbe838a4 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:59.036969 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e5181-19c6-42d5-aa07-c8db88863dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:59.038259 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e5181-19c6-42d5-aa07-c8db88863dd5 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:59.038700 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e5181-19c6-42d5-aa07-c8db88863dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:59.039132 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e5181-19c6-42d5-aa07-c8db88863dd5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:59.050353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b3eea-6cb2-4259-8b66-69088ab62ecd None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:59.058159 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e5181-19c6-42d5-aa07-c8db88863dd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:59.067075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-e95e5181-19c6-42d5-aa07-c8db88863dd5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:59.067075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:59.067075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:59.067075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:59.067075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:59.067075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:59.067075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:59.067075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:59.067075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:59.067075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:59.067075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:59.067075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:59.067075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:59.067075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:59.067075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:59.067075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:59.067991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:59.067991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:59.067991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:59.067991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:59.067991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:59.067991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:59.067991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:59.067991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:59.067991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:59.067991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:59.067991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:59.067991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:46:59.067991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:59.067991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:59.067991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:59.067991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:59.068749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:59.068749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:59.068749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:59.068749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:59.068749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:59.068749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:59.068749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:59.068749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:59.068749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:59.068749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:59.068749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:59.068749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:46:59.070900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 76/152] 10.222.0.32 () {56 vars in 1114 bytes} [Tue May 10 13:46:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:59.083643 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e5181-19c6-42d5-aa07-c8db88863dd5 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:59.145508 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2de16c-b9d6-4608-b7b1-6818d55c4b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:59.146728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2de16c-b9d6-4608-b7b1-6818d55c4b6f None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:59.147164 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2de16c-b9d6-4608-b7b1-6818d55c4b6f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:59.147587 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2de16c-b9d6-4608-b7b1-6818d55c4b6f None admin] PATH_INFO: `/v3/users/2917275ac848431ab364bc258730628d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:59.149987 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2de16c-b9d6-4608-b7b1-6818d55c4b6f None admin] RBAC: Authorizing `identity:get_user(user_id=2917275ac848431ab364bc258730628d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:59.151703 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2de16c-b9d6-4608-b7b1-6818d55c4b6f None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:59.156127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 77/153] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:46:58 2022] GET /identity/v3/users/2917275ac848431ab364bc258730628d => generated 247 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:59.162354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2de16c-b9d6-4608-b7b1-6818d55c4b6f None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:59.303803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e5181-19c6-42d5-aa07-c8db88863dd5 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:59.394073 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f7ac4-7fe7-4a4d-b4c2-da3c25d2b092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:59.395375 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f7ac4-7fe7-4a4d-b4c2-da3c25d2b092 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:59.395882 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f7ac4-7fe7-4a4d-b4c2-da3c25d2b092 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:59.396382 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f7ac4-7fe7-4a4d-b4c2-da3c25d2b092 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:59.399973 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f7ac4-7fe7-4a4d-b4c2-da3c25d2b092 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:59.400547 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f7ac4-7fe7-4a4d-b4c2-da3c25d2b092 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:59.403419 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f7ac4-7fe7-4a4d-b4c2-da3c25d2b092 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:59.425513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2de16c-b9d6-4608-b7b1-6818d55c4b6f None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:59.436947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 77/154] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:46:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:59.439787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270eaed-55c4-4d9a-9fad-1a1a7060e591 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:59.441484 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270eaed-55c4-4d9a-9fad-1a1a7060e591 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:59.442349 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270eaed-55c4-4d9a-9fad-1a1a7060e591 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:59.445864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 78/155] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:59.450759 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270eaed-55c4-4d9a-9fad-1a1a7060e591 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:59.480543 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc8cd3-7476-44ee-8dd6-b26e86ee5d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:59.481645 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc8cd3-7476-44ee-8dd6-b26e86ee5d5a None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:59.482058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc8cd3-7476-44ee-8dd6-b26e86ee5d5a None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:59.483482 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc8cd3-7476-44ee-8dd6-b26e86ee5d5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:59.563285 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc8cd3-7476-44ee-8dd6-b26e86ee5d5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:59.564838 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc8cd3-7476-44ee-8dd6-b26e86ee5d5a None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:59.622132 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270eaed-55c4-4d9a-9fad-1a1a7060e591 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:59.659069 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592e656-ce37-4f57-8b14-f74a3e9849d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:59.660182 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592e656-ce37-4f57-8b14-f74a3e9849d4 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:59.660590 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592e656-ce37-4f57-8b14-f74a3e9849d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:59.660989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592e656-ce37-4f57-8b14-f74a3e9849d4 None admin] PATH_INFO: `/v3/users/a1d7a40db9484e8d8f3167ff53fb5b8a` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:59.662544 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b592e656-ce37-4f57-8b14-f74a3e9849d4 None admin] RBAC: Authorizing `identity:get_user(user_id=a1d7a40db9484e8d8f3167ff53fb5b8a)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:59.664918 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b592e656-ce37-4f57-8b14-f74a3e9849d4 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:59.667420 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 79/156] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:46:59 2022] GET /identity/v3/users/a1d7a40db9484e8d8f3167ff53fb5b8a => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:59.668871 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52837195-006c-4d28-9919-921555afc0ad None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:59.669283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52837195-006c-4d28-9919-921555afc0ad None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:59.669683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52837195-006c-4d28-9919-921555afc0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:59.694311 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-52837195-006c-4d28-9919-921555afc0ad None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:59.695542 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-52837195-006c-4d28-9919-921555afc0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:59.736329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 78/157] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:46:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:59.736329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9aad2-4cc7-4832-8ab2-f4f41c740106 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:59.736329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9aad2-4cc7-4832-8ab2-f4f41c740106 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:59.736329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9aad2-4cc7-4832-8ab2-f4f41c740106 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:59.737500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 79/158] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:46:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:59.738377 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9aad2-4cc7-4832-8ab2-f4f41c740106 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:59.785625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 80/159] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:59.787519 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52837195-006c-4d28-9919-921555afc0ad None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:59.890514 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9aad2-4cc7-4832-8ab2-f4f41c740106 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:59.931526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5c4fa-55b0-49c7-8872-0d9b18ac513e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:59.932192 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5c4fa-55b0-49c7-8872-0d9b18ac513e None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:59.932498 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5c4fa-55b0-49c7-8872-0d9b18ac513e None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:59.932730 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5c4fa-55b0-49c7-8872-0d9b18ac513e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:59.945770 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52837195-006c-4d28-9919-921555afc0ad None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:59.983717 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8878f-84f6-4429-8743-997e48483ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:59.984597 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8878f-84f6-4429-8743-997e48483ed2 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:59.984876 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8878f-84f6-4429-8743-997e48483ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:59.985142 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8878f-84f6-4429-8743-997e48483ed2 None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:59.986487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8878f-84f6-4429-8743-997e48483ed2 None admin] RBAC: Authorizing `identity:get_project(project_id=03067c95202a44bbae7686a1a4886b44)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:59.987963 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8878f-84f6-4429-8743-997e48483ed2 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:59.997801 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 81/160] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:46:59 2022] GET /identity/v3/projects/03067c95202a44bbae7686a1a4886b44 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:59.997801 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9ccd9-1c89-4edf-b426-0a53001b3a1d None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:59.997801 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9ccd9-1c89-4edf-b426-0a53001b3a1d None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:59.997801 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9ccd9-1c89-4edf-b426-0a53001b3a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:00.021423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-71f9ccd9-1c89-4edf-b426-0a53001b3a1d None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:00.023773 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5c4fa-55b0-49c7-8872-0d9b18ac513e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:00.023944 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-71f9ccd9-1c89-4edf-b426-0a53001b3a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:00.025314 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5c4fa-55b0-49c7-8872-0d9b18ac513e None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:00.100757 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 82/161] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:00.101647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9ccd9-1c89-4edf-b426-0a53001b3a1d None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:00.193630 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 80/162] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:46:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:00.195224 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5c4fa-55b0-49c7-8872-0d9b18ac513e None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:00.256479 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9ccd9-1c89-4edf-b426-0a53001b3a1d None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:00.322425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b347e60-7c81-4d8c-97a0-8241fe0f4dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:00.324184 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b347e60-7c81-4d8c-97a0-8241fe0f4dc4 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:00.324657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b347e60-7c81-4d8c-97a0-8241fe0f4dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:00.325126 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b347e60-7c81-4d8c-97a0-8241fe0f4dc4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:00.327586 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b347e60-7c81-4d8c-97a0-8241fe0f4dc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:00.330339 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b347e60-7c81-4d8c-97a0-8241fe0f4dc4 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:00.331750 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5c4fa-55b0-49c7-8872-0d9b18ac513e None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:00.333624 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 83/163] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:00.334928 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b347e60-7c81-4d8c-97a0-8241fe0f4dc4 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:00.374421 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d89d72-6535-4c4d-8254-2dc9786dcd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:00.375113 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d89d72-6535-4c4d-8254-2dc9786dcd55 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:00.375396 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d89d72-6535-4c4d-8254-2dc9786dcd55 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:00.375676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d89d72-6535-4c4d-8254-2dc9786dcd55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:00.376551 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d89d72-6535-4c4d-8254-2dc9786dcd55 None admin] RBAC: Adding query filter params (role.id=17e40821fc444dd0b040dcfce3eb222b, scope.project.id=03067c95202a44bbae7686a1a4886b44, user.id=2917275ac848431ab364bc258730628d) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:00.376868 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d89d72-6535-4c4d-8254-2dc9786dcd55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:00.378443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d89d72-6535-4c4d-8254-2dc9786dcd55 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:00.385177 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 81/164] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:47:00 2022] GET /identity/v3/role_assignments?user.id=2917275ac848431ab364bc258730628d&scope.project.id=03067c95202a44bbae7686a1a4886b44&role.id=17e40821fc444dd0b040dcfce3eb222b => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:00.386050 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d89d72-6535-4c4d-8254-2dc9786dcd55 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:00.499643 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b347e60-7c81-4d8c-97a0-8241fe0f4dc4 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:00.543247 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d89d72-6535-4c4d-8254-2dc9786dcd55 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:00.559482 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4365b0-3e11-45c5-868f-7894f77871fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:00.560855 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4365b0-3e11-45c5-868f-7894f77871fb None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:00.561909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4365b0-3e11-45c5-868f-7894f77871fb None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:00.562418 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4365b0-3e11-45c5-868f-7894f77871fb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:00.582609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4365b0-3e11-45c5-868f-7894f77871fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:00.596693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-ff4365b0-3e11-45c5-868f-7894f77871fb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:47:00.596693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:00.596693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:00.596693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:00.596693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:00.596693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:00.596693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:00.596693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:00.596693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:00.596693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:00.596693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:00.596693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:00.596693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:00.596693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:00.596693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:00.596693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:00.597844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:00.597844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:00.597844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:00.597844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:00.597844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:00.597844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:00.597844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:00.597844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:00.597844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:00.597844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:00.597844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:00.597844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:00.597844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:00.597844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:00.597844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:00.597844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:00.598735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:00.598735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:00.598735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:00.598735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:00.598735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:00.598735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:00.598735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:00.598735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:00.598735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:00.598735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:00.598735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:47:00.598735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:00.600625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 84/165] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:00.600719 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489dd23f-73b5-4dfa-9779-c5f9aafe0fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:00.601125 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489dd23f-73b5-4dfa-9779-c5f9aafe0fb1 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:00.601230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f783e-712a-4efc-8e87-69a6d71295d9 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:00.601415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489dd23f-73b5-4dfa-9779-c5f9aafe0fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:00.601653 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f783e-712a-4efc-8e87-69a6d71295d9 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:00.601808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489dd23f-73b5-4dfa-9779-c5f9aafe0fb1 None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:00.602107 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f783e-712a-4efc-8e87-69a6d71295d9 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:00.603099 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489dd23f-73b5-4dfa-9779-c5f9aafe0fb1 None admin] RBAC: Authorizing `identity:get_project(project_id=03067c95202a44bbae7686a1a4886b44)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:00.612050 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489dd23f-73b5-4dfa-9779-c5f9aafe0fb1 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:00.612436 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 85/166] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:00.612436 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f783e-712a-4efc-8e87-69a6d71295d9 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:00.612934 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 82/167] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:00 2022] GET /identity/v3/projects/03067c95202a44bbae7686a1a4886b44 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:00.616453 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a2241-394a-4e57-a044-d88fb6e79e1e None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:00.616877 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a2241-394a-4e57-a044-d88fb6e79e1e None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:00.617265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a2241-394a-4e57-a044-d88fb6e79e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:00.641251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-1e5a2241-394a-4e57-a044-d88fb6e79e1e None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:00.643416 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-1e5a2241-394a-4e57-a044-d88fb6e79e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:00.762808 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f783e-712a-4efc-8e87-69a6d71295d9 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:00.763767 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 83/168] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:47:00.764842 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a2241-394a-4e57-a044-d88fb6e79e1e None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:00.817416 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c3c49-9d5c-459a-b6fb-963640f46a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:00.818101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c3c49-9d5c-459a-b6fb-963640f46a2a None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:00.818417 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c3c49-9d5c-459a-b6fb-963640f46a2a None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:00.818690 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c3c49-9d5c-459a-b6fb-963640f46a2a None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:00.819430 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c3c49-9d5c-459a-b6fb-963640f46a2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:00.820932 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c3c49-9d5c-459a-b6fb-963640f46a2a None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:00.842570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 86/169] 10.222.0.32 () {60 vars in 1132 bytes} [Tue May 10 13:47:00 2022] POST /identity/v3/users => generated 283 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:47:00.848266 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c3c49-9d5c-459a-b6fb-963640f46a2a None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:00.913201 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a2241-394a-4e57-a044-d88fb6e79e1e None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:00.964987 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edac587-2bdc-4403-9b3c-0d7b11e0bb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:00.965667 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edac587-2bdc-4403-9b3c-0d7b11e0bb9f None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:00.965948 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edac587-2bdc-4403-9b3c-0d7b11e0bb9f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:00.966267 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edac587-2bdc-4403-9b3c-0d7b11e0bb9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:00.967679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edac587-2bdc-4403-9b3c-0d7b11e0bb9f None admin] RBAC: Adding query filter params (role.id=316da37136b4425f9ae486ae1e2bf4b4, scope.project.id=03067c95202a44bbae7686a1a4886b44, user.id=a1d7a40db9484e8d8f3167ff53fb5b8a) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:00.967984 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edac587-2bdc-4403-9b3c-0d7b11e0bb9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:00.969512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edac587-2bdc-4403-9b3c-0d7b11e0bb9f None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:00.985036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 84/170] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:47:00 2022] GET /identity/v3/role_assignments?user.id=a1d7a40db9484e8d8f3167ff53fb5b8a&scope.project.id=03067c95202a44bbae7686a1a4886b44&role.id=316da37136b4425f9ae486ae1e2bf4b4 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:00.985036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edac587-2bdc-4403-9b3c-0d7b11e0bb9f None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:00.995010 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c3c49-9d5c-459a-b6fb-963640f46a2a None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:01.059817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937715c-1ac4-4204-b949-02dffaf4b709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:01.061385 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937715c-1ac4-4204-b949-02dffaf4b709 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:01.061571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937715c-1ac4-4204-b949-02dffaf4b709 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:01.061958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937715c-1ac4-4204-b949-02dffaf4b709 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:01.063583 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937715c-1ac4-4204-b949-02dffaf4b709 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:01.063987 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937715c-1ac4-4204-b949-02dffaf4b709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:01.066648 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937715c-1ac4-4204-b949-02dffaf4b709 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:01.084847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 87/171] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:47:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:01.094670 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937715c-1ac4-4204-b949-02dffaf4b709 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:01.128838 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edac587-2bdc-4403-9b3c-0d7b11e0bb9f None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:01.176089 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf3fc6-445b-4c18-b371-a1f946d6b01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:01.178075 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf3fc6-445b-4c18-b371-a1f946d6b01f None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:01.178075 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf3fc6-445b-4c18-b371-a1f946d6b01f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:01.178075 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf3fc6-445b-4c18-b371-a1f946d6b01f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:01.195894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf3fc6-445b-4c18-b371-a1f946d6b01f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:01.206652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-09cf3fc6-445b-4c18-b371-a1f946d6b01f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:01.206652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:01.206652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:01.206652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:01.206652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:01.206652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:01.206652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:01.206652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:01.206652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:01.206652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:01.206652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:01.206652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:01.206652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:01.206652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:01.206652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:01.206652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:01.207608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:01.207608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:01.207608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:01.207608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:01.207608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:01.207608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:01.207608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:01.207608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:01.207608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:01.207608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:01.207608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:01.207608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:01.207608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:01.207608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:01.207608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:01.207608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:01.208555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:01.208555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:01.208555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:01.208555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:01.208555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:01.208555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:01.208555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:01.208555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:01.208555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:01.208555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:01.208555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:01.208555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:01.208555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 85/172] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:01.226268 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf3fc6-445b-4c18-b371-a1f946d6b01f None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:01.286744 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937715c-1ac4-4204-b949-02dffaf4b709 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:01.352737 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ff70c-6e22-4195-8a86-c7f1d7f1ec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:01.353956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ff70c-6e22-4195-8a86-c7f1d7f1ec29 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:01.354666 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ff70c-6e22-4195-8a86-c7f1d7f1ec29 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:01.355135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ff70c-6e22-4195-8a86-c7f1d7f1ec29 None admin] PATH_INFO: `/v3/users/48acc9bcb97f44808ced41b25bd1bdc7` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:01.356994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ff70c-6e22-4195-8a86-c7f1d7f1ec29 None admin] RBAC: Authorizing `identity:get_user(user_id=48acc9bcb97f44808ced41b25bd1bdc7)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:01.359814 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ff70c-6e22-4195-8a86-c7f1d7f1ec29 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:01.362330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 88/173] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:47:01 2022] GET /identity/v3/users/48acc9bcb97f44808ced41b25bd1bdc7 => generated 289 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:01.374069 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ff70c-6e22-4195-8a86-c7f1d7f1ec29 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:01.449084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf3fc6-445b-4c18-b371-a1f946d6b01f None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:01.493390 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab80309-3e12-495f-9d50-f05455e1c4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:01.494115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab80309-3e12-495f-9d50-f05455e1c4fa None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:01.494427 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab80309-3e12-495f-9d50-f05455e1c4fa None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:01.494705 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab80309-3e12-495f-9d50-f05455e1c4fa None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:01.495474 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab80309-3e12-495f-9d50-f05455e1c4fa None admin] RBAC: Adding query filter params (name=member) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:01.495783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab80309-3e12-495f-9d50-f05455e1c4fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:01.497205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab80309-3e12-495f-9d50-f05455e1c4fa None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:01.511841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 86/174] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:47:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:01.512950 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ff70c-6e22-4195-8a86-c7f1d7f1ec29 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:01.518924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab80309-3e12-495f-9d50-f05455e1c4fa None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:01.561855 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0217b45-c051-490e-a55c-b44e2817e482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:01.563166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0217b45-c051-490e-a55c-b44e2817e482 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:01.563577 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0217b45-c051-490e-a55c-b44e2817e482 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:01.563897 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0217b45-c051-490e-a55c-b44e2817e482 None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:01.566807 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0217b45-c051-490e-a55c-b44e2817e482 None admin] RBAC: Authorizing `identity:get_project(project_id=03067c95202a44bbae7686a1a4886b44)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:01.569361 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0217b45-c051-490e-a55c-b44e2817e482 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:01.571344 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 89/175] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:01 2022] GET /identity/v3/projects/03067c95202a44bbae7686a1a4886b44 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:01.588757 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0217b45-c051-490e-a55c-b44e2817e482 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:01.684742 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab80309-3e12-495f-9d50-f05455e1c4fa None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:01.734457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9237c1c-7063-4862-902f-4e085c82fee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:01.735384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9237c1c-7063-4862-902f-4e085c82fee2 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:01.735662 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9237c1c-7063-4862-902f-4e085c82fee2 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:01.735931 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9237c1c-7063-4862-902f-4e085c82fee2 None admin] PATH_INFO: `/v3/users/a1d7a40db9484e8d8f3167ff53fb5b8a` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:01.737595 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9237c1c-7063-4862-902f-4e085c82fee2 None admin] RBAC: Authorizing `identity:get_user(user_id=a1d7a40db9484e8d8f3167ff53fb5b8a)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:01.739112 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9237c1c-7063-4862-902f-4e085c82fee2 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:01.741350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 87/176] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:47:01 2022] GET /identity/v3/users/a1d7a40db9484e8d8f3167ff53fb5b8a => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:01.755964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9237c1c-7063-4862-902f-4e085c82fee2 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:01.787268 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0217b45-c051-490e-a55c-b44e2817e482 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:01.841534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030af8dc-41bb-4ea2-ba4e-90af5336602f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:01.843518 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030af8dc-41bb-4ea2-ba4e-90af5336602f None admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:01.843812 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030af8dc-41bb-4ea2-ba4e-90af5336602f None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:01.844094 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030af8dc-41bb-4ea2-ba4e-90af5336602f None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44/users/48acc9bcb97f44808ced41b25bd1bdc7/roles/27bc06df3c7b4654b71935efdaca22aa` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:01.849570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030af8dc-41bb-4ea2-ba4e-90af5336602f None admin] RBAC: Authorizing `identity:create_grant(project_id=03067c95202a44bbae7686a1a4886b44, user_id=48acc9bcb97f44808ced41b25bd1bdc7, role_id=27bc06df3c7b4654b71935efdaca22aa)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:01.849933 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030af8dc-41bb-4ea2-ba4e-90af5336602f None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:01.878426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 90/177] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:47:01 2022] PUT /identity/v3/projects/03067c95202a44bbae7686a1a4886b44/users/48acc9bcb97f44808ced41b25bd1bdc7/roles/27bc06df3c7b4654b71935efdaca22aa => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:47:01.969946 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9237c1c-7063-4862-902f-4e085c82fee2 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:02.052193 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b665e3-16f5-48c4-a216-2e63d38db880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:02.053837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b665e3-16f5-48c4-a216-2e63d38db880 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:02.054692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b665e3-16f5-48c4-a216-2e63d38db880 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:02.055401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b665e3-16f5-48c4-a216-2e63d38db880 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:02.164233 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b665e3-16f5-48c4-a216-2e63d38db880 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:02.165926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b665e3-16f5-48c4-a216-2e63d38db880 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:02.405299 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 88/178] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 13:47:02.411543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030af8dc-41bb-4ea2-ba4e-90af5336602f None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:02.675766 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030af8dc-41bb-4ea2-ba4e-90af5336602f None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:02.768100 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21719e6-4bf2-4ca0-9817-f1e20242f8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:02.769001 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21719e6-4bf2-4ca0-9817-f1e20242f8c9 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:02.769285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21719e6-4bf2-4ca0-9817-f1e20242f8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:02.769559 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21719e6-4bf2-4ca0-9817-f1e20242f8c9 None admin] PATH_INFO: `/v3/projects/477a8d374cd243488078d49785d3ba19` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:02.771346 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21719e6-4bf2-4ca0-9817-f1e20242f8c9 None admin] RBAC: Authorizing `identity:get_project(project_id=477a8d374cd243488078d49785d3ba19)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:02.773588 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21719e6-4bf2-4ca0-9817-f1e20242f8c9 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:02.776614 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 91/179] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:02 2022] GET /identity/v3/projects/477a8d374cd243488078d49785d3ba19 => generated 312 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:02.785022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b665e3-16f5-48c4-a216-2e63d38db880 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:02.986905 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b665e3-16f5-48c4-a216-2e63d38db880 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:03.040940 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a319a9-8bf2-4a87-871d-c803dd682e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:03.041581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a319a9-8bf2-4a87-871d-c803dd682e98 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:03.041864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a319a9-8bf2-4a87-871d-c803dd682e98 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:03.042141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a319a9-8bf2-4a87-871d-c803dd682e98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:03.043029 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a319a9-8bf2-4a87-871d-c803dd682e98 None admin] RBAC: Adding query filter params (role.id=34ef75b7c6d54c5e81edbfee2f4b362d, scope.project.id=477a8d374cd243488078d49785d3ba19, user.id=a1d7a40db9484e8d8f3167ff53fb5b8a) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:03.043343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a319a9-8bf2-4a87-871d-c803dd682e98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:03.044817 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a319a9-8bf2-4a87-871d-c803dd682e98 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:03.055096 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 89/180] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:47:02 2022] GET /identity/v3/role_assignments?user.id=a1d7a40db9484e8d8f3167ff53fb5b8a&scope.project.id=477a8d374cd243488078d49785d3ba19&role.id=34ef75b7c6d54c5e81edbfee2f4b362d => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:04.398983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc11fc5-0b10-4a03-a318-acc5b6da5ba5 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:04.400707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc11fc5-0b10-4a03-a318-acc5b6da5ba5 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:04.401483 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc11fc5-0b10-4a03-a318-acc5b6da5ba5 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:04.404621 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 92/181] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:04.409485 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321b070-13f9-4c85-938a-54462eedfb5d None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:04.410482 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321b070-13f9-4c85-938a-54462eedfb5d None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:04.410953 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321b070-13f9-4c85-938a-54462eedfb5d None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:04.412673 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 90/182] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:04.416992 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd61c2-c536-4121-b759-4332257b4765 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:04.417698 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd61c2-c536-4121-b759-4332257b4765 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:04.418159 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd61c2-c536-4121-b759-4332257b4765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:04.419149 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b8151-ea82-4f32-9b8b-ab6a1fda3567 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:04.419696 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b8151-ea82-4f32-9b8b-ab6a1fda3567 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:04.420744 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b8151-ea82-4f32-9b8b-ab6a1fda3567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:04.438471 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-7d0b8151-ea82-4f32-9b8b-ab6a1fda3567 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:04.438754 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-a7bd61c2-c536-4121-b759-4332257b4765 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:04.440088 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-7d0b8151-ea82-4f32-9b8b-ab6a1fda3567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:04.440196 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a7bd61c2-c536-4121-b759-4332257b4765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:04.516774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 91/183] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:04.518238 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 93/184] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:47:04.542772 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b8151-ea82-4f32-9b8b-ab6a1fda3567 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:04.543718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd61c2-c536-4121-b759-4332257b4765 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:04.652956 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b8151-ea82-4f32-9b8b-ab6a1fda3567 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:04.658662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd61c2-c536-4121-b759-4332257b4765 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:04.698726 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be17f0-2dc5-4743-9ca1-ccea2acd2f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:04.699544 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be17f0-2dc5-4743-9ca1-ccea2acd2f0b None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:04.699830 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be17f0-2dc5-4743-9ca1-ccea2acd2f0b None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:04.700102 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be17f0-2dc5-4743-9ca1-ccea2acd2f0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:04.702025 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be17f0-2dc5-4743-9ca1-ccea2acd2f0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:04.704296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be17f0-2dc5-4743-9ca1-ccea2acd2f0b None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:04.710273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 94/185] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:04.710273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f1792-3238-41c8-9d8d-fb0b7c702310 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:04.710273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f1792-3238-41c8-9d8d-fb0b7c702310 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:04.710273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f1792-3238-41c8-9d8d-fb0b7c702310 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:04.710273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 95/186] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:04.712862 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f1792-3238-41c8-9d8d-fb0b7c702310 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:04.719520 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4ae02-b206-4a70-b75f-10cead9a9dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:04.721013 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4ae02-b206-4a70-b75f-10cead9a9dd1 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:04.721593 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4ae02-b206-4a70-b75f-10cead9a9dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:04.722061 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4ae02-b206-4a70-b75f-10cead9a9dd1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:04.739904 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4ae02-b206-4a70-b75f-10cead9a9dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:04.754781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-f6e4ae02-b206-4a70-b75f-10cead9a9dd1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:47:04.754781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:04.754781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:04.754781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:04.754781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:04.754781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:04.754781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:04.754781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:04.754781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:04.754781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:04.754781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:04.754781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:04.754781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:04.754781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:04.754781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:04.754781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:04.756740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:04.756740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:04.756740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:04.756740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:04.756740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:04.756740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:04.756740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:04.756740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:04.756740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:04.756740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:04.756740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:04.756740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:04.756740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:04.756740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:04.756740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:04.756740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:04.758381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:04.758381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:04.758381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:04.758381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:04.758381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:04.758381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:04.758381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:04.758381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:04.758381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:04.758381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:04.758381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:47:04.758381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:04.758381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 92/187] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:04.759699 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84494d-acbd-4faf-8744-187fc7ffcc74 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:04.759827 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84494d-acbd-4faf-8744-187fc7ffcc74 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:04.760293 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84494d-acbd-4faf-8744-187fc7ffcc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:04.787712 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-4c84494d-acbd-4faf-8744-187fc7ffcc74 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:04.789710 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-4c84494d-acbd-4faf-8744-187fc7ffcc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:04.896281 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 93/188] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:04.897172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84494d-acbd-4faf-8744-187fc7ffcc74 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:04.909020 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f1792-3238-41c8-9d8d-fb0b7c702310 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:04.958032 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307d0b1-fa0e-406d-a3c3-4dd2f972df43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:04.959228 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307d0b1-fa0e-406d-a3c3-4dd2f972df43 None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:04.959722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307d0b1-fa0e-406d-a3c3-4dd2f972df43 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:04.959992 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307d0b1-fa0e-406d-a3c3-4dd2f972df43 None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:04.960733 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307d0b1-fa0e-406d-a3c3-4dd2f972df43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:04.962259 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307d0b1-fa0e-406d-a3c3-4dd2f972df43 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:04.985755 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 96/189] 10.222.0.32 () {60 vars in 1132 bytes} [Tue May 10 13:47:04 2022] POST /identity/v3/users => generated 297 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:47:04.995440 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307d0b1-fa0e-406d-a3c3-4dd2f972df43 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:05.067601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84494d-acbd-4faf-8744-187fc7ffcc74 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:05.133212 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3c09b-fe48-4d6c-b99e-338f11962920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:05.134453 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3c09b-fe48-4d6c-b99e-338f11962920 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:05.134968 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3c09b-fe48-4d6c-b99e-338f11962920 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:05.135434 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307d0b1-fa0e-406d-a3c3-4dd2f972df43 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:05.135542 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3c09b-fe48-4d6c-b99e-338f11962920 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:05.136885 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3c09b-fe48-4d6c-b99e-338f11962920 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:05.137394 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3c09b-fe48-4d6c-b99e-338f11962920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:05.140801 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3c09b-fe48-4d6c-b99e-338f11962920 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:05.156241 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 94/190] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:47:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:05.158054 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9e62b-428e-4c66-bd62-6ee105190439 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:05.158443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9e62b-428e-4c66-bd62-6ee105190439 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:05.158833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9e62b-428e-4c66-bd62-6ee105190439 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:05.160519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 95/191] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:05.168513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9e62b-428e-4c66-bd62-6ee105190439 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:05.199554 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc58d7-a41c-48e0-994a-003920d62855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:05.200865 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc58d7-a41c-48e0-994a-003920d62855 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:05.201782 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc58d7-a41c-48e0-994a-003920d62855 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:05.202242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc58d7-a41c-48e0-994a-003920d62855 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:05.220890 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc58d7-a41c-48e0-994a-003920d62855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:05.229564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-35bc58d7-a41c-48e0-994a-003920d62855 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:47:05.229564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:05.229564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:05.229564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:05.229564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:05.229564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:05.229564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:05.229564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:05.229564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:05.229564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:05.229564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:05.229564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:05.229564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:05.229564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:05.229564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:05.229564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:05.230864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:05.230864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:05.230864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:05.230864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:05.230864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:05.230864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:05.230864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:05.230864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:05.230864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:05.230864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:05.230864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:05.230864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:05.230864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:05.230864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:05.230864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:05.230864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:05.233122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:05.233122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:05.233122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:05.233122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:05.233122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:05.233122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:05.233122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:05.233122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:05.233122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:05.233122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:05.233122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:47:05.233122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:05.233122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 97/192] 10.222.0.32 () {56 vars in 1114 bytes} [Tue May 10 13:47:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:05.234714 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf25f58-93ab-4255-a18f-7cdfeb55982f None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:05.234714 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf25f58-93ab-4255-a18f-7cdfeb55982f None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:05.234714 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf25f58-93ab-4255-a18f-7cdfeb55982f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:05.256039 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-fcf25f58-93ab-4255-a18f-7cdfeb55982f None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:05.257272 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-fcf25f58-93ab-4255-a18f-7cdfeb55982f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:05.362690 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9e62b-428e-4c66-bd62-6ee105190439 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:05.386115 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 98/193] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:05.387518 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf25f58-93ab-4255-a18f-7cdfeb55982f None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:05.424633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55f259-6169-43a6-9d2c-00fb2cf28163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:05.426320 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55f259-6169-43a6-9d2c-00fb2cf28163 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:05.426847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55f259-6169-43a6-9d2c-00fb2cf28163 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:05.427351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55f259-6169-43a6-9d2c-00fb2cf28163 None admin] PATH_INFO: `/v3/users/48acc9bcb97f44808ced41b25bd1bdc7` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:05.428769 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55f259-6169-43a6-9d2c-00fb2cf28163 None admin] RBAC: Authorizing `identity:get_user(user_id=48acc9bcb97f44808ced41b25bd1bdc7)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:05.430271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55f259-6169-43a6-9d2c-00fb2cf28163 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:05.437237 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 96/194] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:47:05 2022] GET /identity/v3/users/48acc9bcb97f44808ced41b25bd1bdc7 => generated 289 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:05.438751 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55f259-6169-43a6-9d2c-00fb2cf28163 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:05.513212 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf25f58-93ab-4255-a18f-7cdfeb55982f None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:05.550181 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55f259-6169-43a6-9d2c-00fb2cf28163 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:05.552064 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321497b-e581-4ddf-b517-6ce9228ecea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:05.553659 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321497b-e581-4ddf-b517-6ce9228ecea8 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:05.553969 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321497b-e581-4ddf-b517-6ce9228ecea8 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:05.554227 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321497b-e581-4ddf-b517-6ce9228ecea8 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:05.555032 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321497b-e581-4ddf-b517-6ce9228ecea8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:05.555337 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321497b-e581-4ddf-b517-6ce9228ecea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:05.556811 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321497b-e581-4ddf-b517-6ce9228ecea8 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:05.570100 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 99/195] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:47:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:05.571019 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321497b-e581-4ddf-b517-6ce9228ecea8 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:05.593770 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2e25e-e8c3-4ea8-b683-911c32819c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:05.594557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2e25e-e8c3-4ea8-b683-911c32819c70 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:05.594835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2e25e-e8c3-4ea8-b683-911c32819c70 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:05.595170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2e25e-e8c3-4ea8-b683-911c32819c70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:05.674133 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2e25e-e8c3-4ea8-b683-911c32819c70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:05.675816 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2e25e-e8c3-4ea8-b683-911c32819c70 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:05.682903 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321497b-e581-4ddf-b517-6ce9228ecea8 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:05.720665 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d978618-674c-49f6-8e58-67a6f61afadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:05.721484 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d978618-674c-49f6-8e58-67a6f61afadf None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:05.721768 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d978618-674c-49f6-8e58-67a6f61afadf None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:05.722039 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d978618-674c-49f6-8e58-67a6f61afadf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:05.733769 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d978618-674c-49f6-8e58-67a6f61afadf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:05.741720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-4d978618-674c-49f6-8e58-67a6f61afadf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:05.741720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:05.741720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:05.741720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:05.741720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:05.741720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:05.741720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:05.741720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:05.741720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:05.741720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:05.741720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:05.741720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:05.741720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:05.741720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:05.741720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:05.741720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:05.745335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:05.745335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:05.745335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:05.745335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:05.745335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:05.745335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:05.745335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:05.745335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:05.745335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:05.745335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:05.745335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:05.745335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:05.745335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:05.745335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:05.745335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:05.745335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:05.748504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:05.748504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:05.748504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:05.748504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:05.748504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:05.748504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:05.748504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:05.748504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:05.748504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:05.748504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:05.748504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:05.748504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:05.748504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 100/196] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:47:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:05.748504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d978618-674c-49f6-8e58-67a6f61afadf None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:05.788571 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 97/197] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:05.789443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2e25e-e8c3-4ea8-b683-911c32819c70 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:05.877507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d978618-674c-49f6-8e58-67a6f61afadf None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:05.911913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2e25e-e8c3-4ea8-b683-911c32819c70 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:05.924410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59153f05-5a13-44fd-80b7-6aec6714e94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:05.925661 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59153f05-5a13-44fd-80b7-6aec6714e94d None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:05.926004 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59153f05-5a13-44fd-80b7-6aec6714e94d None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:05.926269 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59153f05-5a13-44fd-80b7-6aec6714e94d None admin] PATH_INFO: `/v3/users/c5e23998f7014e808912f5d0ef57c711` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:05.941931 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59153f05-5a13-44fd-80b7-6aec6714e94d None admin] RBAC: Authorizing `identity:get_user(user_id=c5e23998f7014e808912f5d0ef57c711)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:05.944041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59153f05-5a13-44fd-80b7-6aec6714e94d None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:05.946118 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 101/198] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:47:05 2022] GET /identity/v3/users/c5e23998f7014e808912f5d0ef57c711 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:05.951175 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59153f05-5a13-44fd-80b7-6aec6714e94d None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:05.962951 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e9b35-84ed-4fca-bd1b-af13f923ebdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:05.963641 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e9b35-84ed-4fca-bd1b-af13f923ebdf None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:05.963922 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e9b35-84ed-4fca-bd1b-af13f923ebdf None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:05.964197 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e9b35-84ed-4fca-bd1b-af13f923ebdf None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:05.965494 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e9b35-84ed-4fca-bd1b-af13f923ebdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:05.965804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e9b35-84ed-4fca-bd1b-af13f923ebdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:05.967776 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e9b35-84ed-4fca-bd1b-af13f923ebdf None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:05.979323 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 98/199] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:05.980224 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e9b35-84ed-4fca-bd1b-af13f923ebdf None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:06.063995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59153f05-5a13-44fd-80b7-6aec6714e94d None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:06.102715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce6566-8537-431b-ac85-896505bc32d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:06.103995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce6566-8537-431b-ac85-896505bc32d6 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:06.104494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce6566-8537-431b-ac85-896505bc32d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:06.104963 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce6566-8537-431b-ac85-896505bc32d6 None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:06.106792 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce6566-8537-431b-ac85-896505bc32d6 None admin] RBAC: Authorizing `identity:get_project(project_id=03067c95202a44bbae7686a1a4886b44)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:06.109078 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce6566-8537-431b-ac85-896505bc32d6 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:06.111209 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 102/200] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:05 2022] GET /identity/v3/projects/03067c95202a44bbae7686a1a4886b44 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:06.118844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce6566-8537-431b-ac85-896505bc32d6 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:06.141878 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e9b35-84ed-4fca-bd1b-af13f923ebdf None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:06.180596 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363e319-410d-4091-9812-9a741e5169e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:06.181217 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363e319-410d-4091-9812-9a741e5169e9 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:06.181534 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363e319-410d-4091-9812-9a741e5169e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:06.181813 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363e319-410d-4091-9812-9a741e5169e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:06.236435 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce6566-8537-431b-ac85-896505bc32d6 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:06.262307 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363e319-410d-4091-9812-9a741e5169e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:06.263975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363e319-410d-4091-9812-9a741e5169e9 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:06.276246 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185c58d-e173-4365-9200-bb00ed4b70b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:06.277502 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185c58d-e173-4365-9200-bb00ed4b70b4 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:06.278010 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185c58d-e173-4365-9200-bb00ed4b70b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:06.278513 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185c58d-e173-4365-9200-bb00ed4b70b4 None admin] PATH_INFO: `/v3/users/c5e23998f7014e808912f5d0ef57c711` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:06.280696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185c58d-e173-4365-9200-bb00ed4b70b4 None admin] RBAC: Authorizing `identity:get_user(user_id=c5e23998f7014e808912f5d0ef57c711)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:06.282605 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185c58d-e173-4365-9200-bb00ed4b70b4 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:06.284718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 103/201] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:47:06 2022] GET /identity/v3/users/c5e23998f7014e808912f5d0ef57c711 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:06.285961 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185c58d-e173-4365-9200-bb00ed4b70b4 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:06.388813 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 99/202] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:06.388813 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363e319-410d-4091-9812-9a741e5169e9 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:06.405186 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185c58d-e173-4365-9200-bb00ed4b70b4 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:06.445099 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2f441-c515-4918-afcd-6e6189396675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:06.446189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2f441-c515-4918-afcd-6e6189396675 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:06.446709 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2f441-c515-4918-afcd-6e6189396675 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:06.447205 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2f441-c515-4918-afcd-6e6189396675 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:06.448329 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2f441-c515-4918-afcd-6e6189396675 None admin] RBAC: Adding query filter params (role.id=27bc06df3c7b4654b71935efdaca22aa, scope.project.id=03067c95202a44bbae7686a1a4886b44, user.id=48acc9bcb97f44808ced41b25bd1bdc7) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:06.448858 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2f441-c515-4918-afcd-6e6189396675 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:06.450606 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2f441-c515-4918-afcd-6e6189396675 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:06.463927 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 104/203] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:47:06 2022] GET /identity/v3/role_assignments?user.id=48acc9bcb97f44808ced41b25bd1bdc7&scope.project.id=03067c95202a44bbae7686a1a4886b44&role.id=27bc06df3c7b4654b71935efdaca22aa => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:06.465250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2f441-c515-4918-afcd-6e6189396675 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:06.530724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363e319-410d-4091-9812-9a741e5169e9 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:06.571789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bdda1-e82f-4458-99d8-5ec960a74f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:06.572467 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bdda1-e82f-4458-99d8-5ec960a74f89 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:06.572754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bdda1-e82f-4458-99d8-5ec960a74f89 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:06.573033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bdda1-e82f-4458-99d8-5ec960a74f89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:06.650919 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2f441-c515-4918-afcd-6e6189396675 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:06.660490 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bdda1-e82f-4458-99d8-5ec960a74f89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:06.662249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bdda1-e82f-4458-99d8-5ec960a74f89 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:06.787858 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8a2b7-93d4-4840-a5de-e1f79f3c5079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:06.789024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8a2b7-93d4-4840-a5de-e1f79f3c5079 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:06.789506 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8a2b7-93d4-4840-a5de-e1f79f3c5079 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:06.790003 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8a2b7-93d4-4840-a5de-e1f79f3c5079 None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:06.797243 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8a2b7-93d4-4840-a5de-e1f79f3c5079 None admin] RBAC: Authorizing `identity:get_project(project_id=ec7d549ce6b14f7f8c85bf895eebadac)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:06.799566 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8a2b7-93d4-4840-a5de-e1f79f3c5079 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:06.811136 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 105/204] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:06 2022] GET /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac => generated 302 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:06.847923 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8a2b7-93d4-4840-a5de-e1f79f3c5079 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:06.861331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 100/205] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:06.867193 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bdda1-e82f-4458-99d8-5ec960a74f89 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:07.008234 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bdda1-e82f-4458-99d8-5ec960a74f89 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:07.059656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68b735-933a-478e-9ee6-939a29ec57a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:07.062479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68b735-933a-478e-9ee6-939a29ec57a2 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:07.062991 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68b735-933a-478e-9ee6-939a29ec57a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:07.063477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68b735-933a-478e-9ee6-939a29ec57a2 None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:07.063583 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8a2b7-93d4-4840-a5de-e1f79f3c5079 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:07.065787 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68b735-933a-478e-9ee6-939a29ec57a2 None admin] RBAC: Authorizing `identity:get_project(project_id=ec7d549ce6b14f7f8c85bf895eebadac)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:07.068632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68b735-933a-478e-9ee6-939a29ec57a2 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:07.074235 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 101/206] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:06 2022] GET /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:07.086323 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68b735-933a-478e-9ee6-939a29ec57a2 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:07.115638 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60553414-b2b5-4697-8b05-a5571d46313b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:07.116975 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60553414-b2b5-4697-8b05-a5571d46313b None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:07.117557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60553414-b2b5-4697-8b05-a5571d46313b None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:07.118121 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60553414-b2b5-4697-8b05-a5571d46313b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:07.119925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60553414-b2b5-4697-8b05-a5571d46313b None admin] RBAC: Adding query filter params (role.id=316da37136b4425f9ae486ae1e2bf4b4, scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac, user.id=c5e23998f7014e808912f5d0ef57c711) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:07.120557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60553414-b2b5-4697-8b05-a5571d46313b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:07.124063 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60553414-b2b5-4697-8b05-a5571d46313b None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:07.138281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 106/207] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:47:06 2022] GET /identity/v3/role_assignments?user.id=c5e23998f7014e808912f5d0ef57c711&scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac&role.id=316da37136b4425f9ae486ae1e2bf4b4 => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:07.215246 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68b735-933a-478e-9ee6-939a29ec57a2 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:07.258489 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d531b9-6865-4a21-a48a-6ff86f3747a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:07.259174 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d531b9-6865-4a21-a48a-6ff86f3747a6 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:07.259460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d531b9-6865-4a21-a48a-6ff86f3747a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:07.259737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d531b9-6865-4a21-a48a-6ff86f3747a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:07.260612 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d531b9-6865-4a21-a48a-6ff86f3747a6 None admin] RBAC: Adding query filter params (role.id=17e40821fc444dd0b040dcfce3eb222b, scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac, user.id=c5e23998f7014e808912f5d0ef57c711) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:07.260927 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d531b9-6865-4a21-a48a-6ff86f3747a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:07.262459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d531b9-6865-4a21-a48a-6ff86f3747a6 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:07.274361 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 102/208] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:47:07 2022] GET /identity/v3/role_assignments?user.id=c5e23998f7014e808912f5d0ef57c711&scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac&role.id=17e40821fc444dd0b040dcfce3eb222b => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:08.234441 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bd469-41db-4cdc-992d-9c224b93c219 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:08.234935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bd469-41db-4cdc-992d-9c224b93c219 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:08.234935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bd469-41db-4cdc-992d-9c224b93c219 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:08.236403 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 107/209] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:08.242404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef3b32-2c93-4ef3-a60b-e704b9a44a51 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:08.242993 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef3b32-2c93-4ef3-a60b-e704b9a44a51 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:08.242993 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef3b32-2c93-4ef3-a60b-e704b9a44a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:08.261756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-ebef3b32-2c93-4ef3-a60b-e704b9a44a51 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:08.263115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-ebef3b32-2c93-4ef3-a60b-e704b9a44a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:08.298840 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7b87d-2f27-4375-a37c-d440b361b628 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:08.299152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7b87d-2f27-4375-a37c-d440b361b628 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:08.299384 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7b87d-2f27-4375-a37c-d440b361b628 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:08.300776 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 108/210] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:08.306331 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5284e-50fc-49f8-b929-0e27da601106 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:08.306616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5284e-50fc-49f8-b929-0e27da601106 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:08.306869 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5284e-50fc-49f8-b929-0e27da601106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:08.328564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-b9f5284e-50fc-49f8-b929-0e27da601106 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:08.329784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b9f5284e-50fc-49f8-b929-0e27da601106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:08.378806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 103/211] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:08.401107 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef3b32-2c93-4ef3-a60b-e704b9a44a51 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:08.433415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 109/212] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:47:08.458440 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5284e-50fc-49f8-b929-0e27da601106 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:08.526477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef3b32-2c93-4ef3-a60b-e704b9a44a51 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:08.567939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbd033-9f4e-4952-b9fa-4478422fcef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:08.568899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbd033-9f4e-4952-b9fa-4478422fcef3 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:08.569191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbd033-9f4e-4952-b9fa-4478422fcef3 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:08.569687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbd033-9f4e-4952-b9fa-4478422fcef3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:08.582681 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbd033-9f4e-4952-b9fa-4478422fcef3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:08.590978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-ddcbd033-9f4e-4952-b9fa-4478422fcef3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:08.590978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:08.590978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:08.590978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:08.590978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:08.590978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:08.590978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:08.590978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:08.590978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:08.590978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:08.590978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:08.590978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:08.590978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:08.590978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:08.590978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:08.590978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:08.593343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:08.593343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:08.593343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:08.593343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:08.593343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:08.593343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:08.593343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:08.593343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:08.593343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:08.593343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:08.593343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:08.593343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:08.593343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:08.593343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:08.593343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:08.593343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:08.594964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:08.594964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:08.594964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:08.594964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:08.594964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:08.594964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:08.594964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:08.594964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:08.594964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:08.594964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:08.594964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:08.594964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:08.594964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 104/213] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:08.600437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbd033-9f4e-4952-b9fa-4478422fcef3 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:08.640392 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5284e-50fc-49f8-b929-0e27da601106 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:08.678904 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79c058-a85e-42bd-b098-c9a8949a3a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:08.679721 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79c058-a85e-42bd-b098-c9a8949a3a71 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:08.680004 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79c058-a85e-42bd-b098-c9a8949a3a71 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:08.680275 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79c058-a85e-42bd-b098-c9a8949a3a71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:08.681523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79c058-a85e-42bd-b098-c9a8949a3a71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:08.683151 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79c058-a85e-42bd-b098-c9a8949a3a71 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:08.685128 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 110/214] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:08.692146 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79c058-a85e-42bd-b098-c9a8949a3a71 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:08.762025 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbd033-9f4e-4952-b9fa-4478422fcef3 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:08.800198 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b9713-4b6a-40d0-8383-affb13e8107e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:08.801228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b9713-4b6a-40d0-8383-affb13e8107e None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:08.801724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b9713-4b6a-40d0-8383-affb13e8107e None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:08.802223 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b9713-4b6a-40d0-8383-affb13e8107e None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:08.803207 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b9713-4b6a-40d0-8383-affb13e8107e None admin] RBAC: Adding query filter params (name=member) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:08.803735 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b9713-4b6a-40d0-8383-affb13e8107e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:08.805358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b9713-4b6a-40d0-8383-affb13e8107e None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:08.806210 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79c058-a85e-42bd-b098-c9a8949a3a71 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:08.816758 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 105/215] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:47:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:08.828505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b9713-4b6a-40d0-8383-affb13e8107e None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:08.850161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4ba96-62ff-42e1-b4f6-b69c48afad5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:08.853417 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4ba96-62ff-42e1-b4f6-b69c48afad5e None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:08.853417 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4ba96-62ff-42e1-b4f6-b69c48afad5e None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:08.853417 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4ba96-62ff-42e1-b4f6-b69c48afad5e None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:08.853417 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4ba96-62ff-42e1-b4f6-b69c48afad5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:08.854346 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4ba96-62ff-42e1-b4f6-b69c48afad5e None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:08.882718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 111/216] 10.222.0.32 () {60 vars in 1132 bytes} [Tue May 10 13:47:08 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:47:08.997704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b9713-4b6a-40d0-8383-affb13e8107e None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:09.039173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b34d2-6233-444c-9dd2-34fdec50ffd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:09.040088 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b34d2-6233-444c-9dd2-34fdec50ffd2 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:09.040370 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b34d2-6233-444c-9dd2-34fdec50ffd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:09.040642 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b34d2-6233-444c-9dd2-34fdec50ffd2 None admin] PATH_INFO: `/v3/users/cd4e76381bce489ca3b5eb092683ff5f` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:09.064335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b34d2-6233-444c-9dd2-34fdec50ffd2 None admin] RBAC: Authorizing `identity:get_user(user_id=cd4e76381bce489ca3b5eb092683ff5f)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:09.066481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b34d2-6233-444c-9dd2-34fdec50ffd2 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:09.070914 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 106/217] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:47:08 2022] GET /identity/v3/users/cd4e76381bce489ca3b5eb092683ff5f => generated 297 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:09.076794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4ba96-62ff-42e1-b4f6-b69c48afad5e None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:09.230458 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4ba96-62ff-42e1-b4f6-b69c48afad5e None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:09.297506 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efe781-bd15-409e-9385-ed451d2e7f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:09.298749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efe781-bd15-409e-9385-ed451d2e7f22 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:09.299249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efe781-bd15-409e-9385-ed451d2e7f22 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:09.299730 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efe781-bd15-409e-9385-ed451d2e7f22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:09.402662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efe781-bd15-409e-9385-ed451d2e7f22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:09.405150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efe781-bd15-409e-9385-ed451d2e7f22 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:09.566072 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 112/218] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:09.571958 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b34d2-6233-444c-9dd2-34fdec50ffd2 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:09.718878 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b34d2-6233-444c-9dd2-34fdec50ffd2 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:09.765204 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5e787-0d3b-47a8-97ed-214e52aa31af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:09.766382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5e787-0d3b-47a8-97ed-214e52aa31af None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:09.766807 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5e787-0d3b-47a8-97ed-214e52aa31af None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:09.767221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5e787-0d3b-47a8-97ed-214e52aa31af None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:09.768740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5e787-0d3b-47a8-97ed-214e52aa31af None admin] RBAC: Authorizing `identity:get_project(project_id=ec7d549ce6b14f7f8c85bf895eebadac)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:09.770429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5e787-0d3b-47a8-97ed-214e52aa31af None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:09.772388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 107/219] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:09 2022] GET /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:09.779060 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efe781-bd15-409e-9385-ed451d2e7f22 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:09.914925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b09d5-cf98-4146-b497-4a7970e639f3 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:09.915593 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b09d5-cf98-4146-b497-4a7970e639f3 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:09.916068 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b09d5-cf98-4146-b497-4a7970e639f3 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:09.917707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 108/220] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:09.925147 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde09ae-5a23-428e-968c-d1ec46891533 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:09.925471 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde09ae-5a23-428e-968c-d1ec46891533 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:09.925715 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde09ae-5a23-428e-968c-d1ec46891533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:09.944755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-adde09ae-5a23-428e-968c-d1ec46891533 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:09.945985 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-adde09ae-5a23-428e-968c-d1ec46891533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:10.027814 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 109/221] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:47:10.034501 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efe781-bd15-409e-9385-ed451d2e7f22 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:10.035681 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b6f27-966c-4eca-b40b-66df9a209532 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:10.035987 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b6f27-966c-4eca-b40b-66df9a209532 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:10.036272 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b6f27-966c-4eca-b40b-66df9a209532 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:10.037718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 110/222] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:10.046674 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef0935-6236-49cd-ae66-ecad91a2996e None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:10.047052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef0935-6236-49cd-ae66-ecad91a2996e None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:10.047246 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef0935-6236-49cd-ae66-ecad91a2996e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:10.080673 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-c1ef0935-6236-49cd-ae66-ecad91a2996e None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:10.081917 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c1ef0935-6236-49cd-ae66-ecad91a2996e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:10.118854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd33e09-d6ce-4828-8a7b-44193e92b47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:10.119533 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd33e09-d6ce-4828-8a7b-44193e92b47e None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:10.119820 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd33e09-d6ce-4828-8a7b-44193e92b47e None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:10.120084 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd33e09-d6ce-4828-8a7b-44193e92b47e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:10.120940 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd33e09-d6ce-4828-8a7b-44193e92b47e None admin] RBAC: Adding query filter params (role.id=34ef75b7c6d54c5e81edbfee2f4b362d, scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac, user.id=cd4e76381bce489ca3b5eb092683ff5f) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:10.121252 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd33e09-d6ce-4828-8a7b-44193e92b47e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:10.122903 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd33e09-d6ce-4828-8a7b-44193e92b47e None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:10.138257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 113/223] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:47:09 2022] GET /identity/v3/role_assignments?user.id=cd4e76381bce489ca3b5eb092683ff5f&scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac&role.id=34ef75b7c6d54c5e81edbfee2f4b362d => generated 259 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:10.138257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd33e09-d6ce-4828-8a7b-44193e92b47e None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:10.229166 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 111/224] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:10.299609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef0935-6236-49cd-ae66-ecad91a2996e None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:10.325167 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd33e09-d6ce-4828-8a7b-44193e92b47e None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:10.385898 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aed150-7f45-404c-a5ec-8ceedee9fc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:10.386743 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aed150-7f45-404c-a5ec-8ceedee9fc65 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:10.387025 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aed150-7f45-404c-a5ec-8ceedee9fc65 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:10.387298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aed150-7f45-404c-a5ec-8ceedee9fc65 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:10.414232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aed150-7f45-404c-a5ec-8ceedee9fc65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:10.423647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-76aed150-7f45-404c-a5ec-8ceedee9fc65 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:47:10.423647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:10.423647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:10.423647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:10.423647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:10.423647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:10.423647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:10.423647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:10.423647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:10.423647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:10.423647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:10.423647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:10.423647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:10.423647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:10.423647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:10.423647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:10.424582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:10.424582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:10.424582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:10.424582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:10.424582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:10.424582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:10.424582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:10.424582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:10.424582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:10.424582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:10.424582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:10.424582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:10.424582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:10.424582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:10.424582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:10.424582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:10.425399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:10.425399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:10.425399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:10.425399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:10.425399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:10.425399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:10.425399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:10.425399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:10.425399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:10.425399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:10.425399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:47:10.425399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:10.430743 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 114/225] 10.222.0.32 () {56 vars in 1114 bytes} [Tue May 10 13:47:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:10.440257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aed150-7f45-404c-a5ec-8ceedee9fc65 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:10.479101 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef0935-6236-49cd-ae66-ecad91a2996e None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:10.522555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a903b-29ea-478e-82ac-57fb3760bb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:10.523382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a903b-29ea-478e-82ac-57fb3760bb41 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:10.523661 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a903b-29ea-478e-82ac-57fb3760bb41 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:10.523932 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a903b-29ea-478e-82ac-57fb3760bb41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:10.545701 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a903b-29ea-478e-82ac-57fb3760bb41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:10.553665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-e82a903b-29ea-478e-82ac-57fb3760bb41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:10.553665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:10.553665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:10.553665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:10.553665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:10.553665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:10.553665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:10.553665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:10.553665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:10.553665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:10.553665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:10.553665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:10.553665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:10.553665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:10.553665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:10.553665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:10.558410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:10.558410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:10.558410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:10.558410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:10.558410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:10.558410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:10.558410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:10.558410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:10.558410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:10.558410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:10.558410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:10.558410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:10.558410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:10.558410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:10.558410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:10.558410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:10.559331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:10.559331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:10.559331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:10.559331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:10.559331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:10.559331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:10.559331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:10.559331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:10.559331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:10.559331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:10.559331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:10.559331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:10.559331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 112/226] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:47:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:10.562685 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a903b-29ea-478e-82ac-57fb3760bb41 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:10.626036 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aed150-7f45-404c-a5ec-8ceedee9fc65 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:10.679591 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b803231-16a2-412a-96a5-b0d0ef70b1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:10.680684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b803231-16a2-412a-96a5-b0d0ef70b1ed None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:10.681173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b803231-16a2-412a-96a5-b0d0ef70b1ed None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:10.681648 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b803231-16a2-412a-96a5-b0d0ef70b1ed None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:10.682684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b803231-16a2-412a-96a5-b0d0ef70b1ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:10.683199 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b803231-16a2-412a-96a5-b0d0ef70b1ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:10.684842 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b803231-16a2-412a-96a5-b0d0ef70b1ed None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:10.706285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 115/227] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:47:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:10.707610 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b803231-16a2-412a-96a5-b0d0ef70b1ed None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:10.770435 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a903b-29ea-478e-82ac-57fb3760bb41 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:10.834757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af7b07-74fe-4052-a577-75e498a3471d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:10.840439 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af7b07-74fe-4052-a577-75e498a3471d None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:10.840761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af7b07-74fe-4052-a577-75e498a3471d None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:10.841063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af7b07-74fe-4052-a577-75e498a3471d None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:10.847705 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af7b07-74fe-4052-a577-75e498a3471d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:10.847705 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af7b07-74fe-4052-a577-75e498a3471d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:10.847705 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af7b07-74fe-4052-a577-75e498a3471d None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:10.874534 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 113/228] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:10.881353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af7b07-74fe-4052-a577-75e498a3471d None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:10.884501 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b803231-16a2-412a-96a5-b0d0ef70b1ed None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:10.987025 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68421ca-7528-4880-a16c-aa6e59dcd013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:10.988303 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68421ca-7528-4880-a16c-aa6e59dcd013 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:10.988791 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68421ca-7528-4880-a16c-aa6e59dcd013 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:10.989292 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68421ca-7528-4880-a16c-aa6e59dcd013 None admin] PATH_INFO: `/v3/users/c5e23998f7014e808912f5d0ef57c711` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:10.990888 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68421ca-7528-4880-a16c-aa6e59dcd013 None admin] RBAC: Authorizing `identity:get_user(user_id=c5e23998f7014e808912f5d0ef57c711)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:10.992616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68421ca-7528-4880-a16c-aa6e59dcd013 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:10.994613 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 116/229] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:47:10 2022] GET /identity/v3/users/c5e23998f7014e808912f5d0ef57c711 => generated 283 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:11.000437 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68421ca-7528-4880-a16c-aa6e59dcd013 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:11.073546 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af7b07-74fe-4052-a577-75e498a3471d None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:11.116403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c273ee5-a36d-4107-b2e7-0ae4a4c82598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:11.117224 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c273ee5-a36d-4107-b2e7-0ae4a4c82598 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:11.117547 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c273ee5-a36d-4107-b2e7-0ae4a4c82598 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:11.117825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c273ee5-a36d-4107-b2e7-0ae4a4c82598 None admin] PATH_INFO: `/v3/users/c5e23998f7014e808912f5d0ef57c711` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:11.119111 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c273ee5-a36d-4107-b2e7-0ae4a4c82598 None admin] RBAC: Authorizing `identity:get_user(user_id=c5e23998f7014e808912f5d0ef57c711)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:11.120584 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c273ee5-a36d-4107-b2e7-0ae4a4c82598 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:11.122680 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 114/230] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:47:10 2022] GET /identity/v3/users/c5e23998f7014e808912f5d0ef57c711 => generated 283 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:11.128472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c273ee5-a36d-4107-b2e7-0ae4a4c82598 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:11.158575 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68421ca-7528-4880-a16c-aa6e59dcd013 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:11.226128 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6c792-ea63-4d6d-85cc-72347b08b39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:11.227121 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6c792-ea63-4d6d-85cc-72347b08b39c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:11.227396 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6c792-ea63-4d6d-85cc-72347b08b39c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:11.227671 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6c792-ea63-4d6d-85cc-72347b08b39c None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:11.230947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6c792-ea63-4d6d-85cc-72347b08b39c None admin] RBAC: Authorizing `identity:get_project(project_id=ec7d549ce6b14f7f8c85bf895eebadac)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:11.234952 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6c792-ea63-4d6d-85cc-72347b08b39c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:11.245364 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 117/231] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:10 2022] GET /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:11.252699 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6c792-ea63-4d6d-85cc-72347b08b39c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:11.372814 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c273ee5-a36d-4107-b2e7-0ae4a4c82598 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:11.403104 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6c792-ea63-4d6d-85cc-72347b08b39c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:11.448279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221d7da-6668-43c4-a36d-c40616abcda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:11.449192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221d7da-6668-43c4-a36d-c40616abcda0 None admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:11.449472 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221d7da-6668-43c4-a36d-c40616abcda0 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:11.449742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221d7da-6668-43c4-a36d-c40616abcda0 None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac/users/c5e23998f7014e808912f5d0ef57c711/roles/316da37136b4425f9ae486ae1e2bf4b4` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:11.456719 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221d7da-6668-43c4-a36d-c40616abcda0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec7d549ce6b14f7f8c85bf895eebadac, user_id=c5e23998f7014e808912f5d0ef57c711, role_id=316da37136b4425f9ae486ae1e2bf4b4)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:11.458233 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221d7da-6668-43c4-a36d-c40616abcda0 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:11.469101 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23456e6c-91f9-4def-930e-24312618b48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:11.470353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23456e6c-91f9-4def-930e-24312618b48a None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:11.470640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23456e6c-91f9-4def-930e-24312618b48a None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:11.470920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23456e6c-91f9-4def-930e-24312618b48a None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:11.474665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23456e6c-91f9-4def-930e-24312618b48a None admin] RBAC: Authorizing `identity:get_project(project_id=ec7d549ce6b14f7f8c85bf895eebadac)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:11.478559 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23456e6c-91f9-4def-930e-24312618b48a None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:11.484574 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 118/232] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:47:11 2022] PUT /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac/users/c5e23998f7014e808912f5d0ef57c711/roles/316da37136b4425f9ae486ae1e2bf4b4 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:47:11.484970 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 115/233] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:11 2022] GET /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac => generated 302 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:11.490766 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221d7da-6668-43c4-a36d-c40616abcda0 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:11.614756 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221d7da-6668-43c4-a36d-c40616abcda0 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:11.683410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231abfa4-7ab0-46d8-bb59-bbb18efd47a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:11.684549 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231abfa4-7ab0-46d8-bb59-bbb18efd47a9 None admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:11.685042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231abfa4-7ab0-46d8-bb59-bbb18efd47a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:11.685571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231abfa4-7ab0-46d8-bb59-bbb18efd47a9 None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac/users/c5e23998f7014e808912f5d0ef57c711/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:11.689524 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231abfa4-7ab0-46d8-bb59-bbb18efd47a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec7d549ce6b14f7f8c85bf895eebadac, user_id=c5e23998f7014e808912f5d0ef57c711, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:11.692302 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231abfa4-7ab0-46d8-bb59-bbb18efd47a9 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:11.716177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 119/234] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:47:11 2022] PUT /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac/users/c5e23998f7014e808912f5d0ef57c711/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:47:12.178829 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1feea0-c504-4d4a-8c55-95947427ecbd None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:12.179356 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1feea0-c504-4d4a-8c55-95947427ecbd None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:12.179658 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1feea0-c504-4d4a-8c55-95947427ecbd None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:12.181483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 116/235] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:12.187501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41fd52-28e5-4291-98b2-9c00f9847d89 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:12.187697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8ea65-2c2a-4432-932f-240b401a59fc None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:12.187792 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41fd52-28e5-4291-98b2-9c00f9847d89 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:12.187863 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8ea65-2c2a-4432-932f-240b401a59fc None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:12.188045 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41fd52-28e5-4291-98b2-9c00f9847d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:12.188381 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8ea65-2c2a-4432-932f-240b401a59fc None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:12.189995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 120/236] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:12.195701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664681d-a29e-4bb0-a1a0-32f0c91afe89 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:12.196358 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664681d-a29e-4bb0-a1a0-32f0c91afe89 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:12.196708 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664681d-a29e-4bb0-a1a0-32f0c91afe89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:12.217569 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-9664681d-a29e-4bb0-a1a0-32f0c91afe89 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:12.218527 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-9664681d-a29e-4bb0-a1a0-32f0c91afe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:12.219294 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-3d41fd52-28e5-4291-98b2-9c00f9847d89 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:12.220489 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-3d41fd52-28e5-4291-98b2-9c00f9847d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:12.308220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 121/237] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:47:12.340940 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664681d-a29e-4bb0-a1a0-32f0c91afe89 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:12.379922 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 117/238] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:12.427667 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41fd52-28e5-4291-98b2-9c00f9847d89 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:12.447908 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664681d-a29e-4bb0-a1a0-32f0c91afe89 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:12.485704 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9715838-a2e4-49e9-a51e-1d2b9463d45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:12.486551 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9715838-a2e4-49e9-a51e-1d2b9463d45b None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:12.486826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9715838-a2e4-49e9-a51e-1d2b9463d45b None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:12.487091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9715838-a2e4-49e9-a51e-1d2b9463d45b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:12.488289 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9715838-a2e4-49e9-a51e-1d2b9463d45b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:12.489732 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9715838-a2e4-49e9-a51e-1d2b9463d45b None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:12.492055 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 122/239] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:12.497215 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9715838-a2e4-49e9-a51e-1d2b9463d45b None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:12.608677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9715838-a2e4-49e9-a51e-1d2b9463d45b None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:12.646941 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d49f3a-2a0d-40a6-a6a9-e08e4b858df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:12.647638 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d49f3a-2a0d-40a6-a6a9-e08e4b858df3 None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:12.647916 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d49f3a-2a0d-40a6-a6a9-e08e4b858df3 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:12.648186 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d49f3a-2a0d-40a6-a6a9-e08e4b858df3 None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:12.648914 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d49f3a-2a0d-40a6-a6a9-e08e4b858df3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:12.650476 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d49f3a-2a0d-40a6-a6a9-e08e4b858df3 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:12.674285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 123/240] 10.222.0.32 () {60 vars in 1132 bytes} [Tue May 10 13:47:12 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:47:12.710636 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41fd52-28e5-4291-98b2-9c00f9847d89 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:12.769777 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7170040-fda8-4bde-8135-d16fd0e62480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:12.770622 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7170040-fda8-4bde-8135-d16fd0e62480 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:12.770902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7170040-fda8-4bde-8135-d16fd0e62480 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:12.771175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7170040-fda8-4bde-8135-d16fd0e62480 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:12.788564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7170040-fda8-4bde-8135-d16fd0e62480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:12.797771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-d7170040-fda8-4bde-8135-d16fd0e62480 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:47:12.797771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:12.797771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:12.797771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:12.797771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:12.797771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:12.797771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:12.797771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:12.797771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:12.797771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:12.797771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:12.797771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:12.797771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:12.797771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:12.797771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:12.797771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:12.798755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:12.798755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:12.798755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:12.798755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:12.798755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:12.798755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:12.798755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:12.798755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:12.798755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:12.798755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:12.798755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:12.798755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:12.798755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:12.798755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:12.798755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:12.798755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:12.800207 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:12.800207 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:12.800207 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:12.800207 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:12.800207 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:12.800207 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:12.800207 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:12.800207 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:12.800207 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:12.800207 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:12.800207 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:47:12.800207 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:12.800207 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 118/241] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:12.807791 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d49f3a-2a0d-40a6-a6a9-e08e4b858df3 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:12.943658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d49f3a-2a0d-40a6-a6a9-e08e4b858df3 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:12.996233 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63814af5-10d3-492f-98ae-c09c3c9481f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:12.996835 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63814af5-10d3-492f-98ae-c09c3c9481f6 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:12.997123 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63814af5-10d3-492f-98ae-c09c3c9481f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:12.997402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63814af5-10d3-492f-98ae-c09c3c9481f6 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:12.998364 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63814af5-10d3-492f-98ae-c09c3c9481f6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:12.998920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63814af5-10d3-492f-98ae-c09c3c9481f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:13.000339 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63814af5-10d3-492f-98ae-c09c3c9481f6 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:13.009253 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 124/242] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:47:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:13.016551 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7170040-fda8-4bde-8135-d16fd0e62480 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:13.158534 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7170040-fda8-4bde-8135-d16fd0e62480 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:13.201710 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd862415-d444-48b3-aa89-29c37145b754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:13.203309 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd862415-d444-48b3-aa89-29c37145b754 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:13.203748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd862415-d444-48b3-aa89-29c37145b754 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:13.204168 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd862415-d444-48b3-aa89-29c37145b754 None admin] PATH_INFO: `/v3/users/fc20e27ea1e04b7e93b338db15ce86a5` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:13.226134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd862415-d444-48b3-aa89-29c37145b754 None admin] RBAC: Authorizing `identity:get_user(user_id=fc20e27ea1e04b7e93b338db15ce86a5)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:13.227890 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd862415-d444-48b3-aa89-29c37145b754 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:13.229826 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 119/243] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:47:13 2022] GET /identity/v3/users/fc20e27ea1e04b7e93b338db15ce86a5 => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:13.237281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63814af5-10d3-492f-98ae-c09c3c9481f6 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:13.310552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c123e-e735-4d80-95cd-5beec3401702 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:13.310747 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c123e-e735-4d80-95cd-5beec3401702 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:13.311199 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c123e-e735-4d80-95cd-5beec3401702 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:13.312632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 120/244] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:13.318560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f272e55-7b15-4310-9cab-658e0be003a9 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:13.318845 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f272e55-7b15-4310-9cab-658e0be003a9 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:13.319125 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f272e55-7b15-4310-9cab-658e0be003a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:13.348406 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-6f272e55-7b15-4310-9cab-658e0be003a9 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:13.349617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-6f272e55-7b15-4310-9cab-658e0be003a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:13.408973 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63814af5-10d3-492f-98ae-c09c3c9481f6 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:13.459373 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c703d1-700a-47f6-85d4-9043cbf396b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:13.460791 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c703d1-700a-47f6-85d4-9043cbf396b0 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:13.461256 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c703d1-700a-47f6-85d4-9043cbf396b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:13.461767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c703d1-700a-47f6-85d4-9043cbf396b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:13.462887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 121/245] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:47:13.487766 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f272e55-7b15-4310-9cab-658e0be003a9 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:13.565718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c703d1-700a-47f6-85d4-9043cbf396b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:13.570176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c703d1-700a-47f6-85d4-9043cbf396b0 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:13.616538 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f272e55-7b15-4310-9cab-658e0be003a9 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:13.668243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45289d-a2ba-4eea-b86a-65f013168b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:13.670410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45289d-a2ba-4eea-b86a-65f013168b95 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:13.671018 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45289d-a2ba-4eea-b86a-65f013168b95 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:13.672849 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45289d-a2ba-4eea-b86a-65f013168b95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:13.698721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45289d-a2ba-4eea-b86a-65f013168b95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:13.712186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-0f45289d-a2ba-4eea-b86a-65f013168b95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:13.712186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:13.712186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:13.712186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:13.712186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:13.712186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:13.712186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:13.712186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:13.712186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:13.712186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:13.712186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:13.712186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:13.712186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:13.712186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:13.712186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:13.712186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:13.713171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:13.713171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:13.713171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:13.713171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:13.713171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:13.713171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:13.713171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:13.713171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:13.713171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:13.713171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:13.713171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:13.713171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:13.713171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:13.713171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:13.713171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:13.713171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:13.713952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:13.713952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:13.713952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:13.713952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:13.713952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:13.713952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:13.713952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:13.713952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:13.713952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:13.713952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:13.713952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:13.713952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:13.715976 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 122/246] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:13.718672 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 125/247] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:13.732710 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45289d-a2ba-4eea-b86a-65f013168b95 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:13.733972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c703d1-700a-47f6-85d4-9043cbf396b0 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:14.007770 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45289d-a2ba-4eea-b86a-65f013168b95 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:14.011297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c703d1-700a-47f6-85d4-9043cbf396b0 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:14.075198 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe3ffc-7d41-42ad-b2c3-0b686fc5b6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:14.076114 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe3ffc-7d41-42ad-b2c3-0b686fc5b6e4 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:14.076399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe3ffc-7d41-42ad-b2c3-0b686fc5b6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:14.076668 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe3ffc-7d41-42ad-b2c3-0b686fc5b6e4 None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:14.078878 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe3ffc-7d41-42ad-b2c3-0b686fc5b6e4 None admin] RBAC: Authorizing `identity:get_project(project_id=ec7d549ce6b14f7f8c85bf895eebadac)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:14.080357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe3ffc-7d41-42ad-b2c3-0b686fc5b6e4 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:14.082353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 123/248] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:13 2022] GET /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac => generated 302 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:14.082837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ec538-cc8b-402e-b374-642ac2e05042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:14.083520 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ec538-cc8b-402e-b374-642ac2e05042 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:14.083795 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ec538-cc8b-402e-b374-642ac2e05042 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:14.084064 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ec538-cc8b-402e-b374-642ac2e05042 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:14.085028 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ec538-cc8b-402e-b374-642ac2e05042 None admin] RBAC: Adding query filter params (name=member) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:14.085330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ec538-cc8b-402e-b374-642ac2e05042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:14.086747 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ec538-cc8b-402e-b374-642ac2e05042 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:14.090233 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe3ffc-7d41-42ad-b2c3-0b686fc5b6e4 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:14.109512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 126/249] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:47:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:14.116177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ec538-cc8b-402e-b374-642ac2e05042 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:14.288648 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe3ffc-7d41-42ad-b2c3-0b686fc5b6e4 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:14.371003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670754f9-efde-4b81-a078-e752e0f512ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:14.372139 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670754f9-efde-4b81-a078-e752e0f512ff None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:14.372448 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670754f9-efde-4b81-a078-e752e0f512ff None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:14.372731 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670754f9-efde-4b81-a078-e752e0f512ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:14.374545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670754f9-efde-4b81-a078-e752e0f512ff None admin] RBAC: Adding query filter params (role.id=27bc06df3c7b4654b71935efdaca22aa, scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac, user.id=fc20e27ea1e04b7e93b338db15ce86a5) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:14.374869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670754f9-efde-4b81-a078-e752e0f512ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:14.376349 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670754f9-efde-4b81-a078-e752e0f512ff None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:14.377893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ec538-cc8b-402e-b374-642ac2e05042 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:14.382615 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 124/250] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:47:14 2022] GET /identity/v3/role_assignments?user.id=fc20e27ea1e04b7e93b338db15ce86a5&scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac&role.id=27bc06df3c7b4654b71935efdaca22aa => generated 259 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:14.438622 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f96ac2-f863-4685-93b9-4dcf661005d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:14.439531 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f96ac2-f863-4685-93b9-4dcf661005d4 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:14.439812 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f96ac2-f863-4685-93b9-4dcf661005d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:14.440081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f96ac2-f863-4685-93b9-4dcf661005d4 None admin] PATH_INFO: `/v3/users/cd4e76381bce489ca3b5eb092683ff5f` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:14.441358 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f96ac2-f863-4685-93b9-4dcf661005d4 None admin] RBAC: Authorizing `identity:get_user(user_id=cd4e76381bce489ca3b5eb092683ff5f)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:14.442902 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f96ac2-f863-4685-93b9-4dcf661005d4 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:14.444996 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 127/251] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:47:14 2022] GET /identity/v3/users/cd4e76381bce489ca3b5eb092683ff5f => generated 297 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:14.450597 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670754f9-efde-4b81-a078-e752e0f512ff None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:14.593426 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670754f9-efde-4b81-a078-e752e0f512ff None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:14.598965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b751ad-722e-4ef7-8e89-9b01f39fa227 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:14.599476 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b751ad-722e-4ef7-8e89-9b01f39fa227 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:14.599585 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b751ad-722e-4ef7-8e89-9b01f39fa227 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:14.600886 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 128/252] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:14.607027 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae801e6f-f582-404d-bfa3-d67590d5d6ad None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:14.607808 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae801e6f-f582-404d-bfa3-d67590d5d6ad None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:14.608283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae801e6f-f582-404d-bfa3-d67590d5d6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:14.626357 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-ae801e6f-f582-404d-bfa3-d67590d5d6ad None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:14.627907 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-ae801e6f-f582-404d-bfa3-d67590d5d6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:14.653258 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17dccd-5b8c-4564-980f-6656d244debc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:14.654140 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17dccd-5b8c-4564-980f-6656d244debc None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:14.654492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17dccd-5b8c-4564-980f-6656d244debc None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:14.654791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17dccd-5b8c-4564-980f-6656d244debc None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:14.656873 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17dccd-5b8c-4564-980f-6656d244debc None admin] RBAC: Authorizing `identity:get_project(project_id=ec7d549ce6b14f7f8c85bf895eebadac)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:14.658422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17dccd-5b8c-4564-980f-6656d244debc None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:14.664715 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 125/253] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:14 2022] GET /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:14.665884 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17dccd-5b8c-4564-980f-6656d244debc None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:14.734162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 129/254] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:47:14.777024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d4081-42ca-4bd8-8994-182d514e6c78 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:14.777941 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d4081-42ca-4bd8-8994-182d514e6c78 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:14.778691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d4081-42ca-4bd8-8994-182d514e6c78 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:14.782141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 130/255] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:14.788529 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f6931-b798-4747-af5b-0fde9807bf4f None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:14.789387 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f6931-b798-4747-af5b-0fde9807bf4f None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:14.789917 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f6931-b798-4747-af5b-0fde9807bf4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:14.814049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-a24f6931-b798-4747-af5b-0fde9807bf4f None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:14.816369 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a24f6931-b798-4747-af5b-0fde9807bf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:14.893115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17dccd-5b8c-4564-980f-6656d244debc None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:14.936509 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 131/256] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:14.937397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f6931-b798-4747-af5b-0fde9807bf4f None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:14.937597 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f269704-8533-4d6e-83e6-608d35efe670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:14.938541 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f269704-8533-4d6e-83e6-608d35efe670 None admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:14.938823 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f269704-8533-4d6e-83e6-608d35efe670 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:14.939096 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f269704-8533-4d6e-83e6-608d35efe670 None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac/users/cd4e76381bce489ca3b5eb092683ff5f/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:14.943695 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f269704-8533-4d6e-83e6-608d35efe670 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec7d549ce6b14f7f8c85bf895eebadac, user_id=cd4e76381bce489ca3b5eb092683ff5f, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:14.945158 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f269704-8533-4d6e-83e6-608d35efe670 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:14.969294 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 126/257] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:47:14 2022] PUT /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac/users/cd4e76381bce489ca3b5eb092683ff5f/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 13:47:14.995554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f269704-8533-4d6e-83e6-608d35efe670 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:15.113533 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f269704-8533-4d6e-83e6-608d35efe670 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:15.136950 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f6931-b798-4747-af5b-0fde9807bf4f None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:15.160344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4745c7-1040-4736-9a47-f266cc641978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:15.162287 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4745c7-1040-4736-9a47-f266cc641978 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:15.163408 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4745c7-1040-4736-9a47-f266cc641978 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:15.163834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4745c7-1040-4736-9a47-f266cc641978 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:15.189687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4745c7-1040-4736-9a47-f266cc641978 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:15.203811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-fe4745c7-1040-4736-9a47-f266cc641978 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:15.203811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:15.203811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:15.203811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:15.203811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:15.203811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:15.203811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:15.203811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:15.203811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:15.203811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:15.203811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:15.203811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:15.203811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:15.203811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:15.203811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:15.203811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:15.204952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:15.204952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:15.204952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:15.204952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:15.204952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:15.204952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:15.204952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:15.204952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:15.204952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:15.204952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:15.204952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:15.204952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:15.204952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:15.204952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:15.204952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:15.204952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:15.205973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:15.205973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:15.205973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:15.205973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:15.205973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:15.205973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:15.205973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:15.205973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:15.205973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:15.205973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:15.205973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:15.205973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:15.211660 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 127/258] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:47:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:15.219040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4745c7-1040-4736-9a47-f266cc641978 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:15.244184 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdee36c-8d28-41db-8175-3b4fb24d84fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:15.245228 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdee36c-8d28-41db-8175-3b4fb24d84fa None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:15.245516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdee36c-8d28-41db-8175-3b4fb24d84fa None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:15.245789 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdee36c-8d28-41db-8175-3b4fb24d84fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:15.269173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdee36c-8d28-41db-8175-3b4fb24d84fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:15.277510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-3bdee36c-8d28-41db-8175-3b4fb24d84fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:47:15.277510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:15.277510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:15.277510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:15.277510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:15.277510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:15.277510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:15.277510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:15.277510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:15.277510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:15.277510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:15.277510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:15.277510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:15.277510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:15.277510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:15.277510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:15.278504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:15.278504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:15.278504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:15.278504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:15.278504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:15.278504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:15.278504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:15.278504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:15.278504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:15.278504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:15.278504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:15.278504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:15.278504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:15.278504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:15.278504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:15.278504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:15.279986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:15.279986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:15.279986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:15.279986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:15.279986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:15.279986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:15.279986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:15.279986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:15.279986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:15.279986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:15.279986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:47:15.279986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:15.283751 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 132/259] 10.222.0.32 () {56 vars in 1114 bytes} [Tue May 10 13:47:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:15.294154 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdee36c-8d28-41db-8175-3b4fb24d84fa None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:15.448179 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdee36c-8d28-41db-8175-3b4fb24d84fa None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:15.487126 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4745c7-1040-4736-9a47-f266cc641978 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:15.499611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb594687-87c0-4a4d-aa50-9aa224cce79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:15.500556 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb594687-87c0-4a4d-aa50-9aa224cce79a None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:15.500973 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb594687-87c0-4a4d-aa50-9aa224cce79a None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:15.501387 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb594687-87c0-4a4d-aa50-9aa224cce79a None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:15.502326 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb594687-87c0-4a4d-aa50-9aa224cce79a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:15.505102 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb594687-87c0-4a4d-aa50-9aa224cce79a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:15.506870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb594687-87c0-4a4d-aa50-9aa224cce79a None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:15.532748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 133/260] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:47:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:15.538429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb594687-87c0-4a4d-aa50-9aa224cce79a None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:15.554073 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ea2b1-f2b9-4801-bab5-eb99f71e72fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:15.554887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ea2b1-f2b9-4801-bab5-eb99f71e72fc None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:15.555223 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ea2b1-f2b9-4801-bab5-eb99f71e72fc None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:15.555501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ea2b1-f2b9-4801-bab5-eb99f71e72fc None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:15.556377 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ea2b1-f2b9-4801-bab5-eb99f71e72fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:15.556681 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ea2b1-f2b9-4801-bab5-eb99f71e72fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:15.558082 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ea2b1-f2b9-4801-bab5-eb99f71e72fc None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:15.577564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 128/261] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:15.585508 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ea2b1-f2b9-4801-bab5-eb99f71e72fc None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:15.778148 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb594687-87c0-4a4d-aa50-9aa224cce79a None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:15.842961 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ea2b1-f2b9-4801-bab5-eb99f71e72fc None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:15.858741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5f31b-3a6c-49c6-a69b-c2fde621bf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:15.860942 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5f31b-3a6c-49c6-a69b-c2fde621bf3e None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:15.862594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5f31b-3a6c-49c6-a69b-c2fde621bf3e None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:15.863071 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5f31b-3a6c-49c6-a69b-c2fde621bf3e None admin] PATH_INFO: `/v3/users/c5e23998f7014e808912f5d0ef57c711` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:15.865168 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5f31b-3a6c-49c6-a69b-c2fde621bf3e None admin] RBAC: Authorizing `identity:get_user(user_id=c5e23998f7014e808912f5d0ef57c711)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:15.867066 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5f31b-3a6c-49c6-a69b-c2fde621bf3e None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:15.870416 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 134/262] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:47:15 2022] GET /identity/v3/users/c5e23998f7014e808912f5d0ef57c711 => generated 283 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:15.877790 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5f31b-3a6c-49c6-a69b-c2fde621bf3e None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:15.931654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321720e-6edb-4cad-ab44-e4f823af984c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:15.932953 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321720e-6edb-4cad-ab44-e4f823af984c None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:15.933471 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321720e-6edb-4cad-ab44-e4f823af984c None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:15.933954 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321720e-6edb-4cad-ab44-e4f823af984c None admin] PATH_INFO: `/v3/users/c5e23998f7014e808912f5d0ef57c711` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:15.939060 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321720e-6edb-4cad-ab44-e4f823af984c None admin] RBAC: Authorizing `identity:get_user(user_id=c5e23998f7014e808912f5d0ef57c711)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:15.940910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321720e-6edb-4cad-ab44-e4f823af984c None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:15.943293 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 129/263] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:47:15 2022] GET /identity/v3/users/c5e23998f7014e808912f5d0ef57c711 => generated 283 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:15.954361 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321720e-6edb-4cad-ab44-e4f823af984c None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:16.087160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5f31b-3a6c-49c6-a69b-c2fde621bf3e None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:16.135143 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098df6bb-d3af-45a6-968c-bd3a557a9708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:16.136163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098df6bb-d3af-45a6-968c-bd3a557a9708 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:16.136603 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098df6bb-d3af-45a6-968c-bd3a557a9708 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:16.137051 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098df6bb-d3af-45a6-968c-bd3a557a9708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:16.223178 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321720e-6edb-4cad-ab44-e4f823af984c None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:16.286719 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8922eac-f511-43de-b565-a309c7fa4dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:16.288362 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8922eac-f511-43de-b565-a309c7fa4dcf None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:16.289021 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8922eac-f511-43de-b565-a309c7fa4dcf None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:16.289591 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8922eac-f511-43de-b565-a309c7fa4dcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:16.311570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098df6bb-d3af-45a6-968c-bd3a557a9708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:16.313506 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098df6bb-d3af-45a6-968c-bd3a557a9708 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:16.386355 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8922eac-f511-43de-b565-a309c7fa4dcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:16.389136 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8922eac-f511-43de-b565-a309c7fa4dcf None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:16.520148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 130/264] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:16.523107 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142ba7c-d15c-4205-8d51-2d9d64c3afc4 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:16.523547 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142ba7c-d15c-4205-8d51-2d9d64c3afc4 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:16.523957 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142ba7c-d15c-4205-8d51-2d9d64c3afc4 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:16.525421 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 131/265] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:16.526320 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142ba7c-d15c-4205-8d51-2d9d64c3afc4 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:16.531251 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 135/266] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:16.534866 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b27a46-b518-443c-9448-6b8bd78af0b4 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:16.535361 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b27a46-b518-443c-9448-6b8bd78af0b4 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:16.536047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b27a46-b518-443c-9448-6b8bd78af0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:16.553163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-27b27a46-b518-443c-9448-6b8bd78af0b4 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:16.554681 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-27b27a46-b518-443c-9448-6b8bd78af0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:16.626869 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 136/267] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:47:16.628009 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b27a46-b518-443c-9448-6b8bd78af0b4 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:16.655822 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142ba7c-d15c-4205-8d51-2d9d64c3afc4 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:16.716505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f30487-9d28-4f81-9c64-40c4ed9ed002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:16.718932 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f30487-9d28-4f81-9c64-40c4ed9ed002 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:16.719414 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f30487-9d28-4f81-9c64-40c4ed9ed002 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:16.719866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f30487-9d28-4f81-9c64-40c4ed9ed002 None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:16.724049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f30487-9d28-4f81-9c64-40c4ed9ed002 None admin] RBAC: Authorizing `identity:get_project(project_id=ec7d549ce6b14f7f8c85bf895eebadac)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:16.725829 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f30487-9d28-4f81-9c64-40c4ed9ed002 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:16.729382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 132/268] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:16 2022] GET /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:16.734559 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f30487-9d28-4f81-9c64-40c4ed9ed002 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:16.840513 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b27a46-b518-443c-9448-6b8bd78af0b4 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:16.901066 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9d125-53f2-4e3f-8083-01d3c993b5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:16.901937 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9d125-53f2-4e3f-8083-01d3c993b5c9 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:16.902239 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9d125-53f2-4e3f-8083-01d3c993b5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:16.902506 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9d125-53f2-4e3f-8083-01d3c993b5c9 None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:16.904633 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9d125-53f2-4e3f-8083-01d3c993b5c9 None admin] RBAC: Authorizing `identity:get_project(project_id=ec7d549ce6b14f7f8c85bf895eebadac)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:16.906548 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9d125-53f2-4e3f-8083-01d3c993b5c9 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:16.908541 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 137/269] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:16 2022] GET /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:16.909584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9d125-53f2-4e3f-8083-01d3c993b5c9 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:16.933143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f30487-9d28-4f81-9c64-40c4ed9ed002 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:16.976554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7684ed-a4f1-41dc-a27a-83ed63b0086f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:16.977641 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7684ed-a4f1-41dc-a27a-83ed63b0086f None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:16.978150 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7684ed-a4f1-41dc-a27a-83ed63b0086f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:16.978630 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7684ed-a4f1-41dc-a27a-83ed63b0086f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:16.991108 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7684ed-a4f1-41dc-a27a-83ed63b0086f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:16.999869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-7d7684ed-a4f1-41dc-a27a-83ed63b0086f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:16.999869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:16.999869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:16.999869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:16.999869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:16.999869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:16.999869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:16.999869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:16.999869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:16.999869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:16.999869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:16.999869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:16.999869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:16.999869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:16.999869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:16.999869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:17.000785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:17.000785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:17.000785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:17.000785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:17.000785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:17.000785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:17.000785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:17.000785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:17.000785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:17.000785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:17.000785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:17.000785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:17.000785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:17.000785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:17.000785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:17.000785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:17.001560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:17.001560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:17.001560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:17.001560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:17.001560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:17.001560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:17.001560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:17.001560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:17.001560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:17.001560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:17.001560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:17.001560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:17.004047 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 133/270] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:17.005670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7bfad-690a-43a6-8929-f79198fe6624 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.006280 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7bfad-690a-43a6-8929-f79198fe6624 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.006773 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7bfad-690a-43a6-8929-f79198fe6624 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.008580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 134/271] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:17.009576 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7bfad-690a-43a6-8929-f79198fe6624 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:17.034941 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9d125-53f2-4e3f-8083-01d3c993b5c9 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:17.071998 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b44a57-77a8-4bbd-be9a-4ad5253a7dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:17.073019 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b44a57-77a8-4bbd-be9a-4ad5253a7dbc None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.073616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b44a57-77a8-4bbd-be9a-4ad5253a7dbc None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.074087 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b44a57-77a8-4bbd-be9a-4ad5253a7dbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.075296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b44a57-77a8-4bbd-be9a-4ad5253a7dbc None admin] RBAC: Adding query filter params (role.id=17e40821fc444dd0b040dcfce3eb222b, scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac, user.id=c5e23998f7014e808912f5d0ef57c711) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:17.075840 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b44a57-77a8-4bbd-be9a-4ad5253a7dbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:17.078439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b44a57-77a8-4bbd-be9a-4ad5253a7dbc None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:17.094407 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 138/272] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:47:16 2022] GET /identity/v3/role_assignments?user.id=c5e23998f7014e808912f5d0ef57c711&scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac&role.id=17e40821fc444dd0b040dcfce3eb222b => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:17.095845 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b44a57-77a8-4bbd-be9a-4ad5253a7dbc None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:17.158401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7bfad-690a-43a6-8929-f79198fe6624 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:17.222505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28721461-2794-4d0c-a7d5-21dadae11d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:17.223639 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28721461-2794-4d0c-a7d5-21dadae11d37 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.224155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28721461-2794-4d0c-a7d5-21dadae11d37 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.224690 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28721461-2794-4d0c-a7d5-21dadae11d37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.225764 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28721461-2794-4d0c-a7d5-21dadae11d37 None admin] RBAC: Adding query filter params (role.id=316da37136b4425f9ae486ae1e2bf4b4, scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac, user.id=c5e23998f7014e808912f5d0ef57c711) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:17.226366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28721461-2794-4d0c-a7d5-21dadae11d37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:17.228107 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28721461-2794-4d0c-a7d5-21dadae11d37 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:17.236788 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 135/273] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:47:17 2022] GET /identity/v3/role_assignments?user.id=c5e23998f7014e808912f5d0ef57c711&scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac&role.id=316da37136b4425f9ae486ae1e2bf4b4 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:17.242714 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d678f8-261c-4a01-841a-451fc7d9b043 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.243321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d678f8-261c-4a01-841a-451fc7d9b043 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.243799 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d678f8-261c-4a01-841a-451fc7d9b043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.273576 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-94d678f8-261c-4a01-841a-451fc7d9b043 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:17.275293 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-94d678f8-261c-4a01-841a-451fc7d9b043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:17.332643 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b44a57-77a8-4bbd-be9a-4ad5253a7dbc None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:17.396088 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 136/274] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:17.409054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985c68d-16b2-46cb-857f-45b21654bf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:17.410123 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985c68d-16b2-46cb-857f-45b21654bf9d None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.410642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985c68d-16b2-46cb-857f-45b21654bf9d None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.411115 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985c68d-16b2-46cb-857f-45b21654bf9d None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.412203 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985c68d-16b2-46cb-857f-45b21654bf9d None admin] RBAC: Adding query filter params (name=member) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:17.412775 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985c68d-16b2-46cb-857f-45b21654bf9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:17.414482 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985c68d-16b2-46cb-857f-45b21654bf9d None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:17.425577 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 139/275] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:47:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:17.431088 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d678f8-261c-4a01-841a-451fc7d9b043 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:17.444701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985c68d-16b2-46cb-857f-45b21654bf9d None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:17.594904 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d678f8-261c-4a01-841a-451fc7d9b043 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:17.633016 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de72fce-4fc4-4533-b21e-73b15840f3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:17.634281 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de72fce-4fc4-4533-b21e-73b15840f3dc None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.634789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de72fce-4fc4-4533-b21e-73b15840f3dc None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.635088 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985c68d-16b2-46cb-857f-45b21654bf9d None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:17.635492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de72fce-4fc4-4533-b21e-73b15840f3dc None admin] PATH_INFO: `/v3/users/3d3cb9ad866b46f2b7c424d672caff87` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.651789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de72fce-4fc4-4533-b21e-73b15840f3dc None admin] RBAC: Authorizing `identity:get_user(user_id=3d3cb9ad866b46f2b7c424d672caff87)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:17.653597 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de72fce-4fc4-4533-b21e-73b15840f3dc None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:17.656271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 137/276] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:47:17 2022] GET /identity/v3/users/3d3cb9ad866b46f2b7c424d672caff87 => generated 293 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:17.661552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de72fce-4fc4-4533-b21e-73b15840f3dc None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:17.680895 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecde50a-186c-4e62-a402-087fa18b4f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:17.681781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecde50a-186c-4e62-a402-087fa18b4f57 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.681960 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecde50a-186c-4e62-a402-087fa18b4f57 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.682244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecde50a-186c-4e62-a402-087fa18b4f57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.683413 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecde50a-186c-4e62-a402-087fa18b4f57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:17.684866 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecde50a-186c-4e62-a402-087fa18b4f57 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:17.687601 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 140/277] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:17.695224 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecde50a-186c-4e62-a402-087fa18b4f57 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:17.786685 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de72fce-4fc4-4533-b21e-73b15840f3dc None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:17.827145 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a57d5c-c936-4899-902b-be0964e75672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:17.827822 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a57d5c-c936-4899-902b-be0964e75672 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.828107 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a57d5c-c936-4899-902b-be0964e75672 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.828386 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a57d5c-c936-4899-902b-be0964e75672 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.829226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a57d5c-c936-4899-902b-be0964e75672 None admin] RBAC: Adding query filter params (role.id=34ef75b7c6d54c5e81edbfee2f4b362d, user.id=3d3cb9ad866b46f2b7c424d672caff87, scope.system=all) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:17.829540 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a57d5c-c936-4899-902b-be0964e75672 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:17.831055 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a57d5c-c936-4899-902b-be0964e75672 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:17.837671 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 138/278] 10.222.0.32 () {56 vars in 1308 bytes} [Tue May 10 13:47:17 2022] GET /identity/v3/role_assignments?user.id=3d3cb9ad866b46f2b7c424d672caff87&scope.system=all&role.id=34ef75b7c6d54c5e81edbfee2f4b362d => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:17.839273 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f38fb-321d-4f70-996d-cbfba217875b None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.839273 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f38fb-321d-4f70-996d-cbfba217875b None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.839554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f38fb-321d-4f70-996d-cbfba217875b None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.840761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 139/279] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:17.847884 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4573058-50eb-42b8-b860-2b5683f4c419 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.848194 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4573058-50eb-42b8-b860-2b5683f4c419 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.848440 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4573058-50eb-42b8-b860-2b5683f4c419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.858034 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecde50a-186c-4e62-a402-087fa18b4f57 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:17.871860 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-f4573058-50eb-42b8-b860-2b5683f4c419 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:17.874017 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f4573058-50eb-42b8-b860-2b5683f4c419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:17.905767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ca65f-85f0-4aa7-b88e-208f494c2ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:17.907458 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ca65f-85f0-4aa7-b88e-208f494c2ef9 None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.908162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ca65f-85f0-4aa7-b88e-208f494c2ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.908748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ca65f-85f0-4aa7-b88e-208f494c2ef9 None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.909885 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ca65f-85f0-4aa7-b88e-208f494c2ef9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:17.912601 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ca65f-85f0-4aa7-b88e-208f494c2ef9 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:17.940946 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 141/280] 10.222.0.32 () {60 vars in 1132 bytes} [Tue May 10 13:47:17 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:47:17.960808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 140/281] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:17.992973 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ca65f-85f0-4aa7-b88e-208f494c2ef9 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:18.116385 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ca65f-85f0-4aa7-b88e-208f494c2ef9 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:18.167718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26520daf-122c-435c-99c1-632eb51a3589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:18.168455 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26520daf-122c-435c-99c1-632eb51a3589 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:18.168738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26520daf-122c-435c-99c1-632eb51a3589 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:18.169013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26520daf-122c-435c-99c1-632eb51a3589 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:18.184560 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26520daf-122c-435c-99c1-632eb51a3589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:18.193141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-26520daf-122c-435c-99c1-632eb51a3589 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:47:18.193141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:18.193141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:18.193141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:18.193141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:18.193141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:18.193141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:18.193141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:18.193141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:18.193141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:18.193141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:18.193141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:18.193141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:18.193141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:18.193141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:18.193141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:18.194089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:18.194089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:18.194089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:18.194089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:18.194089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:18.194089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:18.194089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:18.194089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:18.194089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:18.194089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:18.194089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:18.194089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:18.194089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:18.194089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:18.194089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:18.194089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:18.194935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:18.194935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:18.194935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:18.194935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:18.194935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:18.194935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:18.194935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:18.194935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:18.194935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:18.194935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:18.194935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:47:18.194935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:18.196218 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 142/282] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:18.203367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4573058-50eb-42b8-b860-2b5683f4c419 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:18.328665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4573058-50eb-42b8-b860-2b5683f4c419 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:18.371934 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5631d-9ee6-4af9-a7e8-bb5ab2061dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:18.372624 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5631d-9ee6-4af9-a7e8-bb5ab2061dbd None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:18.372997 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5631d-9ee6-4af9-a7e8-bb5ab2061dbd None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:18.373277 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5631d-9ee6-4af9-a7e8-bb5ab2061dbd None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:18.374098 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5631d-9ee6-4af9-a7e8-bb5ab2061dbd None admin] RBAC: Adding query filter params (name=reader) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:18.374473 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5631d-9ee6-4af9-a7e8-bb5ab2061dbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:18.375884 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5631d-9ee6-4af9-a7e8-bb5ab2061dbd None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:18.386452 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 141/283] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:47:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:18.391930 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26520daf-122c-435c-99c1-632eb51a3589 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:18.394761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20d12b-785a-4790-91cf-921bfa93d79b None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:18.395051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20d12b-785a-4790-91cf-921bfa93d79b None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:18.395331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20d12b-785a-4790-91cf-921bfa93d79b None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:18.396862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 142/284] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:18.402132 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c462d-4753-4c97-b8fc-1a2d2eb69d01 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:18.402450 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c462d-4753-4c97-b8fc-1a2d2eb69d01 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:18.402731 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c462d-4753-4c97-b8fc-1a2d2eb69d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:18.425850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-5b7c462d-4753-4c97-b8fc-1a2d2eb69d01 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:18.426991 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-5b7c462d-4753-4c97-b8fc-1a2d2eb69d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:18.508729 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 143/285] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:47:18.520234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26520daf-122c-435c-99c1-632eb51a3589 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:18.541717 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c462d-4753-4c97-b8fc-1a2d2eb69d01 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:18.584320 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa2640-fdf1-446b-a138-5ac7b820a2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:18.585145 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa2640-fdf1-446b-a138-5ac7b820a2da None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:18.585424 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa2640-fdf1-446b-a138-5ac7b820a2da None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:18.585695 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa2640-fdf1-446b-a138-5ac7b820a2da None admin] PATH_INFO: `/v3/users/fc20e27ea1e04b7e93b338db15ce86a5` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:18.590957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa2640-fdf1-446b-a138-5ac7b820a2da None admin] RBAC: Authorizing `identity:get_user(user_id=fc20e27ea1e04b7e93b338db15ce86a5)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:18.592519 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa2640-fdf1-446b-a138-5ac7b820a2da None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:18.594504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 143/286] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:47:18 2022] GET /identity/v3/users/fc20e27ea1e04b7e93b338db15ce86a5 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:18.599519 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa2640-fdf1-446b-a138-5ac7b820a2da None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:18.677552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c462d-4753-4c97-b8fc-1a2d2eb69d01 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:18.724596 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f134854-aa33-4d46-9b40-85951d2c6f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:18.726020 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f134854-aa33-4d46-9b40-85951d2c6f4c None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:18.726624 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f134854-aa33-4d46-9b40-85951d2c6f4c None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:18.727096 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f134854-aa33-4d46-9b40-85951d2c6f4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:18.751526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f134854-aa33-4d46-9b40-85951d2c6f4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:18.760811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-3f134854-aa33-4d46-9b40-85951d2c6f4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:18.760811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:18.760811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:18.760811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:18.760811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:18.760811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:18.760811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:18.760811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:18.760811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:18.760811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:18.760811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:18.760811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:18.760811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:18.760811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:18.760811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:18.760811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:18.761727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:18.761727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:18.761727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:18.761727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:18.761727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:18.761727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:18.761727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:18.761727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:18.761727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:18.761727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:18.761727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:18.761727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:18.761727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:18.761727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:18.761727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:18.761727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:18.762609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:18.762609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:18.762609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:18.762609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:18.762609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:18.762609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:18.762609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:18.762609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:18.762609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:18.762609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:18.762609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:18.762609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:18.774273 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 144/287] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:18.800256 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f134854-aa33-4d46-9b40-85951d2c6f4c None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:18.846133 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa2640-fdf1-446b-a138-5ac7b820a2da None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:18.924934 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a39722-5f5d-42e7-b0dd-36f9c4903317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:18.925566 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f134854-aa33-4d46-9b40-85951d2c6f4c None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:18.926728 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a39722-5f5d-42e7-b0dd-36f9c4903317 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:18.927220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a39722-5f5d-42e7-b0dd-36f9c4903317 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:18.927746 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a39722-5f5d-42e7-b0dd-36f9c4903317 None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:18.929135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a39722-5f5d-42e7-b0dd-36f9c4903317 None admin] RBAC: Authorizing `identity:get_project(project_id=ec7d549ce6b14f7f8c85bf895eebadac)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:18.930907 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a39722-5f5d-42e7-b0dd-36f9c4903317 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:18.933311 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 144/288] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:18 2022] GET /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac => generated 302 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:18.938951 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a39722-5f5d-42e7-b0dd-36f9c4903317 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:18.969507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2843ef-4b09-496a-87cf-a8c8576447ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:18.970597 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2843ef-4b09-496a-87cf-a8c8576447ff None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:18.971100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2843ef-4b09-496a-87cf-a8c8576447ff None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:18.972347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2843ef-4b09-496a-87cf-a8c8576447ff None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:18.973342 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2843ef-4b09-496a-87cf-a8c8576447ff None admin] RBAC: Adding query filter params (name=member) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:18.974004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2843ef-4b09-496a-87cf-a8c8576447ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:18.977387 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2843ef-4b09-496a-87cf-a8c8576447ff None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:18.994176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 145/289] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:47:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:18.998934 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2843ef-4b09-496a-87cf-a8c8576447ff None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:19.117580 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a39722-5f5d-42e7-b0dd-36f9c4903317 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:19.172093 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fceb4-0a37-405e-b6f0-818c0a3ffeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:19.173344 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fceb4-0a37-405e-b6f0-818c0a3ffeba None admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:19.173838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fceb4-0a37-405e-b6f0-818c0a3ffeba None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:19.174359 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fceb4-0a37-405e-b6f0-818c0a3ffeba None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac/users/fc20e27ea1e04b7e93b338db15ce86a5/roles/27bc06df3c7b4654b71935efdaca22aa` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:19.177133 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fceb4-0a37-405e-b6f0-818c0a3ffeba None admin] RBAC: Authorizing `identity:create_grant(project_id=ec7d549ce6b14f7f8c85bf895eebadac, user_id=fc20e27ea1e04b7e93b338db15ce86a5, role_id=27bc06df3c7b4654b71935efdaca22aa)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:19.179443 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fceb4-0a37-405e-b6f0-818c0a3ffeba None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:19.185038 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2843ef-4b09-496a-87cf-a8c8576447ff None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:19.197070 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 145/290] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:47:18 2022] PUT /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac/users/fc20e27ea1e04b7e93b338db15ce86a5/roles/27bc06df3c7b4654b71935efdaca22aa => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 13:47:19.247231 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23fce0-f931-4697-9b10-ea2a4067de3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:19.248249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23fce0-f931-4697-9b10-ea2a4067de3a None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:19.248535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23fce0-f931-4697-9b10-ea2a4067de3a None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:19.248817 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23fce0-f931-4697-9b10-ea2a4067de3a None admin] PATH_INFO: `/v3/users/cd4e76381bce489ca3b5eb092683ff5f` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:19.250049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23fce0-f931-4697-9b10-ea2a4067de3a None admin] RBAC: Authorizing `identity:get_user(user_id=cd4e76381bce489ca3b5eb092683ff5f)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:19.251526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23fce0-f931-4697-9b10-ea2a4067de3a None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:19.262819 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 146/291] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:47:18 2022] GET /identity/v3/users/cd4e76381bce489ca3b5eb092683ff5f => generated 297 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:19.268863 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fceb4-0a37-405e-b6f0-818c0a3ffeba None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:19.457456 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fceb4-0a37-405e-b6f0-818c0a3ffeba None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:19.497683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b01176-dac4-4c29-b96a-717c6102d3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:19.498720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b01176-dac4-4c29-b96a-717c6102d3da None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:19.499052 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b01176-dac4-4c29-b96a-717c6102d3da None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:19.499404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b01176-dac4-4c29-b96a-717c6102d3da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:19.582657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b01176-dac4-4c29-b96a-717c6102d3da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:19.584140 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b01176-dac4-4c29-b96a-717c6102d3da None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:19.709143 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 146/292] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:19.714297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23fce0-f931-4697-9b10-ea2a4067de3a None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:19.893505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23fce0-f931-4697-9b10-ea2a4067de3a None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:19.931782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb83c4f-6f30-4649-8f81-1ecd96ca9441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:19.933030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb83c4f-6f30-4649-8f81-1ecd96ca9441 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:19.933512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb83c4f-6f30-4649-8f81-1ecd96ca9441 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:19.933984 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb83c4f-6f30-4649-8f81-1ecd96ca9441 None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:19.936002 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb83c4f-6f30-4649-8f81-1ecd96ca9441 None admin] RBAC: Authorizing `identity:get_project(project_id=ec7d549ce6b14f7f8c85bf895eebadac)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:19.937747 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb83c4f-6f30-4649-8f81-1ecd96ca9441 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:19.939754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 147/293] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:19 2022] GET /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:19.945480 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b01176-dac4-4c29-b96a-717c6102d3da None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:20.123978 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b01176-dac4-4c29-b96a-717c6102d3da None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:20.173867 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e7779-a6cd-4da1-be3f-5b5f37c25776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:20.174560 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e7779-a6cd-4da1-be3f-5b5f37c25776 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:20.174840 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e7779-a6cd-4da1-be3f-5b5f37c25776 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:20.175113 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e7779-a6cd-4da1-be3f-5b5f37c25776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:20.175953 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e7779-a6cd-4da1-be3f-5b5f37c25776 None admin] RBAC: Adding query filter params (role.id=34ef75b7c6d54c5e81edbfee2f4b362d, scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac, user.id=cd4e76381bce489ca3b5eb092683ff5f) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:20.176261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e7779-a6cd-4da1-be3f-5b5f37c25776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:20.177711 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e7779-a6cd-4da1-be3f-5b5f37c25776 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:20.184544 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 147/294] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:47:19 2022] GET /identity/v3/role_assignments?user.id=cd4e76381bce489ca3b5eb092683ff5f&scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac&role.id=34ef75b7c6d54c5e81edbfee2f4b362d => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:20.648481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b2b55-4fd7-446e-9cb7-751d2b3e1be1 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:20.648858 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b2b55-4fd7-446e-9cb7-751d2b3e1be1 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:20.649036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b2b55-4fd7-446e-9cb7-751d2b3e1be1 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:20.650753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 148/295] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:20.656665 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa9fcf-a491-4a78-abe1-68f9cc60ff7a None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:20.657261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa9fcf-a491-4a78-abe1-68f9cc60ff7a None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:20.657734 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa9fcf-a491-4a78-abe1-68f9cc60ff7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:20.675297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-faaa9fcf-a491-4a78-abe1-68f9cc60ff7a None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:20.676839 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-faaa9fcf-a491-4a78-abe1-68f9cc60ff7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:20.753647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 148/296] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:20.776380 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b2b55-4fd7-446e-9cb7-751d2b3e1be1 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:20.860946 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefd5d6-ecc0-4db0-bb46-4af6365a099d None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:20.861288 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefd5d6-ecc0-4db0-bb46-4af6365a099d None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:20.861504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefd5d6-ecc0-4db0-bb46-4af6365a099d None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:20.863501 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 149/297] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:20.880965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1b9bb-a87c-4812-aaa1-01ba92070013 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:20.881897 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1b9bb-a87c-4812-aaa1-01ba92070013 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:20.882681 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1b9bb-a87c-4812-aaa1-01ba92070013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:20.907558 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-40c1b9bb-a87c-4812-aaa1-01ba92070013 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:20.909295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-40c1b9bb-a87c-4812-aaa1-01ba92070013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:20.942837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b2b55-4fd7-446e-9cb7-751d2b3e1be1 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:20.998662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 150/298] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:21.009726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607cce8-1850-4fe4-8721-a9707cd33336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:21.011098 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607cce8-1850-4fe4-8721-a9707cd33336 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:21.011627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607cce8-1850-4fe4-8721-a9707cd33336 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:21.012135 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607cce8-1850-4fe4-8721-a9707cd33336 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:21.024617 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b6759-762d-4ddb-a4f2-b650b0988d53 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:21.024808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607cce8-1850-4fe4-8721-a9707cd33336 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:21.024915 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b6759-762d-4ddb-a4f2-b650b0988d53 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:21.025171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b6759-762d-4ddb-a4f2-b650b0988d53 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:21.026739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 151/299] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:21.031912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b6759-762d-4ddb-a4f2-b650b0988d53 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:21.033226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-f607cce8-1850-4fe4-8721-a9707cd33336 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:21.033226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:21.033226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:21.033226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:21.033226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:21.033226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:21.033226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:21.033226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:21.033226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:21.033226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:21.033226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:21.033226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:21.033226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:21.033226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:21.033226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:21.033226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:21.035064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:21.035064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:21.035064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:21.035064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:21.035064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:21.035064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:21.035064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:21.035064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:21.035064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:21.035064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:21.035064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:21.035064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:21.035064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:21.035064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:21.035064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:21.035064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:21.036689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:21.036689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:21.036689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:21.036689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:21.036689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:21.036689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:21.036689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:21.036689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:21.036689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:21.036689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:21.036689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:21.036689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:21.036689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 149/300] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:21.036689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a88e9e-d410-4d22-8d41-357d4f87cc00 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:21.037866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a88e9e-d410-4d22-8d41-357d4f87cc00 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:21.037866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a88e9e-d410-4d22-8d41-357d4f87cc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:21.058398 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-60a88e9e-d410-4d22-8d41-357d4f87cc00 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:21.059588 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-60a88e9e-d410-4d22-8d41-357d4f87cc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:21.149687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 150/301] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:21.149687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a88e9e-d410-4d22-8d41-357d4f87cc00 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:21.158077 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b6759-762d-4ddb-a4f2-b650b0988d53 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:21.199726 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be8a8b-e84d-4641-9065-3f20d33e8ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:21.200534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be8a8b-e84d-4641-9065-3f20d33e8ed9 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:21.200818 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be8a8b-e84d-4641-9065-3f20d33e8ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:21.200818 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be8a8b-e84d-4641-9065-3f20d33e8ed9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:21.212212 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be8a8b-e84d-4641-9065-3f20d33e8ed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:21.220764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-53be8a8b-e84d-4641-9065-3f20d33e8ed9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:47:21.220764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:21.220764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:21.220764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:21.220764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:21.220764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:21.220764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:21.220764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:21.220764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:21.220764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:21.220764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:21.220764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:21.220764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:21.220764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:21.220764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:21.220764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:21.222568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:21.222568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:21.222568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:21.222568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:21.222568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:21.222568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:21.222568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:21.222568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:21.222568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:21.222568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:21.222568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:21.222568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:21.222568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:21.222568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:21.222568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:21.222568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:21.224306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:21.224306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:21.224306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:21.224306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:21.224306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:21.224306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:21.224306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:21.224306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:21.224306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:21.224306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:21.224306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:47:21.224306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:21.224306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 152/302] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:21.224306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be8a8b-e84d-4641-9065-3f20d33e8ed9 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:21.273821 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a88e9e-d410-4d22-8d41-357d4f87cc00 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:21.318788 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed451ae8-7c05-4b40-86f0-50af2dfbc322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:21.319482 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed451ae8-7c05-4b40-86f0-50af2dfbc322 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:21.319760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed451ae8-7c05-4b40-86f0-50af2dfbc322 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:21.320041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed451ae8-7c05-4b40-86f0-50af2dfbc322 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:21.320808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed451ae8-7c05-4b40-86f0-50af2dfbc322 None admin] RBAC: Adding query filter params (name=member) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:21.321137 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed451ae8-7c05-4b40-86f0-50af2dfbc322 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:21.322590 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed451ae8-7c05-4b40-86f0-50af2dfbc322 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:21.332017 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 151/303] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:47:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:21.332894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed451ae8-7c05-4b40-86f0-50af2dfbc322 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:21.360072 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be8a8b-e84d-4641-9065-3f20d33e8ed9 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:21.404535 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e11d5d-ede8-4a59-822d-1bb32ca9a4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:21.405954 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e11d5d-ede8-4a59-822d-1bb32ca9a4bc None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:21.406486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e11d5d-ede8-4a59-822d-1bb32ca9a4bc None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:21.406957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e11d5d-ede8-4a59-822d-1bb32ca9a4bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:21.408838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e11d5d-ede8-4a59-822d-1bb32ca9a4bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:21.411641 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e11d5d-ede8-4a59-822d-1bb32ca9a4bc None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:21.414981 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 153/304] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:21.416263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e11d5d-ede8-4a59-822d-1bb32ca9a4bc None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:21.465155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed451ae8-7c05-4b40-86f0-50af2dfbc322 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:21.504004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8abcb-23e5-4df6-b941-e3222bdd2ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:21.504686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8abcb-23e5-4df6-b941-e3222bdd2ee7 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:21.504969 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8abcb-23e5-4df6-b941-e3222bdd2ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:21.505243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8abcb-23e5-4df6-b941-e3222bdd2ee7 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:21.506006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8abcb-23e5-4df6-b941-e3222bdd2ee7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:21.506355 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8abcb-23e5-4df6-b941-e3222bdd2ee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:21.507745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8abcb-23e5-4df6-b941-e3222bdd2ee7 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:21.521546 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 152/305] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:47:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:21.521546 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8abcb-23e5-4df6-b941-e3222bdd2ee7 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:21.563072 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e11d5d-ede8-4a59-822d-1bb32ca9a4bc None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:21.613931 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c94393-21aa-46dc-b6be-7771e58f4249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:21.614860 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c94393-21aa-46dc-b6be-7771e58f4249 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:21.615139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c94393-21aa-46dc-b6be-7771e58f4249 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:21.615411 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c94393-21aa-46dc-b6be-7771e58f4249 None admin] PATH_INFO: `/v3/users/3d3cb9ad866b46f2b7c424d672caff87` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:21.616677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c94393-21aa-46dc-b6be-7771e58f4249 None admin] RBAC: Authorizing `identity:get_user(user_id=3d3cb9ad866b46f2b7c424d672caff87)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:21.618153 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c94393-21aa-46dc-b6be-7771e58f4249 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:21.619864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 154/306] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:47:21 2022] GET /identity/v3/users/3d3cb9ad866b46f2b7c424d672caff87 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:21.620653 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c94393-21aa-46dc-b6be-7771e58f4249 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:21.636994 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8abcb-23e5-4df6-b941-e3222bdd2ee7 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:21.675470 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fefc06-9da3-4907-ac84-220883aafec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:21.676088 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fefc06-9da3-4907-ac84-220883aafec4 None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:21.676374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fefc06-9da3-4907-ac84-220883aafec4 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:21.676715 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fefc06-9da3-4907-ac84-220883aafec4 None admin] PATH_INFO: `/v3/groups` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:21.677418 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fefc06-9da3-4907-ac84-220883aafec4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:21.678982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fefc06-9da3-4907-ac84-220883aafec4 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:21.706282 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 153/307] 10.222.0.32 () {60 vars in 1134 bytes} [Tue May 10 13:47:21 2022] POST /identity/v3/groups => generated 229 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:47:21.707330 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fefc06-9da3-4907-ac84-220883aafec4 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:21.747054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c94393-21aa-46dc-b6be-7771e58f4249 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:21.788411 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de53cae-25ea-4a5b-a1f9-607778fd8374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:21.789797 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de53cae-25ea-4a5b-a1f9-607778fd8374 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:21.790388 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de53cae-25ea-4a5b-a1f9-607778fd8374 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:21.790915 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de53cae-25ea-4a5b-a1f9-607778fd8374 None admin] PATH_INFO: `/v3/users/41c3d8ea83bc4713ae8487b16de2a8fd` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:21.808392 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de53cae-25ea-4a5b-a1f9-607778fd8374 None admin] RBAC: Authorizing `identity:get_user(user_id=41c3d8ea83bc4713ae8487b16de2a8fd)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:21.810574 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de53cae-25ea-4a5b-a1f9-607778fd8374 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:21.812766 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 155/308] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:47:21 2022] GET /identity/v3/users/41c3d8ea83bc4713ae8487b16de2a8fd => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:21.819258 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de53cae-25ea-4a5b-a1f9-607778fd8374 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:21.839903 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fefc06-9da3-4907-ac84-220883aafec4 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:21.893752 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895ae91-2225-4039-84d0-f07d99493505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:21.894774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895ae91-2225-4039-84d0-f07d99493505 None admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:21.895064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895ae91-2225-4039-84d0-f07d99493505 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:21.895350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895ae91-2225-4039-84d0-f07d99493505 None admin] PATH_INFO: `/v3/system/users/3d3cb9ad866b46f2b7c424d672caff87/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:21.897734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895ae91-2225-4039-84d0-f07d99493505 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3d3cb9ad866b46f2b7c424d672caff87, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:21.899842 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895ae91-2225-4039-84d0-f07d99493505 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:21.917634 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 154/309] 10.222.0.32 () {58 vars in 1334 bytes} [Tue May 10 13:47:21 2022] PUT /identity/v3/system/users/3d3cb9ad866b46f2b7c424d672caff87/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:47:21.957969 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de53cae-25ea-4a5b-a1f9-607778fd8374 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:21.994799 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b018b54-d26a-43fc-8169-114ff0ce3a9d None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:21.995356 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b018b54-d26a-43fc-8169-114ff0ce3a9d None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:21.995863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b018b54-d26a-43fc-8169-114ff0ce3a9d None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:21.999092 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 155/310] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:21.999773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31771531-2cd0-49f3-b203-39e796578c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:22.000527 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31771531-2cd0-49f3-b203-39e796578c4b None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:22.000810 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31771531-2cd0-49f3-b203-39e796578c4b None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:22.001085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31771531-2cd0-49f3-b203-39e796578c4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:22.001997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31771531-2cd0-49f3-b203-39e796578c4b None admin] RBAC: Adding query filter params (role.id=27bc06df3c7b4654b71935efdaca22aa, user.id=41c3d8ea83bc4713ae8487b16de2a8fd, scope.system=all) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:22.002404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31771531-2cd0-49f3-b203-39e796578c4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:22.003981 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31771531-2cd0-49f3-b203-39e796578c4b None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:22.010121 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 156/311] 10.222.0.32 () {56 vars in 1308 bytes} [Tue May 10 13:47:21 2022] GET /identity/v3/role_assignments?user.id=41c3d8ea83bc4713ae8487b16de2a8fd&scope.system=all&role.id=27bc06df3c7b4654b71935efdaca22aa => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:22.012899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d641c8-d2ae-4d38-a73d-4d0ca96616f1 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:22.013477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d641c8-d2ae-4d38-a73d-4d0ca96616f1 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:22.014516 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d641c8-d2ae-4d38-a73d-4d0ca96616f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:22.043946 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-43d641c8-d2ae-4d38-a73d-4d0ca96616f1 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:22.047472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-43d641c8-d2ae-4d38-a73d-4d0ca96616f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:22.168557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 156/312] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:22.194253 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31771531-2cd0-49f3-b203-39e796578c4b None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:22.310169 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31771531-2cd0-49f3-b203-39e796578c4b None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:22.347805 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c91537-f8e7-46e0-aeea-6b170dbf9d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:22.348608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c91537-f8e7-46e0-aeea-6b170dbf9d9d None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:22.348891 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c91537-f8e7-46e0-aeea-6b170dbf9d9d None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:22.349165 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c91537-f8e7-46e0-aeea-6b170dbf9d9d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:22.360340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c91537-f8e7-46e0-aeea-6b170dbf9d9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:22.368321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-53c91537-f8e7-46e0-aeea-6b170dbf9d9d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:47:22.368321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:22.368321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:22.368321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:22.368321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:22.368321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:22.368321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:22.368321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:22.368321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:22.368321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:22.368321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:22.368321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:22.368321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:22.368321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:22.368321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:22.368321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:22.369236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:22.369236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:22.369236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:22.369236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:22.369236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:22.369236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:22.369236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:22.369236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:22.369236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:22.369236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:22.369236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:22.369236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:22.369236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:22.369236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:22.369236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:22.369236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:22.370013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:22.370013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:22.370013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:22.370013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:22.370013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:22.370013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:22.370013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:22.370013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:22.370013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:22.370013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:22.370013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:47:22.370013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:22.370013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 157/313] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:22.377498 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d641c8-d2ae-4d38-a73d-4d0ca96616f1 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:22.485447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d641c8-d2ae-4d38-a73d-4d0ca96616f1 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:22.530190 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865e863-741d-4836-9a89-eeaa5307ce57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:22.531305 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865e863-741d-4836-9a89-eeaa5307ce57 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:22.531783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865e863-741d-4836-9a89-eeaa5307ce57 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:22.532249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865e863-741d-4836-9a89-eeaa5307ce57 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:22.533237 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865e863-741d-4836-9a89-eeaa5307ce57 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:22.533755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865e863-741d-4836-9a89-eeaa5307ce57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:22.535385 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865e863-741d-4836-9a89-eeaa5307ce57 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:22.545258 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 157/314] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:47:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:22.555320 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c91537-f8e7-46e0-aeea-6b170dbf9d9d None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:22.664923 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c91537-f8e7-46e0-aeea-6b170dbf9d9d None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:22.699646 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2f4e5-9ca7-4b41-89b3-304de885c8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:22.700938 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2f4e5-9ca7-4b41-89b3-304de885c8cf None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:22.701487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2f4e5-9ca7-4b41-89b3-304de885c8cf None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:22.701975 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2f4e5-9ca7-4b41-89b3-304de885c8cf None admin] PATH_INFO: `/v3/users/fc20e27ea1e04b7e93b338db15ce86a5` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:22.703430 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2f4e5-9ca7-4b41-89b3-304de885c8cf None admin] RBAC: Authorizing `identity:get_user(user_id=fc20e27ea1e04b7e93b338db15ce86a5)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:22.705205 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2f4e5-9ca7-4b41-89b3-304de885c8cf None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:22.707360 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 158/315] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:47:22 2022] GET /identity/v3/users/fc20e27ea1e04b7e93b338db15ce86a5 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:22.713014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865e863-741d-4836-9a89-eeaa5307ce57 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:22.818481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865e863-741d-4836-9a89-eeaa5307ce57 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:22.858943 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2a299-8bb1-4205-8398-fa10631924a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:22.859621 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2a299-8bb1-4205-8398-fa10631924a2 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:22.859910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2a299-8bb1-4205-8398-fa10631924a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:22.860190 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2a299-8bb1-4205-8398-fa10631924a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:22.932949 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2a299-8bb1-4205-8398-fa10631924a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:22.934825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2a299-8bb1-4205-8398-fa10631924a2 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:23.038664 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 158/316] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:23.050222 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2f4e5-9ca7-4b41-89b3-304de885c8cf None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:23.154524 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2f4e5-9ca7-4b41-89b3-304de885c8cf None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:23.196466 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38198ac6-41ca-4fb9-9224-a31b065ae3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:23.197255 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38198ac6-41ca-4fb9-9224-a31b065ae3a5 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:23.197535 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38198ac6-41ca-4fb9-9224-a31b065ae3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:23.197805 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38198ac6-41ca-4fb9-9224-a31b065ae3a5 None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:23.199045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38198ac6-41ca-4fb9-9224-a31b065ae3a5 None admin] RBAC: Authorizing `identity:get_project(project_id=ec7d549ce6b14f7f8c85bf895eebadac)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:23.200492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38198ac6-41ca-4fb9-9224-a31b065ae3a5 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:23.202559 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 159/317] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:23 2022] GET /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:23.208043 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2a299-8bb1-4205-8398-fa10631924a2 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:23.320475 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2a299-8bb1-4205-8398-fa10631924a2 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:23.356891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ce4e4-53a7-43f6-9c12-208ce8c4e5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:23.358833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ce4e4-53a7-43f6-9c12-208ce8c4e5b0 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:23.359326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ce4e4-53a7-43f6-9c12-208ce8c4e5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:23.359817 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ce4e4-53a7-43f6-9c12-208ce8c4e5b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:23.360846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ce4e4-53a7-43f6-9c12-208ce8c4e5b0 None admin] RBAC: Adding query filter params (role.id=27bc06df3c7b4654b71935efdaca22aa, scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac, user.id=fc20e27ea1e04b7e93b338db15ce86a5) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:23.361357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ce4e4-53a7-43f6-9c12-208ce8c4e5b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:23.363032 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ce4e4-53a7-43f6-9c12-208ce8c4e5b0 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:23.369458 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 159/318] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:47:23 2022] GET /identity/v3/role_assignments?user.id=fc20e27ea1e04b7e93b338db15ce86a5&scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac&role.id=27bc06df3c7b4654b71935efdaca22aa => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:24.224202 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bae7b-6528-4c00-aaae-2a5d3c24a68f None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:24.224684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bae7b-6528-4c00-aaae-2a5d3c24a68f None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:24.224684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bae7b-6528-4c00-aaae-2a5d3c24a68f None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:24.226180 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 160/319] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:24.231843 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177f0fa-e43b-4361-9785-d65e81174e86 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:24.232334 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177f0fa-e43b-4361-9785-d65e81174e86 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:24.232408 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177f0fa-e43b-4361-9785-d65e81174e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:24.250025 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-a177f0fa-e43b-4361-9785-d65e81174e86 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:24.251282 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-a177f0fa-e43b-4361-9785-d65e81174e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:24.316127 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93699d-cba8-45d7-acc0-5d3ccf82eb9f None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:24.316419 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93699d-cba8-45d7-acc0-5d3ccf82eb9f None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:24.316696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93699d-cba8-45d7-acc0-5d3ccf82eb9f None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:24.318272 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 161/320] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:24.323501 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075c0df-ca40-452f-b25f-ad95da8952ff None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:24.323789 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075c0df-ca40-452f-b25f-ad95da8952ff None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:24.324098 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075c0df-ca40-452f-b25f-ad95da8952ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:24.330695 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 160/321] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:24.342563 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-7075c0df-ca40-452f-b25f-ad95da8952ff None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:24.343760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-7075c0df-ca40-452f-b25f-ad95da8952ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:24.353802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177f0fa-e43b-4361-9785-d65e81174e86 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:24.424861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 162/322] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:47:24.427313 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa72437-125d-4833-a42e-714d17a67eb6 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:24.427779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa72437-125d-4833-a42e-714d17a67eb6 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:24.428230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa72437-125d-4833-a42e-714d17a67eb6 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:24.434473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 163/323] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:24.436448 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984b389-7d33-4dc8-ab9b-8d56674c575b None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:24.436751 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984b389-7d33-4dc8-ab9b-8d56674c575b None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:24.437362 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984b389-7d33-4dc8-ab9b-8d56674c575b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:24.455510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-b984b389-7d33-4dc8-ab9b-8d56674c575b None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:24.456699 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b984b389-7d33-4dc8-ab9b-8d56674c575b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:24.460058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177f0fa-e43b-4361-9785-d65e81174e86 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:24.498512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177c1b0-e832-4512-9f6f-a0208a88b382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:24.499715 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177c1b0-e832-4512-9f6f-a0208a88b382 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:24.500148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177c1b0-e832-4512-9f6f-a0208a88b382 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:24.500601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177c1b0-e832-4512-9f6f-a0208a88b382 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:24.502539 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177c1b0-e832-4512-9f6f-a0208a88b382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:24.505000 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177c1b0-e832-4512-9f6f-a0208a88b382 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:24.512230 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 161/324] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:24.512230 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177c1b0-e832-4512-9f6f-a0208a88b382 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:24.525304 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 164/325] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:24.526285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984b389-7d33-4dc8-ab9b-8d56674c575b None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:24.629665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177c1b0-e832-4512-9f6f-a0208a88b382 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:24.642326 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984b389-7d33-4dc8-ab9b-8d56674c575b None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:24.665258 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bac623-cf35-4fec-bc02-f8e30e840b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:24.666062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bac623-cf35-4fec-bc02-f8e30e840b19 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:24.666384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bac623-cf35-4fec-bc02-f8e30e840b19 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:24.666662 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bac623-cf35-4fec-bc02-f8e30e840b19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:24.678139 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bac623-cf35-4fec-bc02-f8e30e840b19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:24.679332 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e537fe-1757-4601-ad9f-f5fe3a0a7855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:24.680176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e537fe-1757-4601-ad9f-f5fe3a0a7855 None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:24.680481 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e537fe-1757-4601-ad9f-f5fe3a0a7855 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:24.680971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e537fe-1757-4601-ad9f-f5fe3a0a7855 None admin] PATH_INFO: `/v3/groups` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:24.682153 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e537fe-1757-4601-ad9f-f5fe3a0a7855 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:24.684709 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e537fe-1757-4601-ad9f-f5fe3a0a7855 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:24.687170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-51bac623-cf35-4fec-bc02-f8e30e840b19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:24.687170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:24.687170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:24.687170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:24.687170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:24.687170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:24.687170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:24.687170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:24.687170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:24.687170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:24.687170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:24.687170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:24.687170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:24.687170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:24.687170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:24.687170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:24.688011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:24.688011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:24.688011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:24.688011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:24.688011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:24.688011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:24.688011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:24.688011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:24.688011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:24.688011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:24.688011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:24.688011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:24.688011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:24.688011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:24.688011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:24.688011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:24.688774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:24.688774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:24.688774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:24.688774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:24.688774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:24.688774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:24.688774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:24.688774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:24.688774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:24.688774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:24.688774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:24.688774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:24.688774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 162/326] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:24.689403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bac623-cf35-4fec-bc02-f8e30e840b19 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:24.704013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 165/327] 10.222.0.32 () {60 vars in 1134 bytes} [Tue May 10 13:47:24 2022] POST /identity/v3/groups => generated 226 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:47:24.705183 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e537fe-1757-4601-ad9f-f5fe3a0a7855 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:24.814635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bac623-cf35-4fec-bc02-f8e30e840b19 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:24.834557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e537fe-1757-4601-ad9f-f5fe3a0a7855 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:24.860646 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd24c90-f4fd-417b-88c3-42b1c09e45f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:24.862539 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd24c90-f4fd-417b-88c3-42b1c09e45f6 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:24.863238 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd24c90-f4fd-417b-88c3-42b1c09e45f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:24.864315 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd24c90-f4fd-417b-88c3-42b1c09e45f6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:24.875933 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18001e2e-d3b7-48f3-9cc2-886f11622ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:24.876632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18001e2e-d3b7-48f3-9cc2-886f11622ef4 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:24.876983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18001e2e-d3b7-48f3-9cc2-886f11622ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:24.877271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18001e2e-d3b7-48f3-9cc2-886f11622ef4 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:24.878061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18001e2e-d3b7-48f3-9cc2-886f11622ef4 None admin] RBAC: Adding query filter params (name=member) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:24.878392 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18001e2e-d3b7-48f3-9cc2-886f11622ef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:24.878637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd24c90-f4fd-417b-88c3-42b1c09e45f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:24.880008 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18001e2e-d3b7-48f3-9cc2-886f11622ef4 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:24.886594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-efd24c90-f4fd-417b-88c3-42b1c09e45f6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:47:24.886594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:24.886594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:24.886594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:24.886594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:24.886594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:24.886594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:24.886594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:24.886594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:24.886594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:24.886594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:24.886594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:24.886594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:24.886594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:24.886594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:24.886594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:24.887570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:24.887570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:24.887570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:24.887570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:24.887570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:24.887570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:24.887570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:24.887570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:24.887570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:24.887570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:24.887570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:24.887570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:24.887570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:24.887570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:24.887570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:24.887570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:24.889644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:24.889644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:24.889644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:24.889644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:24.889644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:24.889644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:24.889644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:24.889644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:24.889644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:24.889644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:24.889644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:47:24.889644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:24.889644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 163/328] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:24.898587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 166/329] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:47:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:24.899821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18001e2e-d3b7-48f3-9cc2-886f11622ef4 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:24.900143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd24c90-f4fd-417b-88c3-42b1c09e45f6 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:25.016935 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd24c90-f4fd-417b-88c3-42b1c09e45f6 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:25.033546 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18001e2e-d3b7-48f3-9cc2-886f11622ef4 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:25.062342 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f03b9-554b-4924-87da-c683d0222b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:25.063330 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f03b9-554b-4924-87da-c683d0222b90 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:25.063793 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f03b9-554b-4924-87da-c683d0222b90 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:25.064246 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f03b9-554b-4924-87da-c683d0222b90 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:25.065240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f03b9-554b-4924-87da-c683d0222b90 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:25.065754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f03b9-554b-4924-87da-c683d0222b90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:25.067368 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f03b9-554b-4924-87da-c683d0222b90 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:25.071103 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d00748-a129-4aff-95e5-a600cd0fee96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:25.072070 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d00748-a129-4aff-95e5-a600cd0fee96 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:25.072427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d00748-a129-4aff-95e5-a600cd0fee96 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:25.072774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d00748-a129-4aff-95e5-a600cd0fee96 None admin] PATH_INFO: `/v3/users/3d3cb9ad866b46f2b7c424d672caff87` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:25.074155 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d00748-a129-4aff-95e5-a600cd0fee96 None admin] RBAC: Authorizing `identity:get_user(user_id=3d3cb9ad866b46f2b7c424d672caff87)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:25.075654 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d00748-a129-4aff-95e5-a600cd0fee96 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:25.077963 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 167/330] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:47:24 2022] GET /identity/v3/users/3d3cb9ad866b46f2b7c424d672caff87 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:25.078834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 164/331] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:47:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:25.083156 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d00748-a129-4aff-95e5-a600cd0fee96 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:25.085211 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f03b9-554b-4924-87da-c683d0222b90 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:25.201804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f03b9-554b-4924-87da-c683d0222b90 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:25.211258 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d00748-a129-4aff-95e5-a600cd0fee96 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:25.239181 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84633c-5844-4c16-ba4f-0fc6aead9c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:25.240787 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84633c-5844-4c16-ba4f-0fc6aead9c58 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:25.241258 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84633c-5844-4c16-ba4f-0fc6aead9c58 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:25.241707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84633c-5844-4c16-ba4f-0fc6aead9c58 None admin] PATH_INFO: `/v3/users/41c3d8ea83bc4713ae8487b16de2a8fd` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:25.243148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84633c-5844-4c16-ba4f-0fc6aead9c58 None admin] RBAC: Authorizing `identity:get_user(user_id=41c3d8ea83bc4713ae8487b16de2a8fd)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:25.244790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84633c-5844-4c16-ba4f-0fc6aead9c58 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:25.247041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 165/332] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:47:25 2022] GET /identity/v3/users/41c3d8ea83bc4713ae8487b16de2a8fd => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:25.255104 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5ab53-0097-4484-9758-a443f6b84acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:25.255635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84633c-5844-4c16-ba4f-0fc6aead9c58 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:25.255959 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5ab53-0097-4484-9758-a443f6b84acf None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:25.256154 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5ab53-0097-4484-9758-a443f6b84acf None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:25.256445 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5ab53-0097-4484-9758-a443f6b84acf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:25.257296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5ab53-0097-4484-9758-a443f6b84acf None admin] RBAC: Adding query filter params (role.id=34ef75b7c6d54c5e81edbfee2f4b362d, user.id=3d3cb9ad866b46f2b7c424d672caff87, scope.system=all) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:25.257601 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5ab53-0097-4484-9758-a443f6b84acf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:25.259311 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5ab53-0097-4484-9758-a443f6b84acf None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:25.273181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 168/333] 10.222.0.32 () {56 vars in 1308 bytes} [Tue May 10 13:47:25 2022] GET /identity/v3/role_assignments?user.id=3d3cb9ad866b46f2b7c424d672caff87&scope.system=all&role.id=34ef75b7c6d54c5e81edbfee2f4b362d => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:25.378826 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84633c-5844-4c16-ba4f-0fc6aead9c58 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:25.416940 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb973681-1c35-4cd2-900f-db66095d3e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:25.417833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb973681-1c35-4cd2-900f-db66095d3e39 None admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:25.418118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb973681-1c35-4cd2-900f-db66095d3e39 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:25.418431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb973681-1c35-4cd2-900f-db66095d3e39 None admin] PATH_INFO: `/v3/system/users/41c3d8ea83bc4713ae8487b16de2a8fd/roles/27bc06df3c7b4654b71935efdaca22aa` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:25.420113 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb973681-1c35-4cd2-900f-db66095d3e39 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=41c3d8ea83bc4713ae8487b16de2a8fd, role_id=27bc06df3c7b4654b71935efdaca22aa)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:25.421752 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb973681-1c35-4cd2-900f-db66095d3e39 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:25.433843 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 166/334] 10.222.0.32 () {58 vars in 1334 bytes} [Tue May 10 13:47:25 2022] PUT /identity/v3/system/users/41c3d8ea83bc4713ae8487b16de2a8fd/roles/27bc06df3c7b4654b71935efdaca22aa => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:47:27.335120 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15515e-b43e-4353-9572-68cb84f0e399 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:27.335599 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15515e-b43e-4353-9572-68cb84f0e399 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:27.335599 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15515e-b43e-4353-9572-68cb84f0e399 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:27.337188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 169/335] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:27.343972 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e992ed4-2bd6-499d-aec1-3afa89c25adf None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:27.344403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e992ed4-2bd6-499d-aec1-3afa89c25adf None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:27.344589 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e992ed4-2bd6-499d-aec1-3afa89c25adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:27.367222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-0e992ed4-2bd6-499d-aec1-3afa89c25adf None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:27.368416 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-0e992ed4-2bd6-499d-aec1-3afa89c25adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:27.452781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 167/336] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:47:27.500945 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15515e-b43e-4353-9572-68cb84f0e399 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:27.647088 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15515e-b43e-4353-9572-68cb84f0e399 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:27.689267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15341b36-940f-4b52-a1ea-0bb2e4046bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:27.690085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15341b36-940f-4b52-a1ea-0bb2e4046bdb None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:27.690407 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15341b36-940f-4b52-a1ea-0bb2e4046bdb None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:27.690685 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15341b36-940f-4b52-a1ea-0bb2e4046bdb None admin] PATH_INFO: `/v3/roles/member` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:27.707966 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15341b36-940f-4b52-a1ea-0bb2e4046bdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:27.715899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-15341b36-940f-4b52-a1ea-0bb2e4046bdb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:27.715899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:27.715899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:27.715899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:27.715899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:27.715899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:27.715899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:27.715899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:27.715899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:27.715899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:27.715899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:27.715899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:27.715899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:27.715899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:27.715899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:27.715899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:27.717594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:27.717594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:27.717594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:27.717594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:27.717594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:27.717594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:27.717594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:27.717594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:27.717594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:27.717594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:27.717594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:27.717594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:27.717594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:27.717594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:27.717594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:27.717594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:27.718806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:27.718806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:27.718806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:27.718806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:27.718806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:27.718806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:27.718806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:27.718806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:27.718806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:27.718806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:27.718806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:27.718806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:27.718806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 170/337] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:27.723833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e992ed4-2bd6-499d-aec1-3afa89c25adf None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:27.823134 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a400e-89f2-4bf5-8f37-b022cc0e0e1f None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:27.823457 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a400e-89f2-4bf5-8f37-b022cc0e0e1f None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:27.823694 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a400e-89f2-4bf5-8f37-b022cc0e0e1f None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:27.826833 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 171/338] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:27.839768 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddede25-07e7-4bd2-8913-1a151c966cb5 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:27.840131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddede25-07e7-4bd2-8913-1a151c966cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:27.840324 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddede25-07e7-4bd2-8913-1a151c966cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:27.879239 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-5ddede25-07e7-4bd2-8913-1a151c966cb5 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:27.880473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-5ddede25-07e7-4bd2-8913-1a151c966cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:27.882011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e992ed4-2bd6-499d-aec1-3afa89c25adf None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:27.921770 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e138023-5132-40db-831a-855843e30ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:27.924689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e138023-5132-40db-831a-855843e30ebe None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:27.925172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e138023-5132-40db-831a-855843e30ebe None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:27.925615 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e138023-5132-40db-831a-855843e30ebe None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:27.926565 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e138023-5132-40db-831a-855843e30ebe None admin] RBAC: Adding query filter params (name=member) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:27.927101 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e138023-5132-40db-831a-855843e30ebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:27.928819 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e138023-5132-40db-831a-855843e30ebe None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:27.938816 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 168/339] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:47:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:27.944633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e138023-5132-40db-831a-855843e30ebe None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:27.980534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 172/340] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:28.033436 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddede25-07e7-4bd2-8913-1a151c966cb5 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:28.061597 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e138023-5132-40db-831a-855843e30ebe None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:28.096345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5883a2-0d7c-470f-831e-426365beaf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:28.097339 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5883a2-0d7c-470f-831e-426365beaf6d None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:28.097771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5883a2-0d7c-470f-831e-426365beaf6d None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:28.098181 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5883a2-0d7c-470f-831e-426365beaf6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:28.169174 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5883a2-0d7c-470f-831e-426365beaf6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:28.170159 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddede25-07e7-4bd2-8913-1a151c966cb5 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:28.171228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5883a2-0d7c-470f-831e-426365beaf6d None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:28.211854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a8d68-f174-47ec-af5d-934936f78805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:28.212676 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a8d68-f174-47ec-af5d-934936f78805 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:28.212967 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a8d68-f174-47ec-af5d-934936f78805 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:28.213245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a8d68-f174-47ec-af5d-934936f78805 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:28.227693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a8d68-f174-47ec-af5d-934936f78805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:28.237739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-094a8d68-f174-47ec-af5d-934936f78805 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:47:28.237739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:28.237739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:28.237739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:28.237739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:28.237739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:28.237739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:28.237739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:28.237739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:28.237739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:28.237739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:28.237739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:28.237739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:28.237739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:28.237739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:28.237739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:28.238901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:28.238901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:28.238901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:28.238901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:28.238901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:28.238901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:28.238901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:28.238901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:28.238901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:28.238901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:28.238901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:28.238901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:28.238901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:28.238901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:28.238901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:28.238901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:28.239857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:28.239857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:28.239857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:28.239857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:28.239857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:28.239857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:28.239857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:28.239857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:28.239857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:28.239857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:28.239857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:47:28.239857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:28.239857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 173/341] 10.222.0.32 () {56 vars in 1114 bytes} [Tue May 10 13:47:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:28.247331 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a8d68-f174-47ec-af5d-934936f78805 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:28.292264 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 169/342] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 13:47:28.299042 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5883a2-0d7c-470f-831e-426365beaf6d None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:28.417941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5883a2-0d7c-470f-831e-426365beaf6d None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:28.434549 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a8d68-f174-47ec-af5d-934936f78805 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:28.454483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d0e67-9145-44e7-8a89-006199cfd985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:28.455361 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d0e67-9145-44e7-8a89-006199cfd985 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:28.455645 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d0e67-9145-44e7-8a89-006199cfd985 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:28.455920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d0e67-9145-44e7-8a89-006199cfd985 None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:28.457135 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d0e67-9145-44e7-8a89-006199cfd985 None admin] RBAC: Authorizing `identity:get_project(project_id=03067c95202a44bbae7686a1a4886b44)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:28.458604 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d0e67-9145-44e7-8a89-006199cfd985 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:28.460469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 170/343] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:28 2022] GET /identity/v3/projects/03067c95202a44bbae7686a1a4886b44 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:28.466003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d0e67-9145-44e7-8a89-006199cfd985 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:28.485570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb28fbb-5377-4045-ae4a-ec499f12974d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:28.486268 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb28fbb-5377-4045-ae4a-ec499f12974d None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:28.486552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb28fbb-5377-4045-ae4a-ec499f12974d None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:28.486829 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb28fbb-5377-4045-ae4a-ec499f12974d None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:28.487587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb28fbb-5377-4045-ae4a-ec499f12974d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:28.487893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb28fbb-5377-4045-ae4a-ec499f12974d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:28.489273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb28fbb-5377-4045-ae4a-ec499f12974d None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:28.503178 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 174/344] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:47:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:28.508683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb28fbb-5377-4045-ae4a-ec499f12974d None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:28.572055 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d0e67-9145-44e7-8a89-006199cfd985 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:28.610025 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac9e76-fc91-47a2-baa6-a0e735d473dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:28.610941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac9e76-fc91-47a2-baa6-a0e735d473dd None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:28.611225 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac9e76-fc91-47a2-baa6-a0e735d473dd None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:28.611508 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac9e76-fc91-47a2-baa6-a0e735d473dd None admin] PATH_INFO: `/v3/groups/0b8a77f30f714b91b7590c55195bd47c` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:28.618100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac9e76-fc91-47a2-baa6-a0e735d473dd None admin] RBAC: Authorizing `identity:get_group(group_id=0b8a77f30f714b91b7590c55195bd47c)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:28.619673 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac9e76-fc91-47a2-baa6-a0e735d473dd None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:28.626364 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 171/345] 10.222.0.32 () {56 vars in 1180 bytes} [Tue May 10 13:47:28 2022] GET /identity/v3/groups/0b8a77f30f714b91b7590c55195bd47c => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:28.627986 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac9e76-fc91-47a2-baa6-a0e735d473dd None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:28.639642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb28fbb-5377-4045-ae4a-ec499f12974d None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:28.699623 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404bf4a-9864-4b34-abaa-de06e0db9ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:28.700294 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404bf4a-9864-4b34-abaa-de06e0db9ae2 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:28.700575 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404bf4a-9864-4b34-abaa-de06e0db9ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:28.700915 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404bf4a-9864-4b34-abaa-de06e0db9ae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:28.735531 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac9e76-fc91-47a2-baa6-a0e735d473dd None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:28.774341 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae521c-5008-4978-9098-3f428d752af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:28.775105 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae521c-5008-4978-9098-3f428d752af4 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:28.775390 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae521c-5008-4978-9098-3f428d752af4 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:28.775720 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae521c-5008-4978-9098-3f428d752af4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:28.776658 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae521c-5008-4978-9098-3f428d752af4 None admin] RBAC: Adding query filter params (group.id=0b8a77f30f714b91b7590c55195bd47c, role.id=34ef75b7c6d54c5e81edbfee2f4b362d, scope.project.id=03067c95202a44bbae7686a1a4886b44) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:28.776978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae521c-5008-4978-9098-3f428d752af4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:28.778508 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae521c-5008-4978-9098-3f428d752af4 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:28.790051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 172/346] 10.222.0.32 () {56 vars in 1376 bytes} [Tue May 10 13:47:28 2022] GET /identity/v3/role_assignments?group.id=0b8a77f30f714b91b7590c55195bd47c&scope.project.id=03067c95202a44bbae7686a1a4886b44&role.id=34ef75b7c6d54c5e81edbfee2f4b362d => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:28.791704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170e7bc-0a42-454f-9ded-8a1f9b0b0ac6 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:28.791991 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170e7bc-0a42-454f-9ded-8a1f9b0b0ac6 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:28.792275 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170e7bc-0a42-454f-9ded-8a1f9b0b0ac6 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:28.793689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 173/347] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:28.806509 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08990625-cd57-41a7-9d36-baf39a0b9694 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:28.806831 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08990625-cd57-41a7-9d36-baf39a0b9694 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:28.807123 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08990625-cd57-41a7-9d36-baf39a0b9694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:28.840785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-08990625-cd57-41a7-9d36-baf39a0b9694 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:28.842153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-08990625-cd57-41a7-9d36-baf39a0b9694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:28.923561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404bf4a-9864-4b34-abaa-de06e0db9ae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:28.925399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404bf4a-9864-4b34-abaa-de06e0db9ae2 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:28.952998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 174/348] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 10 13:47:29.022742 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df259ca-a4ce-4d99-9b42-0034dacb2bcd None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:29.023019 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df259ca-a4ce-4d99-9b42-0034dacb2bcd None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:29.023279 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df259ca-a4ce-4d99-9b42-0034dacb2bcd None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:29.024940 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 175/349] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:29.031353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef2569-2e68-44c3-9837-a059d95a743d None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:29.031673 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef2569-2e68-44c3-9837-a059d95a743d None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:29.031984 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef2569-2e68-44c3-9837-a059d95a743d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:29.063491 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-cdef2569-2e68-44c3-9837-a059d95a743d None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:29.064985 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-cdef2569-2e68-44c3-9837-a059d95a743d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:29.159903 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 176/350] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:47:29.160991 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef2569-2e68-44c3-9837-a059d95a743d None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:29.169598 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 175/351] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 13:47:29.174880 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404bf4a-9864-4b34-abaa-de06e0db9ae2 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:29.312616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef2569-2e68-44c3-9837-a059d95a743d None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:29.356256 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e21593-22b0-47dd-864a-e30e24017742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:29.357864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e21593-22b0-47dd-864a-e30e24017742 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:29.358148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e21593-22b0-47dd-864a-e30e24017742 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:29.358460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e21593-22b0-47dd-864a-e30e24017742 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:29.364689 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404bf4a-9864-4b34-abaa-de06e0db9ae2 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:29.373336 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e21593-22b0-47dd-864a-e30e24017742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:29.382523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-17e21593-22b0-47dd-864a-e30e24017742 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:47:29.382523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:29.382523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:29.382523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:29.382523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:29.382523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:29.382523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:29.382523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:29.382523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:29.382523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:29.382523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:29.382523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:29.382523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:29.382523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:29.382523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:29.382523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:29.384358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:29.384358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:29.384358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:29.384358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:29.384358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:29.384358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:29.384358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:29.384358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:29.384358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:29.384358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:29.384358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:29.384358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:29.384358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:29.384358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:29.384358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:29.384358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:29.386782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:29.386782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:29.386782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:29.386782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:29.386782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:29.386782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:29.386782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:29.386782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:29.386782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:29.386782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:29.386782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:47:29.386782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:29.386782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 177/352] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:29.386782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e21593-22b0-47dd-864a-e30e24017742 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:29.425376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf6bbd-165b-40b1-abcb-870eaf608c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:29.426754 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf6bbd-165b-40b1-abcb-870eaf608c3e None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:29.427263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf6bbd-165b-40b1-abcb-870eaf608c3e None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:29.427739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf6bbd-165b-40b1-abcb-870eaf608c3e None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:29.429381 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf6bbd-165b-40b1-abcb-870eaf608c3e None admin] RBAC: Authorizing `identity:get_project(project_id=03067c95202a44bbae7686a1a4886b44)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:29.431214 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf6bbd-165b-40b1-abcb-870eaf608c3e None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:29.433735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 176/353] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:29 2022] GET /identity/v3/projects/03067c95202a44bbae7686a1a4886b44 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:29.434903 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf6bbd-165b-40b1-abcb-870eaf608c3e None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:29.505971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e21593-22b0-47dd-864a-e30e24017742 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:29.545020 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c697bb-cecb-486e-aac1-b04306964352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:29.546150 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c697bb-cecb-486e-aac1-b04306964352 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:29.546467 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c697bb-cecb-486e-aac1-b04306964352 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:29.546747 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c697bb-cecb-486e-aac1-b04306964352 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:29.559519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c697bb-cecb-486e-aac1-b04306964352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:29.574335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-27c697bb-cecb-486e-aac1-b04306964352 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:29.574335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:29.574335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:29.574335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:29.574335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:29.574335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:29.574335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:29.574335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:29.574335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:29.574335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:29.574335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:29.574335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:29.574335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:29.574335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:29.574335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:29.574335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:29.576902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:29.576902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:29.576902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:29.576902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:29.576902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:29.576902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:29.576902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:29.576902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:29.576902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:29.576902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:29.576902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:29.576902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:29.576902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:29.576902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:29.576902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:29.576902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:29.583693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:29.583693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:29.583693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:29.583693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:29.583693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:29.583693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:29.583693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:29.583693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:29.583693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:29.583693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:29.583693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:29.583693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:29.583693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 178/354] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:29.583693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c697bb-cecb-486e-aac1-b04306964352 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:29.609306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf6bbd-165b-40b1-abcb-870eaf608c3e None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:29.667310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb4fcf-31fc-4cb3-a718-47c8879f70be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:29.668971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb4fcf-31fc-4cb3-a718-47c8879f70be None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:29.669837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb4fcf-31fc-4cb3-a718-47c8879f70be None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:29.670647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb4fcf-31fc-4cb3-a718-47c8879f70be None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:29.672442 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb4fcf-31fc-4cb3-a718-47c8879f70be None admin] RBAC: Adding query filter params (name=reader) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:29.673307 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb4fcf-31fc-4cb3-a718-47c8879f70be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:29.676393 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb4fcf-31fc-4cb3-a718-47c8879f70be None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:29.692972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 177/355] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:47:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:29.698922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb4fcf-31fc-4cb3-a718-47c8879f70be None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:29.710345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c697bb-cecb-486e-aac1-b04306964352 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:29.747983 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1319def-703c-46e9-843d-170e280cf013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:29.748988 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1319def-703c-46e9-843d-170e280cf013 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:29.749278 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1319def-703c-46e9-843d-170e280cf013 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:29.749553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1319def-703c-46e9-843d-170e280cf013 None admin] PATH_INFO: `/v3/groups/0b8a77f30f714b91b7590c55195bd47c` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:29.752048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1319def-703c-46e9-843d-170e280cf013 None admin] RBAC: Authorizing `identity:get_group(group_id=0b8a77f30f714b91b7590c55195bd47c)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:29.753614 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1319def-703c-46e9-843d-170e280cf013 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:29.755883 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 179/356] 10.222.0.32 () {56 vars in 1180 bytes} [Tue May 10 13:47:29 2022] GET /identity/v3/groups/0b8a77f30f714b91b7590c55195bd47c => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:29.757314 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77717c02-c185-4233-b0f5-12a74fc44b24 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:29.757601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77717c02-c185-4233-b0f5-12a74fc44b24 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:29.757879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77717c02-c185-4233-b0f5-12a74fc44b24 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:29.759547 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 180/357] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:29.760303 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77717c02-c185-4233-b0f5-12a74fc44b24 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:29.820738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb4fcf-31fc-4cb3-a718-47c8879f70be None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:29.860371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa45cd-bdc5-4058-98a1-37c83aa2d791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:29.861430 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa45cd-bdc5-4058-98a1-37c83aa2d791 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:29.861915 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa45cd-bdc5-4058-98a1-37c83aa2d791 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:29.863052 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa45cd-bdc5-4058-98a1-37c83aa2d791 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:29.864049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa45cd-bdc5-4058-98a1-37c83aa2d791 None admin] RBAC: Adding query filter params (name=member) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:29.864565 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa45cd-bdc5-4058-98a1-37c83aa2d791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:29.866268 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa45cd-bdc5-4058-98a1-37c83aa2d791 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:29.875310 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77717c02-c185-4233-b0f5-12a74fc44b24 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:29.877461 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 178/358] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:47:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:29.879006 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748127e7-a766-4bbd-8bf2-7879a7b8021b None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:29.879549 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748127e7-a766-4bbd-8bf2-7879a7b8021b None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:29.880026 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748127e7-a766-4bbd-8bf2-7879a7b8021b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:29.898252 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-748127e7-a766-4bbd-8bf2-7879a7b8021b None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:29.900239 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-748127e7-a766-4bbd-8bf2-7879a7b8021b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:29.914904 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398d3ab-d1e9-4195-8f13-59d21896dff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:29.915803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398d3ab-d1e9-4195-8f13-59d21896dff4 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:29.916090 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398d3ab-d1e9-4195-8f13-59d21896dff4 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:29.916419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398d3ab-d1e9-4195-8f13-59d21896dff4 None admin] PATH_INFO: `/v3/users/41c3d8ea83bc4713ae8487b16de2a8fd` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:29.918868 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398d3ab-d1e9-4195-8f13-59d21896dff4 None admin] RBAC: Authorizing `identity:get_user(user_id=41c3d8ea83bc4713ae8487b16de2a8fd)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:29.920658 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398d3ab-d1e9-4195-8f13-59d21896dff4 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:29.922497 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 181/359] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:47:29 2022] GET /identity/v3/users/41c3d8ea83bc4713ae8487b16de2a8fd => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:29.923447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398d3ab-d1e9-4195-8f13-59d21896dff4 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:30.019206 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 179/360] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:30.020568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748127e7-a766-4bbd-8bf2-7879a7b8021b None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:30.039401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398d3ab-d1e9-4195-8f13-59d21896dff4 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:30.078721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee2544-a03c-40db-ad92-4ea40ea2527e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:30.079400 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee2544-a03c-40db-ad92-4ea40ea2527e None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:30.079685 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee2544-a03c-40db-ad92-4ea40ea2527e None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:30.080022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee2544-a03c-40db-ad92-4ea40ea2527e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:30.080802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee2544-a03c-40db-ad92-4ea40ea2527e None admin] RBAC: Adding query filter params (group.id=0b8a77f30f714b91b7590c55195bd47c, role.id=316da37136b4425f9ae486ae1e2bf4b4, scope.project.id=03067c95202a44bbae7686a1a4886b44) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:30.081115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee2544-a03c-40db-ad92-4ea40ea2527e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:30.082624 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee2544-a03c-40db-ad92-4ea40ea2527e None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:30.089413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 182/361] 10.222.0.32 () {56 vars in 1376 bytes} [Tue May 10 13:47:29 2022] GET /identity/v3/role_assignments?group.id=0b8a77f30f714b91b7590c55195bd47c&scope.project.id=03067c95202a44bbae7686a1a4886b44&role.id=316da37136b4425f9ae486ae1e2bf4b4 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:30.090358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee2544-a03c-40db-ad92-4ea40ea2527e None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:30.148224 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748127e7-a766-4bbd-8bf2-7879a7b8021b None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:30.192521 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210689d-0356-4aeb-b090-259a083f0d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:30.193578 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210689d-0356-4aeb-b090-259a083f0d8c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:30.194087 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210689d-0356-4aeb-b090-259a083f0d8c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:30.194598 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210689d-0356-4aeb-b090-259a083f0d8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:30.209893 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee2544-a03c-40db-ad92-4ea40ea2527e None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:30.249874 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1c734-581f-45b2-afac-c63519c57786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:30.250591 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1c734-581f-45b2-afac-c63519c57786 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:30.250927 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1c734-581f-45b2-afac-c63519c57786 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:30.251210 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1c734-581f-45b2-afac-c63519c57786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:30.252322 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1c734-581f-45b2-afac-c63519c57786 None admin] RBAC: Adding query filter params (role.id=27bc06df3c7b4654b71935efdaca22aa, user.id=41c3d8ea83bc4713ae8487b16de2a8fd, scope.system=all) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:30.252449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1c734-581f-45b2-afac-c63519c57786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:30.253957 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1c734-581f-45b2-afac-c63519c57786 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:30.268272 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 183/362] 10.222.0.32 () {56 vars in 1308 bytes} [Tue May 10 13:47:30 2022] GET /identity/v3/role_assignments?user.id=41c3d8ea83bc4713ae8487b16de2a8fd&scope.system=all&role.id=27bc06df3c7b4654b71935efdaca22aa => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:30.269092 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1c734-581f-45b2-afac-c63519c57786 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:30.285053 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210689d-0356-4aeb-b090-259a083f0d8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:30.287108 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210689d-0356-4aeb-b090-259a083f0d8c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:30.409151 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1c734-581f-45b2-afac-c63519c57786 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:30.410569 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 180/363] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:30.416455 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210689d-0356-4aeb-b090-259a083f0d8c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:30.493003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f33bb0-a33d-4acf-8327-8d6194f7c35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:30.494865 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f33bb0-a33d-4acf-8327-8d6194f7c35c None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:30.501565 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f33bb0-a33d-4acf-8327-8d6194f7c35c None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:30.502267 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f33bb0-a33d-4acf-8327-8d6194f7c35c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:30.526400 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f33bb0-a33d-4acf-8327-8d6194f7c35c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:30.536616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-57f33bb0-a33d-4acf-8327-8d6194f7c35c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:47:30.536616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:30.536616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:30.536616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:30.536616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:30.536616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:30.536616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:30.536616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:30.536616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:30.536616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:30.536616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:30.536616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:30.536616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:30.536616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:30.536616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:30.536616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:30.537580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:30.537580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:30.537580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:30.537580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:30.537580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:30.537580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:30.537580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:30.537580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:30.537580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:30.537580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:30.537580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:30.537580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:30.537580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:30.537580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:30.537580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:30.537580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:30.538422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:30.538422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:30.538422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:30.538422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:30.538422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:30.538422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:30.538422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:30.538422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:30.538422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:30.538422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:30.538422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:47:30.538422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:30.541590 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 184/364] 10.222.0.32 () {56 vars in 1114 bytes} [Tue May 10 13:47:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:30.555935 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f33bb0-a33d-4acf-8327-8d6194f7c35c None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:30.620955 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210689d-0356-4aeb-b090-259a083f0d8c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:30.665952 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9d8f4-3d21-4429-8904-0ef88d9bd942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:30.667239 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9d8f4-3d21-4429-8904-0ef88d9bd942 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:30.667763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9d8f4-3d21-4429-8904-0ef88d9bd942 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:30.668257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9d8f4-3d21-4429-8904-0ef88d9bd942 None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:30.670560 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9d8f4-3d21-4429-8904-0ef88d9bd942 None admin] RBAC: Authorizing `identity:get_project(project_id=ec7d549ce6b14f7f8c85bf895eebadac)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:30.672397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9d8f4-3d21-4429-8904-0ef88d9bd942 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:30.674876 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 181/365] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:30 2022] GET /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:30.681292 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9d8f4-3d21-4429-8904-0ef88d9bd942 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:30.791969 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f33bb0-a33d-4acf-8327-8d6194f7c35c None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:30.834273 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1af2ce-c9f1-483b-8d63-f8b3c8d206c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:30.834967 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1af2ce-c9f1-483b-8d63-f8b3c8d206c4 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:30.835253 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1af2ce-c9f1-483b-8d63-f8b3c8d206c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:30.835532 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1af2ce-c9f1-483b-8d63-f8b3c8d206c4 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:30.836299 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1af2ce-c9f1-483b-8d63-f8b3c8d206c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:30.836620 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1af2ce-c9f1-483b-8d63-f8b3c8d206c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:30.838012 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1af2ce-c9f1-483b-8d63-f8b3c8d206c4 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:30.846946 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 185/366] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:47:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:30.848308 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c3607-9ed2-4f3a-bbec-aaad1f20bfa7 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:30.848597 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c3607-9ed2-4f3a-bbec-aaad1f20bfa7 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:30.848871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c3607-9ed2-4f3a-bbec-aaad1f20bfa7 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:30.850357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 186/367] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:30.862226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c3607-9ed2-4f3a-bbec-aaad1f20bfa7 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:30.862405 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9d8f4-3d21-4429-8904-0ef88d9bd942 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:30.898780 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f21bc-8a26-4841-bb47-95839557c512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:30.900193 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f21bc-8a26-4841-bb47-95839557c512 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:30.900480 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f21bc-8a26-4841-bb47-95839557c512 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:30.900757 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f21bc-8a26-4841-bb47-95839557c512 None admin] PATH_INFO: `/v3/groups/0b8a77f30f714b91b7590c55195bd47c` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:30.902040 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f21bc-8a26-4841-bb47-95839557c512 None admin] RBAC: Authorizing `identity:get_group(group_id=0b8a77f30f714b91b7590c55195bd47c)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:30.903606 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f21bc-8a26-4841-bb47-95839557c512 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:30.906323 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 182/368] 10.222.0.32 () {56 vars in 1180 bytes} [Tue May 10 13:47:30 2022] GET /identity/v3/groups/0b8a77f30f714b91b7590c55195bd47c => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:30.907637 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30fbab-4a08-4b5b-ab37-9e85fbc19fb2 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:30.907928 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30fbab-4a08-4b5b-ab37-9e85fbc19fb2 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:30.908205 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30fbab-4a08-4b5b-ab37-9e85fbc19fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:30.927684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-0d30fbab-4a08-4b5b-ab37-9e85fbc19fb2 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:30.928802 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-0d30fbab-4a08-4b5b-ab37-9e85fbc19fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:30.988347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c3607-9ed2-4f3a-bbec-aaad1f20bfa7 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:31.002645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 183/369] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:31.003534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30fbab-4a08-4b5b-ab37-9e85fbc19fb2 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:31.046604 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49f8a1-a203-40a3-92c3-87387ff29925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:31.047298 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49f8a1-a203-40a3-92c3-87387ff29925 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:31.047743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49f8a1-a203-40a3-92c3-87387ff29925 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:31.048190 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49f8a1-a203-40a3-92c3-87387ff29925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:31.114420 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30fbab-4a08-4b5b-ab37-9e85fbc19fb2 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:31.131631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49f8a1-a203-40a3-92c3-87387ff29925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:31.133350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49f8a1-a203-40a3-92c3-87387ff29925 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:31.150884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484d38f-7c8a-4333-93bb-9e65f4eddba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:31.151553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484d38f-7c8a-4333-93bb-9e65f4eddba9 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:31.151835 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484d38f-7c8a-4333-93bb-9e65f4eddba9 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:31.152110 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484d38f-7c8a-4333-93bb-9e65f4eddba9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:31.152960 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484d38f-7c8a-4333-93bb-9e65f4eddba9 None admin] RBAC: Adding query filter params (group.id=0b8a77f30f714b91b7590c55195bd47c, role.id=34ef75b7c6d54c5e81edbfee2f4b362d, scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:31.153274 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484d38f-7c8a-4333-93bb-9e65f4eddba9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:31.155450 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484d38f-7c8a-4333-93bb-9e65f4eddba9 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:31.161687 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 184/370] 10.222.0.32 () {56 vars in 1376 bytes} [Tue May 10 13:47:31 2022] GET /identity/v3/role_assignments?group.id=0b8a77f30f714b91b7590c55195bd47c&scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac&role.id=34ef75b7c6d54c5e81edbfee2f4b362d => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:31.162512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484d38f-7c8a-4333-93bb-9e65f4eddba9 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:31.244327 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 187/371] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:31.250561 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49f8a1-a203-40a3-92c3-87387ff29925 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:31.271477 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484d38f-7c8a-4333-93bb-9e65f4eddba9 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:31.309944 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e724ca-d813-466b-b8a2-647de1d8708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:31.311693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e724ca-d813-466b-b8a2-647de1d8708f None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:31.312126 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e724ca-d813-466b-b8a2-647de1d8708f None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:31.312564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e724ca-d813-466b-b8a2-647de1d8708f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:31.324828 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e724ca-d813-466b-b8a2-647de1d8708f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:31.333297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-d0e724ca-d813-466b-b8a2-647de1d8708f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:31.333297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:31.333297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:31.333297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:31.333297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:31.333297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:31.333297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:31.333297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:31.333297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:31.333297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:31.333297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:31.333297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:31.333297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:31.333297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:31.333297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:31.333297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:31.334343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:31.334343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:31.334343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:31.334343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:31.334343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:31.334343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:31.334343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:31.334343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:31.334343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:31.334343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:31.334343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:31.334343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:31.334343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:31.334343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:31.334343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:31.334343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:31.335117 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:31.335117 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:31.335117 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:31.335117 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:31.335117 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:31.335117 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:31.335117 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:31.335117 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:31.335117 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:31.335117 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:31.335117 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:31.335117 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:31.337906 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 185/372] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:47:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:31.344153 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e724ca-d813-466b-b8a2-647de1d8708f None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:31.391726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49f8a1-a203-40a3-92c3-87387ff29925 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:31.433463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083c727-497f-4273-a9c1-7d9c6b2802d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:31.434470 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083c727-497f-4273-a9c1-7d9c6b2802d9 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:31.434656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083c727-497f-4273-a9c1-7d9c6b2802d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:31.434932 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083c727-497f-4273-a9c1-7d9c6b2802d9 None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:31.436766 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083c727-497f-4273-a9c1-7d9c6b2802d9 None admin] RBAC: Authorizing `identity:get_project(project_id=ec7d549ce6b14f7f8c85bf895eebadac)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:31.438248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083c727-497f-4273-a9c1-7d9c6b2802d9 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:31.440340 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 188/373] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:31 2022] GET /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:31.446818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083c727-497f-4273-a9c1-7d9c6b2802d9 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:31.460331 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e724ca-d813-466b-b8a2-647de1d8708f None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:31.506452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e3994-5169-418f-b996-25a4bab9fa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:31.507595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e3994-5169-418f-b996-25a4bab9fa6e None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:31.508073 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e3994-5169-418f-b996-25a4bab9fa6e None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:31.508529 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e3994-5169-418f-b996-25a4bab9fa6e None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:31.509518 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e3994-5169-418f-b996-25a4bab9fa6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:31.510013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e3994-5169-418f-b996-25a4bab9fa6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:31.512239 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e3994-5169-418f-b996-25a4bab9fa6e None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:31.525538 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 186/374] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:31.531670 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e3994-5169-418f-b996-25a4bab9fa6e None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:31.600294 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083c727-497f-4273-a9c1-7d9c6b2802d9 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:31.643150 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a51789-7265-44e7-b57a-25fac7b159d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:31.644071 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a51789-7265-44e7-b57a-25fac7b159d6 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:31.644406 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a51789-7265-44e7-b57a-25fac7b159d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:31.644687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a51789-7265-44e7-b57a-25fac7b159d6 None admin] PATH_INFO: `/v3/groups/0b8a77f30f714b91b7590c55195bd47c` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:31.646876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a51789-7265-44e7-b57a-25fac7b159d6 None admin] RBAC: Authorizing `identity:get_group(group_id=0b8a77f30f714b91b7590c55195bd47c)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:31.648316 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a51789-7265-44e7-b57a-25fac7b159d6 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:31.654460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 189/375] 10.222.0.32 () {56 vars in 1180 bytes} [Tue May 10 13:47:31 2022] GET /identity/v3/groups/0b8a77f30f714b91b7590c55195bd47c => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:31.656227 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a51789-7265-44e7-b57a-25fac7b159d6 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:31.661655 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e3994-5169-418f-b996-25a4bab9fa6e None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:31.707145 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07f0c6-df22-497a-b194-3f515ee172a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:31.708122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07f0c6-df22-497a-b194-3f515ee172a4 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:31.708584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07f0c6-df22-497a-b194-3f515ee172a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:31.709031 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07f0c6-df22-497a-b194-3f515ee172a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:31.802249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a51789-7265-44e7-b57a-25fac7b159d6 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:31.809270 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07f0c6-df22-497a-b194-3f515ee172a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:31.811330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07f0c6-df22-497a-b194-3f515ee172a4 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:31.849446 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc49812-93ed-41fa-834e-4ba71dc9bc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:31.851559 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc49812-93ed-41fa-834e-4ba71dc9bc93 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:31.852036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc49812-93ed-41fa-834e-4ba71dc9bc93 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:31.852469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc49812-93ed-41fa-834e-4ba71dc9bc93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:31.853495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc49812-93ed-41fa-834e-4ba71dc9bc93 None admin] RBAC: Adding query filter params (group.id=0b8a77f30f714b91b7590c55195bd47c, role.id=316da37136b4425f9ae486ae1e2bf4b4, scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:31.853961 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc49812-93ed-41fa-834e-4ba71dc9bc93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:31.855653 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc49812-93ed-41fa-834e-4ba71dc9bc93 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:31.864682 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 190/376] 10.222.0.32 () {56 vars in 1376 bytes} [Tue May 10 13:47:31 2022] GET /identity/v3/role_assignments?group.id=0b8a77f30f714b91b7590c55195bd47c&scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac&role.id=316da37136b4425f9ae486ae1e2bf4b4 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:31.940998 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 187/377] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:31.946846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc49812-93ed-41fa-834e-4ba71dc9bc93 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:32.065764 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc49812-93ed-41fa-834e-4ba71dc9bc93 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:32.105727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35863ac7-3f15-4e2b-b5d4-75f8c2adad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:32.106822 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35863ac7-3f15-4e2b-b5d4-75f8c2adad3f None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:32.107922 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35863ac7-3f15-4e2b-b5d4-75f8c2adad3f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:32.108416 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35863ac7-3f15-4e2b-b5d4-75f8c2adad3f None admin] PATH_INFO: `/v3/projects/a83c1c4876b14f72a0e3d2113130a776` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:32.110646 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35863ac7-3f15-4e2b-b5d4-75f8c2adad3f None admin] RBAC: Authorizing `identity:get_project(project_id=a83c1c4876b14f72a0e3d2113130a776)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:32.113291 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35863ac7-3f15-4e2b-b5d4-75f8c2adad3f None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:32.117062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 191/378] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:31 2022] GET /identity/v3/projects/a83c1c4876b14f72a0e3d2113130a776 => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:32.126804 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07f0c6-df22-497a-b194-3f515ee172a4 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:32.242684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07f0c6-df22-497a-b194-3f515ee172a4 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:32.285352 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023172f-f6e9-4893-8fc2-2297fdeff845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:32.286257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023172f-f6e9-4893-8fc2-2297fdeff845 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:32.286547 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023172f-f6e9-4893-8fc2-2297fdeff845 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:32.286820 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023172f-f6e9-4893-8fc2-2297fdeff845 None admin] PATH_INFO: `/v3/groups/997c2677b3d1445e925c67ec44a0a059` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:32.293631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023172f-f6e9-4893-8fc2-2297fdeff845 None admin] RBAC: Authorizing `identity:get_group(group_id=997c2677b3d1445e925c67ec44a0a059)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:32.295734 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023172f-f6e9-4893-8fc2-2297fdeff845 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:32.297831 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 188/379] 10.222.0.32 () {56 vars in 1180 bytes} [Tue May 10 13:47:32 2022] GET /identity/v3/groups/997c2677b3d1445e925c67ec44a0a059 => generated 229 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:32.303674 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35863ac7-3f15-4e2b-b5d4-75f8c2adad3f None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:32.425973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35863ac7-3f15-4e2b-b5d4-75f8c2adad3f None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:32.463172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d13e9-9d7f-4730-9134-06dd6ff2b960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:32.463850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d13e9-9d7f-4730-9134-06dd6ff2b960 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:32.464148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d13e9-9d7f-4730-9134-06dd6ff2b960 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:32.464390 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d13e9-9d7f-4730-9134-06dd6ff2b960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:32.465251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d13e9-9d7f-4730-9134-06dd6ff2b960 None admin] RBAC: Adding query filter params (group.id=997c2677b3d1445e925c67ec44a0a059, role.id=17e40821fc444dd0b040dcfce3eb222b, scope.project.id=a83c1c4876b14f72a0e3d2113130a776) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:32.465556 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d13e9-9d7f-4730-9134-06dd6ff2b960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:32.467278 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d13e9-9d7f-4730-9134-06dd6ff2b960 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:32.474920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 192/380] 10.222.0.32 () {56 vars in 1376 bytes} [Tue May 10 13:47:32 2022] GET /identity/v3/role_assignments?group.id=997c2677b3d1445e925c67ec44a0a059&scope.project.id=a83c1c4876b14f72a0e3d2113130a776&role.id=17e40821fc444dd0b040dcfce3eb222b => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:32.948341 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17fb95-7cb6-46c7-b196-ca68194b3fcd None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:32.949297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17fb95-7cb6-46c7-b196-ca68194b3fcd None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:32.949771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17fb95-7cb6-46c7-b196-ca68194b3fcd None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:32.952329 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 189/381] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:32.957855 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd9ded-cdc1-4a94-bdfa-8e957b3380e0 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:32.958795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd9ded-cdc1-4a94-bdfa-8e957b3380e0 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:32.959274 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd9ded-cdc1-4a94-bdfa-8e957b3380e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:32.979314 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-20cd9ded-cdc1-4a94-bdfa-8e957b3380e0 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:32.980842 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-20cd9ded-cdc1-4a94-bdfa-8e957b3380e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:33.079309 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 193/382] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:33.118013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17fb95-7cb6-46c7-b196-ca68194b3fcd None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:33.273589 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17fb95-7cb6-46c7-b196-ca68194b3fcd None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:33.315388 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2fa8f-bbc2-4a20-a7df-54e39064d7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:33.316475 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2fa8f-bbc2-4a20-a7df-54e39064d7e6 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:33.316906 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2fa8f-bbc2-4a20-a7df-54e39064d7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:33.317321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2fa8f-bbc2-4a20-a7df-54e39064d7e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:33.329263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2fa8f-bbc2-4a20-a7df-54e39064d7e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:33.337298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-9ec2fa8f-bbc2-4a20-a7df-54e39064d7e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:33.337298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:33.337298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:33.337298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:33.337298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:33.337298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:33.337298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:33.337298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:33.337298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:33.337298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:33.337298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:33.337298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:33.337298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:33.337298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:33.337298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:33.337298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:33.338374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:33.338374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:33.338374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:33.338374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:33.338374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:33.338374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:33.338374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:33.338374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:33.338374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:33.338374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:33.338374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:33.338374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:33.338374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:33.338374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:33.338374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:33.338374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:33.339163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:33.339163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:33.339163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:33.339163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:33.339163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:33.339163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:33.339163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:33.339163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:33.339163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:33.339163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:33.339163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:33.339163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:33.346312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 190/383] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:33.351458 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd9ded-cdc1-4a94-bdfa-8e957b3380e0 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:33.438865 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448188f-ddd2-432b-bbe6-75d53266d952 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:33.439357 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448188f-ddd2-432b-bbe6-75d53266d952 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:33.439773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448188f-ddd2-432b-bbe6-75d53266d952 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:33.443725 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 191/384] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:33.448442 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e0cb6-9ba2-4c63-8dd6-d72b0c7788c7 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:33.448933 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e0cb6-9ba2-4c63-8dd6-d72b0c7788c7 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:33.449369 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e0cb6-9ba2-4c63-8dd6-d72b0c7788c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:33.471353 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-3f9e0cb6-9ba2-4c63-8dd6-d72b0c7788c7 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:33.472798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-3f9e0cb6-9ba2-4c63-8dd6-d72b0c7788c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:33.515842 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd9ded-cdc1-4a94-bdfa-8e957b3380e0 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:33.550310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 192/385] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:47:33.571271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e0cb6-9ba2-4c63-8dd6-d72b0c7788c7 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:33.609220 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29928f72-2fb8-4656-9648-cb63144737d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:33.609465 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29928f72-2fb8-4656-9648-cb63144737d4 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:33.609714 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29928f72-2fb8-4656-9648-cb63144737d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:33.609984 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29928f72-2fb8-4656-9648-cb63144737d4 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:33.610776 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29928f72-2fb8-4656-9648-cb63144737d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:33.611083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29928f72-2fb8-4656-9648-cb63144737d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:33.612487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29928f72-2fb8-4656-9648-cb63144737d4 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:33.634346 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 194/386] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:47:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:33.651762 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29928f72-2fb8-4656-9648-cb63144737d4 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:33.683790 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e0cb6-9ba2-4c63-8dd6-d72b0c7788c7 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:33.719521 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1feca5f-80ab-4c2c-a764-50a7b3a9cc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:33.720640 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1feca5f-80ab-4c2c-a764-50a7b3a9cc0a None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:33.721092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1feca5f-80ab-4c2c-a764-50a7b3a9cc0a None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:33.721525 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1feca5f-80ab-4c2c-a764-50a7b3a9cc0a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:33.733375 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1feca5f-80ab-4c2c-a764-50a7b3a9cc0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:33.741993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-c1feca5f-80ab-4c2c-a764-50a7b3a9cc0a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:47:33.741993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:33.741993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:33.741993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:33.741993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:33.741993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:33.741993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:33.741993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:33.741993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:33.741993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:33.741993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:33.741993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:33.741993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:33.741993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:33.741993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:33.741993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:33.744245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:33.744245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:33.744245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:33.744245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:33.744245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:33.744245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:33.744245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:33.744245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:33.744245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:33.744245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:33.744245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:33.744245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:33.744245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:33.744245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:33.744245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:33.744245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:33.745021 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:33.745021 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:33.745021 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:33.745021 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:33.745021 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:33.745021 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:33.745021 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:33.745021 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:33.745021 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:33.745021 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:33.745021 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:47:33.745021 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:33.747049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 193/387] 10.222.0.32 () {56 vars in 1114 bytes} [Tue May 10 13:47:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:33.753915 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1feca5f-80ab-4c2c-a764-50a7b3a9cc0a None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:33.860615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1feca5f-80ab-4c2c-a764-50a7b3a9cc0a None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:33.900027 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9dbcc-a210-427b-a3a5-48e6b56dd9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:33.900999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9dbcc-a210-427b-a3a5-48e6b56dd9c1 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:33.901435 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9dbcc-a210-427b-a3a5-48e6b56dd9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:33.901852 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9dbcc-a210-427b-a3a5-48e6b56dd9c1 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:33.902991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9dbcc-a210-427b-a3a5-48e6b56dd9c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:33.903495 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9dbcc-a210-427b-a3a5-48e6b56dd9c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:33.905102 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9dbcc-a210-427b-a3a5-48e6b56dd9c1 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:33.918568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29928f72-2fb8-4656-9648-cb63144737d4 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:33.920101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 194/388] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:47:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:33.921804 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9dbcc-a210-427b-a3a5-48e6b56dd9c1 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:33.992246 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4cf49-ddd3-4994-9683-21ca9931c218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:33.994671 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4cf49-ddd3-4994-9683-21ca9931c218 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:33.995375 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4cf49-ddd3-4994-9683-21ca9931c218 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:33.995940 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4cf49-ddd3-4994-9683-21ca9931c218 None admin] PATH_INFO: `/v3/groups/0b8a77f30f714b91b7590c55195bd47c` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:33.998838 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4cf49-ddd3-4994-9683-21ca9931c218 None admin] RBAC: Authorizing `identity:get_group(group_id=0b8a77f30f714b91b7590c55195bd47c)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:34.002095 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4cf49-ddd3-4994-9683-21ca9931c218 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:34.014767 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 195/389] 10.222.0.32 () {56 vars in 1180 bytes} [Tue May 10 13:47:33 2022] GET /identity/v3/groups/0b8a77f30f714b91b7590c55195bd47c => generated 226 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:34.016622 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4cf49-ddd3-4994-9683-21ca9931c218 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:34.038297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9dbcc-a210-427b-a3a5-48e6b56dd9c1 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:34.074649 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb95e05-aa2e-4b21-9b96-052ae9ecae1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:34.075869 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb95e05-aa2e-4b21-9b96-052ae9ecae1a None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:34.076297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb95e05-aa2e-4b21-9b96-052ae9ecae1a None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:34.076794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb95e05-aa2e-4b21-9b96-052ae9ecae1a None admin] PATH_INFO: `/v3/groups/0b8a77f30f714b91b7590c55195bd47c` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:34.078399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb95e05-aa2e-4b21-9b96-052ae9ecae1a None admin] RBAC: Authorizing `identity:get_group(group_id=0b8a77f30f714b91b7590c55195bd47c)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:34.080063 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb95e05-aa2e-4b21-9b96-052ae9ecae1a None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:34.086345 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 195/390] 10.222.0.32 () {56 vars in 1180 bytes} [Tue May 10 13:47:33 2022] GET /identity/v3/groups/0b8a77f30f714b91b7590c55195bd47c => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:34.088282 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb95e05-aa2e-4b21-9b96-052ae9ecae1a None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:34.195624 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb95e05-aa2e-4b21-9b96-052ae9ecae1a None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:34.231453 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b05f1-e5a7-42c3-9eae-97bde9766415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:34.233388 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b05f1-e5a7-42c3-9eae-97bde9766415 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:34.233813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b05f1-e5a7-42c3-9eae-97bde9766415 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:34.234239 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b05f1-e5a7-42c3-9eae-97bde9766415 None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:34.235674 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b05f1-e5a7-42c3-9eae-97bde9766415 None admin] RBAC: Authorizing `identity:get_project(project_id=03067c95202a44bbae7686a1a4886b44)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:34.237289 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b05f1-e5a7-42c3-9eae-97bde9766415 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:34.239121 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4cf49-ddd3-4994-9683-21ca9931c218 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:34.244007 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 196/391] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:34 2022] GET /identity/v3/projects/03067c95202a44bbae7686a1a4886b44 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:34.245481 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b05f1-e5a7-42c3-9eae-97bde9766415 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:34.300944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f08f8-6dcc-4510-9771-69a4ea456a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:34.302677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f08f8-6dcc-4510-9771-69a4ea456a21 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:34.303399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f08f8-6dcc-4510-9771-69a4ea456a21 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:34.304092 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f08f8-6dcc-4510-9771-69a4ea456a21 None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:34.306561 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f08f8-6dcc-4510-9771-69a4ea456a21 None admin] RBAC: Authorizing `identity:get_project(project_id=03067c95202a44bbae7686a1a4886b44)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:34.309566 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f08f8-6dcc-4510-9771-69a4ea456a21 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:34.313392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 196/392] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:34 2022] GET /identity/v3/projects/03067c95202a44bbae7686a1a4886b44 => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:34.323066 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f08f8-6dcc-4510-9771-69a4ea456a21 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:34.353383 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b05f1-e5a7-42c3-9eae-97bde9766415 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:34.391225 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e003d5b-4f06-47f2-829c-bc38742e8a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:34.392365 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e003d5b-4f06-47f2-829c-bc38742e8a8d None admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:34.392821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e003d5b-4f06-47f2-829c-bc38742e8a8d None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:34.393283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e003d5b-4f06-47f2-829c-bc38742e8a8d None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44/groups/0b8a77f30f714b91b7590c55195bd47c/roles/316da37136b4425f9ae486ae1e2bf4b4` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:34.395764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e003d5b-4f06-47f2-829c-bc38742e8a8d None admin] RBAC: Authorizing `identity:create_grant(project_id=03067c95202a44bbae7686a1a4886b44, group_id=0b8a77f30f714b91b7590c55195bd47c, role_id=316da37136b4425f9ae486ae1e2bf4b4)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:34.397423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e003d5b-4f06-47f2-829c-bc38742e8a8d None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:34.418305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 197/393] 10.222.0.32 () {58 vars in 1442 bytes} [Tue May 10 13:47:34 2022] PUT /identity/v3/projects/03067c95202a44bbae7686a1a4886b44/groups/0b8a77f30f714b91b7590c55195bd47c/roles/316da37136b4425f9ae486ae1e2bf4b4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 13:47:34.482842 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f08f8-6dcc-4510-9771-69a4ea456a21 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:34.532239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fb01c-0026-4e86-a27f-2c9c9505219a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:34.533705 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fb01c-0026-4e86-a27f-2c9c9505219a None admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:34.534147 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fb01c-0026-4e86-a27f-2c9c9505219a None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:34.534623 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fb01c-0026-4e86-a27f-2c9c9505219a None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44/groups/0b8a77f30f714b91b7590c55195bd47c/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:34.543336 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fb01c-0026-4e86-a27f-2c9c9505219a None admin] RBAC: Authorizing `identity:create_grant(project_id=03067c95202a44bbae7686a1a4886b44, group_id=0b8a77f30f714b91b7590c55195bd47c, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:34.546835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fb01c-0026-4e86-a27f-2c9c9505219a None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:34.571526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 197/394] 10.222.0.32 () {58 vars in 1442 bytes} [Tue May 10 13:47:34 2022] PUT /identity/v3/projects/03067c95202a44bbae7686a1a4886b44/groups/0b8a77f30f714b91b7590c55195bd47c/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 13:47:34.837367 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e729a05-ca7a-463f-9017-87c78429f8d3 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:34.838032 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e729a05-ca7a-463f-9017-87c78429f8d3 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:34.838574 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e729a05-ca7a-463f-9017-87c78429f8d3 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:34.840473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 198/395] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:34.847653 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041eac8-8a37-428a-b09b-8ab0c6453740 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:34.847939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041eac8-8a37-428a-b09b-8ab0c6453740 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:34.848215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041eac8-8a37-428a-b09b-8ab0c6453740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:34.874809 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-c041eac8-8a37-428a-b09b-8ab0c6453740 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:34.875988 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c041eac8-8a37-428a-b09b-8ab0c6453740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:34.954574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 198/396] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:34.979817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e729a05-ca7a-463f-9017-87c78429f8d3 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:35.143531 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e729a05-ca7a-463f-9017-87c78429f8d3 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:35.186450 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a36c5-b86b-4f7d-a93a-2c6d4bcfcbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:35.187626 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a36c5-b86b-4f7d-a93a-2c6d4bcfcbad None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:35.188107 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a36c5-b86b-4f7d-a93a-2c6d4bcfcbad None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:35.188576 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a36c5-b86b-4f7d-a93a-2c6d4bcfcbad None admin] PATH_INFO: `/v3/roles/member` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:35.211293 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a36c5-b86b-4f7d-a93a-2c6d4bcfcbad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:35.220748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-df1a36c5-b86b-4f7d-a93a-2c6d4bcfcbad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:35.220748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:35.220748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:35.220748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:35.220748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:35.220748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:35.220748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:35.220748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:35.220748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:35.220748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:35.220748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:35.220748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:35.220748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:35.220748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:35.220748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:35.220748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:35.221713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:35.221713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:35.221713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:35.221713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:35.221713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:35.221713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:35.221713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:35.221713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:35.221713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:35.221713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:35.221713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:35.221713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:35.221713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:35.221713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:35.221713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:35.221713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:35.222523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:35.222523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:35.222523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:35.222523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:35.222523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:35.222523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:35.222523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:35.222523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:35.222523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:35.222523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:35.222523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:35.222523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:35.225148 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 199/397] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:35.231735 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041eac8-8a37-428a-b09b-8ab0c6453740 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:35.268582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9a936-0ede-4c54-abde-28bef9d69fd2 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:35.269233 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9a936-0ede-4c54-abde-28bef9d69fd2 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:35.269712 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9a936-0ede-4c54-abde-28bef9d69fd2 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:35.271586 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 200/398] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:35.277389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2c860-c70e-488b-a392-328d7847b0f0 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:35.277958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2c860-c70e-488b-a392-328d7847b0f0 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:35.278500 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2c860-c70e-488b-a392-328d7847b0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:35.310920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-44b2c860-c70e-488b-a392-328d7847b0f0 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:35.313495 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-44b2c860-c70e-488b-a392-328d7847b0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:35.359204 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041eac8-8a37-428a-b09b-8ab0c6453740 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:35.403178 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725e1d1-78cf-440e-857c-34c96cfbb38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:35.405211 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725e1d1-78cf-440e-857c-34c96cfbb38d None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:35.405891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725e1d1-78cf-440e-857c-34c96cfbb38d None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:35.406615 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725e1d1-78cf-440e-857c-34c96cfbb38d None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:35.408507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725e1d1-78cf-440e-857c-34c96cfbb38d None admin] RBAC: Adding query filter params (name=member) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:35.409267 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725e1d1-78cf-440e-857c-34c96cfbb38d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:35.411965 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725e1d1-78cf-440e-857c-34c96cfbb38d None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:35.429470 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 199/399] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:47:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:35.434900 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725e1d1-78cf-440e-857c-34c96cfbb38d None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:35.489734 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 201/400] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:47:35.526001 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2c860-c70e-488b-a392-328d7847b0f0 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:35.631935 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725e1d1-78cf-440e-857c-34c96cfbb38d None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:35.651626 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2c860-c70e-488b-a392-328d7847b0f0 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:35.681193 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68623497-1af1-4bdd-bdf5-caf528a5a0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:35.682315 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68623497-1af1-4bdd-bdf5-caf528a5a0f1 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:35.682733 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68623497-1af1-4bdd-bdf5-caf528a5a0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:35.683166 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68623497-1af1-4bdd-bdf5-caf528a5a0f1 None admin] PATH_INFO: `/v3/groups/0b8a77f30f714b91b7590c55195bd47c` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:35.684526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68623497-1af1-4bdd-bdf5-caf528a5a0f1 None admin] RBAC: Authorizing `identity:get_group(group_id=0b8a77f30f714b91b7590c55195bd47c)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:35.687156 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68623497-1af1-4bdd-bdf5-caf528a5a0f1 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:35.693268 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 200/401] 10.222.0.32 () {56 vars in 1180 bytes} [Tue May 10 13:47:35 2022] GET /identity/v3/groups/0b8a77f30f714b91b7590c55195bd47c => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:35.695664 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5320262-aa07-4025-ad99-0c38f2483917 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:35.695954 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5320262-aa07-4025-ad99-0c38f2483917 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:35.696238 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5320262-aa07-4025-ad99-0c38f2483917 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:35.697795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 201/402] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:35.698342 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5320262-aa07-4025-ad99-0c38f2483917 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:35.701537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585daa9-8515-4be8-b5da-b4e52a9cd255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:35.702841 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585daa9-8515-4be8-b5da-b4e52a9cd255 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:35.703099 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585daa9-8515-4be8-b5da-b4e52a9cd255 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:35.703376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585daa9-8515-4be8-b5da-b4e52a9cd255 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:35.723757 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585daa9-8515-4be8-b5da-b4e52a9cd255 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:35.735688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-6585daa9-8515-4be8-b5da-b4e52a9cd255 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:47:35.735688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:35.735688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:35.735688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:35.735688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:35.735688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:35.735688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:35.735688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:35.735688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:35.735688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:35.735688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:35.735688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:35.735688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:35.735688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:35.735688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:35.735688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:35.736618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:35.736618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:35.736618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:35.736618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:35.736618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:35.736618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:35.736618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:35.736618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:35.736618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:35.736618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:35.736618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:35.736618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:35.736618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:35.736618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:35.736618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:35.736618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:35.737390 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:35.737390 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:35.737390 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:35.737390 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:35.737390 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:35.737390 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:35.737390 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:35.737390 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:35.737390 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:35.737390 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:35.737390 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:47:35.737390 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:35.740421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 202/403] 10.222.0.32 () {56 vars in 1114 bytes} [Tue May 10 13:47:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:35.742218 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8934ee-fdac-47d0-990c-49ffc46d49fe None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:35.742723 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8934ee-fdac-47d0-990c-49ffc46d49fe None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:35.743205 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8934ee-fdac-47d0-990c-49ffc46d49fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:35.764557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-8e8934ee-fdac-47d0-990c-49ffc46d49fe None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:35.766637 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-8e8934ee-fdac-47d0-990c-49ffc46d49fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:35.846767 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5320262-aa07-4025-ad99-0c38f2483917 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:35.869894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 203/404] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:35.869894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8934ee-fdac-47d0-990c-49ffc46d49fe None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:35.910454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775e3d3-e22e-436e-a6fa-0cbb31d5e4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:35.911383 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775e3d3-e22e-436e-a6fa-0cbb31d5e4a9 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:35.911945 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775e3d3-e22e-436e-a6fa-0cbb31d5e4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:35.912406 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775e3d3-e22e-436e-a6fa-0cbb31d5e4a9 None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:35.913760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775e3d3-e22e-436e-a6fa-0cbb31d5e4a9 None admin] RBAC: Authorizing `identity:get_project(project_id=ec7d549ce6b14f7f8c85bf895eebadac)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:35.915380 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775e3d3-e22e-436e-a6fa-0cbb31d5e4a9 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:35.917243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 202/405] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:35 2022] GET /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:35.918143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775e3d3-e22e-436e-a6fa-0cbb31d5e4a9 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:36.031263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8934ee-fdac-47d0-990c-49ffc46d49fe None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:36.043146 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775e3d3-e22e-436e-a6fa-0cbb31d5e4a9 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:36.074089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf4d5e-1101-49bf-8252-d49a61ca06c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:36.075042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf4d5e-1101-49bf-8252-d49a61ca06c9 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:36.075327 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf4d5e-1101-49bf-8252-d49a61ca06c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:36.076127 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf4d5e-1101-49bf-8252-d49a61ca06c9 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:36.077533 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf4d5e-1101-49bf-8252-d49a61ca06c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:36.077848 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf4d5e-1101-49bf-8252-d49a61ca06c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:36.079901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf4d5e-1101-49bf-8252-d49a61ca06c9 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:36.083206 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35ebeb-3c58-413e-85c0-a7ce8dd161b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:36.084253 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35ebeb-3c58-413e-85c0-a7ce8dd161b7 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:36.084734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35ebeb-3c58-413e-85c0-a7ce8dd161b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:36.085196 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35ebeb-3c58-413e-85c0-a7ce8dd161b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:36.088652 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 204/406] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:47:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:36.089478 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf4d5e-1101-49bf-8252-d49a61ca06c9 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:36.099672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35ebeb-3c58-413e-85c0-a7ce8dd161b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:36.111382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-bb35ebeb-3c58-413e-85c0-a7ce8dd161b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:36.111382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:36.111382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:36.111382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:36.111382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:36.111382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:36.111382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:36.111382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:36.111382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:36.111382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:36.111382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:36.111382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:36.111382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:36.111382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:36.111382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:36.111382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:36.112354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:36.112354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:36.112354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:36.112354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:36.112354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:36.112354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:36.112354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:36.112354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:36.112354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:36.112354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:36.112354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:36.112354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:36.112354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:36.112354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:36.112354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:36.112354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:36.113143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:36.113143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:36.113143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:36.113143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:36.113143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:36.113143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:36.113143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:36.113143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:36.113143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:36.113143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:36.113143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:36.113143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:36.115637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 203/407] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:47:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:36.116816 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35ebeb-3c58-413e-85c0-a7ce8dd161b7 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:36.209402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf4d5e-1101-49bf-8252-d49a61ca06c9 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:36.255909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98baa54-c5d4-4694-86ba-837b132ada54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:36.257060 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98baa54-c5d4-4694-86ba-837b132ada54 None admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:36.257461 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98baa54-c5d4-4694-86ba-837b132ada54 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:36.257851 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98baa54-c5d4-4694-86ba-837b132ada54 None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac/groups/0b8a77f30f714b91b7590c55195bd47c/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:36.260028 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98baa54-c5d4-4694-86ba-837b132ada54 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec7d549ce6b14f7f8c85bf895eebadac, group_id=0b8a77f30f714b91b7590c55195bd47c, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:36.260150 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35ebeb-3c58-413e-85c0-a7ce8dd161b7 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:36.262565 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98baa54-c5d4-4694-86ba-837b132ada54 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:36.284459 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 205/408] 10.222.0.32 () {58 vars in 1442 bytes} [Tue May 10 13:47:36 2022] PUT /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac/groups/0b8a77f30f714b91b7590c55195bd47c/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:47:36.285564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98baa54-c5d4-4694-86ba-837b132ada54 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:36.328902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47224db9-139c-4b46-a8b3-42440893b448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:36.330097 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47224db9-139c-4b46-a8b3-42440893b448 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:36.330567 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47224db9-139c-4b46-a8b3-42440893b448 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:36.331052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47224db9-139c-4b46-a8b3-42440893b448 None admin] PATH_INFO: `/v3/groups/0b8a77f30f714b91b7590c55195bd47c` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:36.332591 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47224db9-139c-4b46-a8b3-42440893b448 None admin] RBAC: Authorizing `identity:get_group(group_id=0b8a77f30f714b91b7590c55195bd47c)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:36.334332 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47224db9-139c-4b46-a8b3-42440893b448 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:36.336273 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 204/409] 10.222.0.32 () {56 vars in 1180 bytes} [Tue May 10 13:47:36 2022] GET /identity/v3/groups/0b8a77f30f714b91b7590c55195bd47c => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:36.344786 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47224db9-139c-4b46-a8b3-42440893b448 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:36.467369 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98baa54-c5d4-4694-86ba-837b132ada54 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:36.532553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b60641-30a0-4d76-b635-6d818e706988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:36.533721 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b60641-30a0-4d76-b635-6d818e706988 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:36.534245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b60641-30a0-4d76-b635-6d818e706988 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:36.534981 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b60641-30a0-4d76-b635-6d818e706988 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:36.536161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b60641-30a0-4d76-b635-6d818e706988 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:36.536479 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b60641-30a0-4d76-b635-6d818e706988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:36.538960 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b60641-30a0-4d76-b635-6d818e706988 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:36.556165 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 206/410] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:36.565674 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b60641-30a0-4d76-b635-6d818e706988 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:36.570480 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47224db9-139c-4b46-a8b3-42440893b448 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:36.644303 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e0cca-3267-4ac9-8116-58e95c51182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:36.645490 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e0cca-3267-4ac9-8116-58e95c51182b None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:36.645906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e0cca-3267-4ac9-8116-58e95c51182b None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:36.646375 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e0cca-3267-4ac9-8116-58e95c51182b None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:36.647857 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e0cca-3267-4ac9-8116-58e95c51182b None admin] RBAC: Authorizing `identity:get_project(project_id=ec7d549ce6b14f7f8c85bf895eebadac)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:36.649527 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e0cca-3267-4ac9-8116-58e95c51182b None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:36.652100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 205/411] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:36 2022] GET /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:36.660242 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e0cca-3267-4ac9-8116-58e95c51182b None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:36.770672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e0cca-3267-4ac9-8116-58e95c51182b None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:36.807807 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aed317-7f9c-41b1-888d-124c6a6a63d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:36.808608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b60641-30a0-4d76-b635-6d818e706988 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:36.809185 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aed317-7f9c-41b1-888d-124c6a6a63d4 None admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:36.809607 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aed317-7f9c-41b1-888d-124c6a6a63d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:36.810661 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aed317-7f9c-41b1-888d-124c6a6a63d4 None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac/groups/0b8a77f30f714b91b7590c55195bd47c/roles/316da37136b4425f9ae486ae1e2bf4b4` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:36.813244 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aed317-7f9c-41b1-888d-124c6a6a63d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec7d549ce6b14f7f8c85bf895eebadac, group_id=0b8a77f30f714b91b7590c55195bd47c, role_id=316da37136b4425f9ae486ae1e2bf4b4)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:36.814935 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aed317-7f9c-41b1-888d-124c6a6a63d4 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:36.847330 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 206/412] 10.222.0.32 () {58 vars in 1442 bytes} [Tue May 10 13:47:36 2022] PUT /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac/groups/0b8a77f30f714b91b7590c55195bd47c/roles/316da37136b4425f9ae486ae1e2bf4b4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 13:47:36.873702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a6f84-625c-4c71-8c44-ce7842192859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:36.874618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a6f84-625c-4c71-8c44-ce7842192859 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:36.874936 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a6f84-625c-4c71-8c44-ce7842192859 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:36.875224 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a6f84-625c-4c71-8c44-ce7842192859 None admin] PATH_INFO: `/v3/groups/997c2677b3d1445e925c67ec44a0a059` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:36.876641 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a6f84-625c-4c71-8c44-ce7842192859 None admin] RBAC: Authorizing `identity:get_group(group_id=997c2677b3d1445e925c67ec44a0a059)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:36.878179 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a6f84-625c-4c71-8c44-ce7842192859 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:36.880386 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 207/413] 10.222.0.32 () {56 vars in 1180 bytes} [Tue May 10 13:47:36 2022] GET /identity/v3/groups/997c2677b3d1445e925c67ec44a0a059 => generated 229 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:36.886045 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aed317-7f9c-41b1-888d-124c6a6a63d4 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:37.030652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aed317-7f9c-41b1-888d-124c6a6a63d4 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:37.084042 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34b642-0ed4-4835-bf1c-8175adff2bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:37.084854 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34b642-0ed4-4835-bf1c-8175adff2bcd None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:37.085134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34b642-0ed4-4835-bf1c-8175adff2bcd None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:37.085410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34b642-0ed4-4835-bf1c-8175adff2bcd None admin] PATH_INFO: `/v3/projects/a83c1c4876b14f72a0e3d2113130a776` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:37.086664 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34b642-0ed4-4835-bf1c-8175adff2bcd None admin] RBAC: Authorizing `identity:get_project(project_id=a83c1c4876b14f72a0e3d2113130a776)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:37.088132 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34b642-0ed4-4835-bf1c-8175adff2bcd None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:37.090260 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 207/414] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:36 2022] GET /identity/v3/projects/a83c1c4876b14f72a0e3d2113130a776 => generated 344 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:37.097090 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a6f84-625c-4c71-8c44-ce7842192859 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:37.221063 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a6f84-625c-4c71-8c44-ce7842192859 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:37.262828 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5024ff-32c5-4c8f-836a-71b230c01653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:37.264545 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5024ff-32c5-4c8f-836a-71b230c01653 None admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:37.264826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5024ff-32c5-4c8f-836a-71b230c01653 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:37.265103 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5024ff-32c5-4c8f-836a-71b230c01653 None admin] PATH_INFO: `/v3/projects/a83c1c4876b14f72a0e3d2113130a776/groups/997c2677b3d1445e925c67ec44a0a059/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:37.267361 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5024ff-32c5-4c8f-836a-71b230c01653 None admin] RBAC: Authorizing `identity:create_grant(project_id=a83c1c4876b14f72a0e3d2113130a776, group_id=997c2677b3d1445e925c67ec44a0a059, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:37.268860 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5024ff-32c5-4c8f-836a-71b230c01653 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:37.286572 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 208/415] 10.222.0.32 () {58 vars in 1442 bytes} [Tue May 10 13:47:37 2022] PUT /identity/v3/projects/a83c1c4876b14f72a0e3d2113130a776/groups/997c2677b3d1445e925c67ec44a0a059/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:47:37.463209 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583d580-ed03-4788-b732-c3f5b698acac None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:37.463880 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583d580-ed03-4788-b732-c3f5b698acac None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:37.463880 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583d580-ed03-4788-b732-c3f5b698acac None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:37.465563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 208/416] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:37.471881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84677678-066d-4674-883d-03476f16fd33 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:37.472274 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84677678-066d-4674-883d-03476f16fd33 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:37.472447 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84677678-066d-4674-883d-03476f16fd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:37.495519 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-84677678-066d-4674-883d-03476f16fd33 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:37.496805 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-84677678-066d-4674-883d-03476f16fd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:37.599511 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 209/417] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:37.625458 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583d580-ed03-4788-b732-c3f5b698acac None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:37.769134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583d580-ed03-4788-b732-c3f5b698acac None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:37.819399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c01361-edb5-4535-b005-5b9c79ae92d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:37.820294 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c01361-edb5-4535-b005-5b9c79ae92d1 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:37.820574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c01361-edb5-4535-b005-5b9c79ae92d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:37.820895 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c01361-edb5-4535-b005-5b9c79ae92d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:37.839274 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c01361-edb5-4535-b005-5b9c79ae92d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:37.847791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-c7c01361-edb5-4535-b005-5b9c79ae92d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:47:37.847791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:37.847791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:37.847791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:37.847791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:37.847791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:37.847791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:37.847791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:37.847791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:37.847791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:37.847791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:37.847791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:37.847791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:37.847791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:37.847791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:37.847791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:37.848692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:37.848692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:37.848692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:37.848692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:37.848692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:37.848692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:37.848692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:37.848692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:37.848692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:37.848692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:37.848692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:37.848692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:37.848692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:37.848692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:37.848692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:37.848692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:37.849487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:37.849487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:37.849487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:37.849487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:37.849487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:37.849487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:37.849487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:37.849487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:37.849487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:37.849487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:37.849487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:47:37.849487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:37.849487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 209/418] 10.222.0.32 () {56 vars in 1114 bytes} [Tue May 10 13:47:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:37.858245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84677678-066d-4674-883d-03476f16fd33 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:37.887864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95a43f-1b7f-4873-8378-cfa381b333ec None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:37.888451 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95a43f-1b7f-4873-8378-cfa381b333ec None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:37.888831 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95a43f-1b7f-4873-8378-cfa381b333ec None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:37.890659 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 210/419] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:37.896677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b4796-04cc-4d7a-be8c-6b50e6b27446 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:37.897180 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b4796-04cc-4d7a-be8c-6b50e6b27446 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:37.897626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b4796-04cc-4d7a-be8c-6b50e6b27446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:37.932474 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-681b4796-04cc-4d7a-be8c-6b50e6b27446 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:37.934111 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-681b4796-04cc-4d7a-be8c-6b50e6b27446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:38.026379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84677678-066d-4674-883d-03476f16fd33 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:38.081447 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5740fc-39a0-4e5c-9a65-96594a5d6085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:38.082567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5740fc-39a0-4e5c-9a65-96594a5d6085 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:38.083063 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5740fc-39a0-4e5c-9a65-96594a5d6085 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:38.083537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5740fc-39a0-4e5c-9a65-96594a5d6085 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:38.084528 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5740fc-39a0-4e5c-9a65-96594a5d6085 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:38.087145 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5740fc-39a0-4e5c-9a65-96594a5d6085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:38.088836 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5740fc-39a0-4e5c-9a65-96594a5d6085 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:38.113834 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 210/420] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:47:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:38.123669 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5740fc-39a0-4e5c-9a65-96594a5d6085 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:38.128267 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 211/421] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:38.165682 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b4796-04cc-4d7a-be8c-6b50e6b27446 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:38.344460 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5740fc-39a0-4e5c-9a65-96594a5d6085 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:38.374179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b4796-04cc-4d7a-be8c-6b50e6b27446 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:38.407034 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13b0c6-3f42-4aae-b3be-5040d4a29b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:38.408069 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13b0c6-3f42-4aae-b3be-5040d4a29b6c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:38.408601 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13b0c6-3f42-4aae-b3be-5040d4a29b6c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:38.409131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13b0c6-3f42-4aae-b3be-5040d4a29b6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:38.456777 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede5470-4eaa-46e3-9c4b-2b671ee2ec3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:38.457956 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede5470-4eaa-46e3-9c4b-2b671ee2ec3f None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:38.458468 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede5470-4eaa-46e3-9c4b-2b671ee2ec3f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:38.458941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede5470-4eaa-46e3-9c4b-2b671ee2ec3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:38.484735 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede5470-4eaa-46e3-9c4b-2b671ee2ec3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:38.493749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-2ede5470-4eaa-46e3-9c4b-2b671ee2ec3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:38.493749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:38.493749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:38.493749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:38.493749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:38.493749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:38.493749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:38.493749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:38.493749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:38.493749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:38.493749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:38.493749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:38.493749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:38.493749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:38.493749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:38.493749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:38.494675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:38.494675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:38.494675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:38.494675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:38.494675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:38.494675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:38.494675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:38.494675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:38.494675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:38.494675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:38.494675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:38.494675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:38.494675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:38.494675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:38.494675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:38.494675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:38.495469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:38.495469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:38.495469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:38.495469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:38.495469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:38.495469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:38.495469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:38.495469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:38.495469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:38.495469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:38.495469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:38.495469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:38.500495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 212/422] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:38.507586 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede5470-4eaa-46e3-9c4b-2b671ee2ec3f None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:38.568956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13b0c6-3f42-4aae-b3be-5040d4a29b6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:38.571020 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13b0c6-3f42-4aae-b3be-5040d4a29b6c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:38.656346 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede5470-4eaa-46e3-9c4b-2b671ee2ec3f None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:38.703914 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79fb38-aeaa-4784-9ff7-5020fbf291cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:38.704613 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79fb38-aeaa-4784-9ff7-5020fbf291cd None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:38.704896 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79fb38-aeaa-4784-9ff7-5020fbf291cd None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:38.705177 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79fb38-aeaa-4784-9ff7-5020fbf291cd None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:38.705940 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79fb38-aeaa-4784-9ff7-5020fbf291cd None admin] RBAC: Adding query filter params (name=member) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:38.706280 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79fb38-aeaa-4784-9ff7-5020fbf291cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:38.707741 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79fb38-aeaa-4784-9ff7-5020fbf291cd None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:38.708220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 211/423] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:38.716203 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13b0c6-3f42-4aae-b3be-5040d4a29b6c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:38.717590 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 213/424] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:47:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:38.739569 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79fb38-aeaa-4784-9ff7-5020fbf291cd None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:38.930073 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13b0c6-3f42-4aae-b3be-5040d4a29b6c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:38.995723 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79fb38-aeaa-4784-9ff7-5020fbf291cd None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:39.002826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3390550-0398-423d-81a9-bd3151118387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:39.003955 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3390550-0398-423d-81a9-bd3151118387 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:39.004380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3390550-0398-423d-81a9-bd3151118387 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:39.004793 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3390550-0398-423d-81a9-bd3151118387 None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:39.011067 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3390550-0398-423d-81a9-bd3151118387 None admin] RBAC: Authorizing `identity:get_project(project_id=03067c95202a44bbae7686a1a4886b44)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:39.012768 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3390550-0398-423d-81a9-bd3151118387 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:39.015853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 212/425] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:38 2022] GET /identity/v3/projects/03067c95202a44bbae7686a1a4886b44 => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:39.023600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3390550-0398-423d-81a9-bd3151118387 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:39.035412 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de16ad-3991-4b5b-b269-20766b5cba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:39.036100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de16ad-3991-4b5b-b269-20766b5cba16 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:39.036382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de16ad-3991-4b5b-b269-20766b5cba16 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:39.041457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de16ad-3991-4b5b-b269-20766b5cba16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:39.180695 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de16ad-3991-4b5b-b269-20766b5cba16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:39.182101 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de16ad-3991-4b5b-b269-20766b5cba16 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:39.265433 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3390550-0398-423d-81a9-bd3151118387 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:39.327123 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 214/426] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 13:47:39.338298 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de16ad-3991-4b5b-b269-20766b5cba16 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:39.350608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330edfaa-2685-4810-a99b-fbdfff2fb271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:39.351594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330edfaa-2685-4810-a99b-fbdfff2fb271 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:39.351827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330edfaa-2685-4810-a99b-fbdfff2fb271 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:39.352080 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330edfaa-2685-4810-a99b-fbdfff2fb271 None admin] PATH_INFO: `/v3/groups/0b8a77f30f714b91b7590c55195bd47c` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:39.359104 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330edfaa-2685-4810-a99b-fbdfff2fb271 None admin] RBAC: Authorizing `identity:get_group(group_id=0b8a77f30f714b91b7590c55195bd47c)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:39.360623 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330edfaa-2685-4810-a99b-fbdfff2fb271 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:39.362920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 213/427] 10.222.0.32 () {56 vars in 1180 bytes} [Tue May 10 13:47:39 2022] GET /identity/v3/groups/0b8a77f30f714b91b7590c55195bd47c => generated 226 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:39.368218 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330edfaa-2685-4810-a99b-fbdfff2fb271 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:39.443031 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de16ad-3991-4b5b-b269-20766b5cba16 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:39.476985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330edfaa-2685-4810-a99b-fbdfff2fb271 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:39.487948 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d7cdf-201c-4fa7-b80f-e69c6062ef3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:39.488810 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d7cdf-201c-4fa7-b80f-e69c6062ef3c None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:39.489098 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d7cdf-201c-4fa7-b80f-e69c6062ef3c None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:39.494228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d7cdf-201c-4fa7-b80f-e69c6062ef3c None admin] PATH_INFO: `/v3/projects/03067c95202a44bbae7686a1a4886b44` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:39.494228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d7cdf-201c-4fa7-b80f-e69c6062ef3c None admin] RBAC: Authorizing `identity:get_project(project_id=03067c95202a44bbae7686a1a4886b44)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:39.494228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d7cdf-201c-4fa7-b80f-e69c6062ef3c None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:39.496830 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 215/428] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:39 2022] GET /identity/v3/projects/03067c95202a44bbae7686a1a4886b44 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:39.501555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d7cdf-201c-4fa7-b80f-e69c6062ef3c None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:39.536042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a50f58-ede9-410d-a7fa-ced9d8a7753c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:39.536728 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a50f58-ede9-410d-a7fa-ced9d8a7753c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:39.537008 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a50f58-ede9-410d-a7fa-ced9d8a7753c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:39.537278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a50f58-ede9-410d-a7fa-ced9d8a7753c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:39.538121 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a50f58-ede9-410d-a7fa-ced9d8a7753c None admin] RBAC: Adding query filter params (group.id=0b8a77f30f714b91b7590c55195bd47c, role.id=316da37136b4425f9ae486ae1e2bf4b4, scope.project.id=03067c95202a44bbae7686a1a4886b44) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:39.538454 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a50f58-ede9-410d-a7fa-ced9d8a7753c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:39.539888 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a50f58-ede9-410d-a7fa-ced9d8a7753c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:39.554002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 214/429] 10.222.0.32 () {56 vars in 1376 bytes} [Tue May 10 13:47:39 2022] GET /identity/v3/role_assignments?group.id=0b8a77f30f714b91b7590c55195bd47c&scope.project.id=03067c95202a44bbae7686a1a4886b44&role.id=316da37136b4425f9ae486ae1e2bf4b4 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:39.556655 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6b249-69b2-40d7-8279-8baaab31302e None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:39.557231 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6b249-69b2-40d7-8279-8baaab31302e None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:39.557719 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6b249-69b2-40d7-8279-8baaab31302e None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:39.559723 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 215/430] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:39.565853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1d3df-2765-43f4-a91f-fb5889bfcb8f None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:39.566130 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1d3df-2765-43f4-a91f-fb5889bfcb8f None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:39.566627 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1d3df-2765-43f4-a91f-fb5889bfcb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:39.603395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-efc1d3df-2765-43f4-a91f-fb5889bfcb8f None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:39.604857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-efc1d3df-2765-43f4-a91f-fb5889bfcb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:39.622844 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d7cdf-201c-4fa7-b80f-e69c6062ef3c None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:39.666539 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d5cdb-148f-491e-97b2-e458e5f496d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:39.667813 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d5cdb-148f-491e-97b2-e458e5f496d4 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:39.668301 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d5cdb-148f-491e-97b2-e458e5f496d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:39.669024 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d5cdb-148f-491e-97b2-e458e5f496d4 None admin] PATH_INFO: `/v3/groups/0b8a77f30f714b91b7590c55195bd47c` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:39.673467 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d5cdb-148f-491e-97b2-e458e5f496d4 None admin] RBAC: Authorizing `identity:get_group(group_id=0b8a77f30f714b91b7590c55195bd47c)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:39.675515 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d5cdb-148f-491e-97b2-e458e5f496d4 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:39.678435 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 216/431] 10.222.0.32 () {56 vars in 1180 bytes} [Tue May 10 13:47:39 2022] GET /identity/v3/groups/0b8a77f30f714b91b7590c55195bd47c => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:39.691114 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d5cdb-148f-491e-97b2-e458e5f496d4 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:39.768319 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 216/432] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:39.820883 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1d3df-2765-43f4-a91f-fb5889bfcb8f None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:39.865536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d5cdb-148f-491e-97b2-e458e5f496d4 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:39.918925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b9f4a-c45a-422b-ab8d-c06a3e1cf0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:39.920024 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b9f4a-c45a-422b-ab8d-c06a3e1cf0ba None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:39.920489 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b9f4a-c45a-422b-ab8d-c06a3e1cf0ba None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:39.920961 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b9f4a-c45a-422b-ab8d-c06a3e1cf0ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:39.922725 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b9f4a-c45a-422b-ab8d-c06a3e1cf0ba None admin] RBAC: Adding query filter params (group.id=0b8a77f30f714b91b7590c55195bd47c, role.id=34ef75b7c6d54c5e81edbfee2f4b362d, scope.project.id=03067c95202a44bbae7686a1a4886b44) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:39.923483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b9f4a-c45a-422b-ab8d-c06a3e1cf0ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:39.926100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b9f4a-c45a-422b-ab8d-c06a3e1cf0ba None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:39.934189 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 217/433] 10.222.0.32 () {56 vars in 1376 bytes} [Tue May 10 13:47:39 2022] GET /identity/v3/role_assignments?group.id=0b8a77f30f714b91b7590c55195bd47c&scope.project.id=03067c95202a44bbae7686a1a4886b44&role.id=34ef75b7c6d54c5e81edbfee2f4b362d => generated 611 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:39.964442 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1d3df-2765-43f4-a91f-fb5889bfcb8f None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:40.004054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b2a4e-eccd-4e36-81be-ae8cb02bac61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:40.005255 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b2a4e-eccd-4e36-81be-ae8cb02bac61 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:40.005736 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b2a4e-eccd-4e36-81be-ae8cb02bac61 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:40.006231 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b2a4e-eccd-4e36-81be-ae8cb02bac61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:40.020253 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b2a4e-eccd-4e36-81be-ae8cb02bac61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:40.029615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-a03b2a4e-eccd-4e36-81be-ae8cb02bac61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:40.029615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:40.029615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:40.029615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:40.029615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:40.029615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:40.029615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:40.029615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:40.029615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:40.029615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:40.029615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:40.029615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:40.029615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:40.029615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:40.029615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:40.029615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:40.030595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:40.030595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:40.030595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:40.030595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:40.030595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:40.030595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:40.030595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:40.030595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:40.030595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:40.030595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:40.030595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:40.030595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:40.030595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:40.030595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:40.030595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:40.030595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:40.031374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:40.031374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:40.031374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:40.031374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:40.031374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:40.031374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:40.031374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:40.031374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:40.031374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:40.031374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:40.031374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:47:40.031374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:40.037278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 217/434] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:40.041558 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b9f4a-c45a-422b-ab8d-c06a3e1cf0ba None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:40.178587 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b9f4a-c45a-422b-ab8d-c06a3e1cf0ba None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:40.219407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373004c-5dfc-4e7c-aa20-8936c2b7463a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:40.220106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373004c-5dfc-4e7c-aa20-8936c2b7463a None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:40.220394 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373004c-5dfc-4e7c-aa20-8936c2b7463a None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:40.220672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373004c-5dfc-4e7c-aa20-8936c2b7463a None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:40.221453 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373004c-5dfc-4e7c-aa20-8936c2b7463a None admin] RBAC: Adding query filter params (name=member) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:40.221863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373004c-5dfc-4e7c-aa20-8936c2b7463a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:40.223438 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373004c-5dfc-4e7c-aa20-8936c2b7463a None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:40.235059 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 218/435] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:47:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:40.240759 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b2a4e-eccd-4e36-81be-ae8cb02bac61 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:40.246905 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33dd13-a45b-4535-ada2-4b7545f1387c None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:40.247226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33dd13-a45b-4535-ada2-4b7545f1387c None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:40.247776 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33dd13-a45b-4535-ada2-4b7545f1387c None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:40.249855 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 219/436] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:40.257041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d57995-f110-4d9b-b83c-df5a4eac7973 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:40.257372 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d57995-f110-4d9b-b83c-df5a4eac7973 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:40.257600 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d57995-f110-4d9b-b83c-df5a4eac7973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:40.278145 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-93d57995-f110-4d9b-b83c-df5a4eac7973 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:40.279542 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-93d57995-f110-4d9b-b83c-df5a4eac7973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:40.373075 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 220/437] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:40.376012 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b746f4-e810-492b-8337-4bd70dcabbad None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:40.376315 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b746f4-e810-492b-8337-4bd70dcabbad None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:40.376566 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b746f4-e810-492b-8337-4bd70dcabbad None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:40.377886 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 221/438] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:40.383689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79683e5e-ca0e-42c9-9aa8-faca429c12ef None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:40.383961 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79683e5e-ca0e-42c9-9aa8-faca429c12ef None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:40.384236 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79683e5e-ca0e-42c9-9aa8-faca429c12ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:40.402639 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-79683e5e-ca0e-42c9-9aa8-faca429c12ef None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:40.404409 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-79683e5e-ca0e-42c9-9aa8-faca429c12ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:40.406762 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b2a4e-eccd-4e36-81be-ae8cb02bac61 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:40.449942 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346e634-39ae-4ef9-beeb-08505a3d490c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:40.450679 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346e634-39ae-4ef9-beeb-08505a3d490c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:40.451797 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346e634-39ae-4ef9-beeb-08505a3d490c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:40.451797 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346e634-39ae-4ef9-beeb-08505a3d490c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:40.487833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 222/439] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:47:40.488742 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79683e5e-ca0e-42c9-9aa8-faca429c12ef None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:40.552301 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346e634-39ae-4ef9-beeb-08505a3d490c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:40.554099 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346e634-39ae-4ef9-beeb-08505a3d490c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:40.632918 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79683e5e-ca0e-42c9-9aa8-faca429c12ef None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:40.671415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0cd44-2bdf-4a8d-ada1-b532c17eb603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:40.672239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0cd44-2bdf-4a8d-ada1-b532c17eb603 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:40.672519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0cd44-2bdf-4a8d-ada1-b532c17eb603 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:40.672793 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0cd44-2bdf-4a8d-ada1-b532c17eb603 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:40.680177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 218/440] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:40.685723 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346e634-39ae-4ef9-beeb-08505a3d490c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:40.685841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0cd44-2bdf-4a8d-ada1-b532c17eb603 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:40.693215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-8df0cd44-2bdf-4a8d-ada1-b532c17eb603 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:47:40.693215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:40.693215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:40.693215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:40.693215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:40.693215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:40.693215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:40.693215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:40.693215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:40.693215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:40.693215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:40.693215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:40.693215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:40.693215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:40.693215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:40.693215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:40.694183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:40.694183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:40.694183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:40.694183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:40.694183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:40.694183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:40.694183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:40.694183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:40.694183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:40.694183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:40.694183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:40.694183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:40.694183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:40.694183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:40.694183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:40.694183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:40.695006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:40.695006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:40.695006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:40.695006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:40.695006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:40.695006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:40.695006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:40.695006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:40.695006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:40.695006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:40.695006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:47:40.695006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:40.695006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 223/441] 10.222.0.32 () {56 vars in 1114 bytes} [Tue May 10 13:47:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:40.695632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0cd44-2bdf-4a8d-ada1-b532c17eb603 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:40.799738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346e634-39ae-4ef9-beeb-08505a3d490c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:40.810914 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0cd44-2bdf-4a8d-ada1-b532c17eb603 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:40.835066 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d1e12-a7cc-414b-a458-4326ff867dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:40.835865 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d1e12-a7cc-414b-a458-4326ff867dfb None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:40.836152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d1e12-a7cc-414b-a458-4326ff867dfb None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:40.836426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d1e12-a7cc-414b-a458-4326ff867dfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:40.848325 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d1e12-a7cc-414b-a458-4326ff867dfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:40.848836 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb881b23-75ab-458b-b3c1-f6740d74f368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:40.849705 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb881b23-75ab-458b-b3c1-f6740d74f368 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:40.849985 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb881b23-75ab-458b-b3c1-f6740d74f368 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:40.850323 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb881b23-75ab-458b-b3c1-f6740d74f368 None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:40.851531 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb881b23-75ab-458b-b3c1-f6740d74f368 None admin] RBAC: Authorizing `identity:get_project(project_id=ec7d549ce6b14f7f8c85bf895eebadac)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:40.853011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb881b23-75ab-458b-b3c1-f6740d74f368 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:40.856296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-410d1e12-a7cc-414b-a458-4326ff867dfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:40.856296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:40.856296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:40.856296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:40.856296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:40.856296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:40.856296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:40.856296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:40.856296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:40.856296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:40.856296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:40.856296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:40.856296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:40.856296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:40.856296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:40.856296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:40.857584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:40.857584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:40.857584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:40.857584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:40.857584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:40.857584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:40.857584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:40.857584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:40.857584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:40.857584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:40.857584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:40.857584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:40.857584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:40.857584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:40.857584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:40.857584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:40.858652 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:40.858652 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:40.858652 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:40.858652 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:40.858652 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:40.858652 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:40.858652 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:40.858652 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:40.858652 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:40.858652 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:40.858652 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:40.858652 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:40.858652 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 219/442] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:47:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:40.860062 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d1e12-a7cc-414b-a458-4326ff867dfb None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:40.860129 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 224/443] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:40 2022] GET /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:40.860568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb881b23-75ab-458b-b3c1-f6740d74f368 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:40.963598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb881b23-75ab-458b-b3c1-f6740d74f368 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:40.965008 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d1e12-a7cc-414b-a458-4326ff867dfb None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:40.997666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25665d39-f429-4952-bad6-7be08963eef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:40.998594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25665d39-f429-4952-bad6-7be08963eef4 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:40.998745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa380a0c-47fd-433e-8920-1f24b2d00010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:40.998853 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25665d39-f429-4952-bad6-7be08963eef4 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:40.999118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25665d39-f429-4952-bad6-7be08963eef4 None admin] PATH_INFO: `/v3/groups/0b8a77f30f714b91b7590c55195bd47c` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:40.999400 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa380a0c-47fd-433e-8920-1f24b2d00010 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:40.999689 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa380a0c-47fd-433e-8920-1f24b2d00010 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:40.999968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa380a0c-47fd-433e-8920-1f24b2d00010 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:41.000469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25665d39-f429-4952-bad6-7be08963eef4 None admin] RBAC: Authorizing `identity:get_group(group_id=0b8a77f30f714b91b7590c55195bd47c)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:41.000713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa380a0c-47fd-433e-8920-1f24b2d00010 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:41.001019 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa380a0c-47fd-433e-8920-1f24b2d00010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:41.001895 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25665d39-f429-4952-bad6-7be08963eef4 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:41.002399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa380a0c-47fd-433e-8920-1f24b2d00010 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:41.003549 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 225/444] 10.222.0.32 () {56 vars in 1180 bytes} [Tue May 10 13:47:40 2022] GET /identity/v3/groups/0b8a77f30f714b91b7590c55195bd47c => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:41.004307 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25665d39-f429-4952-bad6-7be08963eef4 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:41.017899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 220/445] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:47:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:41.019067 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa380a0c-47fd-433e-8920-1f24b2d00010 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:41.116121 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25665d39-f429-4952-bad6-7be08963eef4 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:41.133935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa380a0c-47fd-433e-8920-1f24b2d00010 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:41.149913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92315a4-bf37-41be-944a-5ceacb169a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:41.150614 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92315a4-bf37-41be-944a-5ceacb169a83 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:41.150895 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92315a4-bf37-41be-944a-5ceacb169a83 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:41.151167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92315a4-bf37-41be-944a-5ceacb169a83 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:41.151921 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92315a4-bf37-41be-944a-5ceacb169a83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:41.152226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92315a4-bf37-41be-944a-5ceacb169a83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:41.154411 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92315a4-bf37-41be-944a-5ceacb169a83 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:41.163643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 226/446] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:41.164471 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92315a4-bf37-41be-944a-5ceacb169a83 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:41.173669 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d0b59-5fbe-4526-aab3-63584608642c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:41.174377 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d0b59-5fbe-4526-aab3-63584608642c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:41.174672 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d0b59-5fbe-4526-aab3-63584608642c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:41.174954 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d0b59-5fbe-4526-aab3-63584608642c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:41.175805 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d0b59-5fbe-4526-aab3-63584608642c None admin] RBAC: Adding query filter params (group.id=0b8a77f30f714b91b7590c55195bd47c, role.id=34ef75b7c6d54c5e81edbfee2f4b362d, scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:41.176119 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d0b59-5fbe-4526-aab3-63584608642c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:41.177563 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d0b59-5fbe-4526-aab3-63584608642c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:41.184876 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 221/447] 10.222.0.32 () {56 vars in 1376 bytes} [Tue May 10 13:47:41 2022] GET /identity/v3/role_assignments?group.id=0b8a77f30f714b91b7590c55195bd47c&scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac&role.id=34ef75b7c6d54c5e81edbfee2f4b362d => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:41.185867 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d0b59-5fbe-4526-aab3-63584608642c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:41.303123 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92315a4-bf37-41be-944a-5ceacb169a83 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:41.319053 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d0b59-5fbe-4526-aab3-63584608642c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:41.343015 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f183e-ae43-4b69-adbe-6543843f36d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:41.343697 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f183e-ae43-4b69-adbe-6543843f36d2 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:41.343981 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f183e-ae43-4b69-adbe-6543843f36d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:41.344261 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f183e-ae43-4b69-adbe-6543843f36d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:41.358373 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e878b2e-6bf2-4028-b100-c14b9c1f6b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:41.359093 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e878b2e-6bf2-4028-b100-c14b9c1f6b19 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:41.359373 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e878b2e-6bf2-4028-b100-c14b9c1f6b19 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:41.359648 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e878b2e-6bf2-4028-b100-c14b9c1f6b19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:41.429067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f183e-ae43-4b69-adbe-6543843f36d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:41.430511 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f183e-ae43-4b69-adbe-6543843f36d2 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:41.433432 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e878b2e-6bf2-4028-b100-c14b9c1f6b19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:41.434988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e878b2e-6bf2-4028-b100-c14b9c1f6b19 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:41.542961 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 222/448] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:41.549021 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e878b2e-6bf2-4028-b100-c14b9c1f6b19 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:41.551987 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 227/449] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:41.558536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f183e-ae43-4b69-adbe-6543843f36d2 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:41.666589 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e878b2e-6bf2-4028-b100-c14b9c1f6b19 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:41.674265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f183e-ae43-4b69-adbe-6543843f36d2 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:41.703408 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252955cb-0e57-46f5-9c4d-66fce181e940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:41.704183 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252955cb-0e57-46f5-9c4d-66fce181e940 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:41.704464 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252955cb-0e57-46f5-9c4d-66fce181e940 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:41.704743 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252955cb-0e57-46f5-9c4d-66fce181e940 None admin] PATH_INFO: `/v3/projects/a83c1c4876b14f72a0e3d2113130a776` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:41.706041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252955cb-0e57-46f5-9c4d-66fce181e940 None admin] RBAC: Authorizing `identity:get_project(project_id=a83c1c4876b14f72a0e3d2113130a776)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:41.707523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252955cb-0e57-46f5-9c4d-66fce181e940 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:41.709259 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 223/450] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:41 2022] GET /identity/v3/projects/a83c1c4876b14f72a0e3d2113130a776 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:41.710228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14108d7-8f24-4ee7-8bdb-4104ce01bd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:41.711390 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14108d7-8f24-4ee7-8bdb-4104ce01bd49 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:41.711706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14108d7-8f24-4ee7-8bdb-4104ce01bd49 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:41.712015 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14108d7-8f24-4ee7-8bdb-4104ce01bd49 None admin] PATH_INFO: `/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:41.713457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14108d7-8f24-4ee7-8bdb-4104ce01bd49 None admin] RBAC: Authorizing `identity:get_project(project_id=ec7d549ce6b14f7f8c85bf895eebadac)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:41.715066 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252955cb-0e57-46f5-9c4d-66fce181e940 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:41.715347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14108d7-8f24-4ee7-8bdb-4104ce01bd49 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:41.717286 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 228/451] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:47:41 2022] GET /identity/v3/projects/ec7d549ce6b14f7f8c85bf895eebadac => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:41.722875 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14108d7-8f24-4ee7-8bdb-4104ce01bd49 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:41.830150 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14108d7-8f24-4ee7-8bdb-4104ce01bd49 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:41.833945 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252955cb-0e57-46f5-9c4d-66fce181e940 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:41.871217 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01318f80-c0ff-45a2-bb9c-a128d0edf134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:41.872090 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01318f80-c0ff-45a2-bb9c-a128d0edf134 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:41.872414 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01318f80-c0ff-45a2-bb9c-a128d0edf134 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:41.872689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01318f80-c0ff-45a2-bb9c-a128d0edf134 None admin] PATH_INFO: `/v3/groups/0b8a77f30f714b91b7590c55195bd47c` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:41.874103 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01318f80-c0ff-45a2-bb9c-a128d0edf134 None admin] RBAC: Authorizing `identity:get_group(group_id=0b8a77f30f714b91b7590c55195bd47c)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:41.874876 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1e5a7-0000-4cbe-9131-2cb945a4f5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:41.875580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01318f80-c0ff-45a2-bb9c-a128d0edf134 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:41.875739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1e5a7-0000-4cbe-9131-2cb945a4f5e1 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:41.876032 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1e5a7-0000-4cbe-9131-2cb945a4f5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:41.876346 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1e5a7-0000-4cbe-9131-2cb945a4f5e1 None admin] PATH_INFO: `/v3/groups/997c2677b3d1445e925c67ec44a0a059` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:41.877403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 229/452] 10.222.0.32 () {56 vars in 1180 bytes} [Tue May 10 13:47:41 2022] GET /identity/v3/groups/0b8a77f30f714b91b7590c55195bd47c => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:41.877615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1e5a7-0000-4cbe-9131-2cb945a4f5e1 None admin] RBAC: Authorizing `identity:get_group(group_id=997c2677b3d1445e925c67ec44a0a059)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:41.879205 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1e5a7-0000-4cbe-9131-2cb945a4f5e1 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:41.881063 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 224/453] 10.222.0.32 () {56 vars in 1180 bytes} [Tue May 10 13:47:41 2022] GET /identity/v3/groups/997c2677b3d1445e925c67ec44a0a059 => generated 229 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:41.883090 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01318f80-c0ff-45a2-bb9c-a128d0edf134 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:41.888327 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1e5a7-0000-4cbe-9131-2cb945a4f5e1 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:42.001318 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1e5a7-0000-4cbe-9131-2cb945a4f5e1 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:42.008004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01318f80-c0ff-45a2-bb9c-a128d0edf134 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:42.039380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c78d4-eaa6-4179-854e-b43cdfefab89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:42.040043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c78d4-eaa6-4179-854e-b43cdfefab89 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:42.040327 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c78d4-eaa6-4179-854e-b43cdfefab89 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:42.040609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c78d4-eaa6-4179-854e-b43cdfefab89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:42.041459 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c78d4-eaa6-4179-854e-b43cdfefab89 None admin] RBAC: Adding query filter params (group.id=997c2677b3d1445e925c67ec44a0a059, role.id=17e40821fc444dd0b040dcfce3eb222b, scope.project.id=a83c1c4876b14f72a0e3d2113130a776) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:42.041770 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c78d4-eaa6-4179-854e-b43cdfefab89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:42.043286 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c78d4-eaa6-4179-854e-b43cdfefab89 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:42.045409 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e6d3d-2688-4c13-9542-a6be0c8693da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:42.046075 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e6d3d-2688-4c13-9542-a6be0c8693da None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:42.046402 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e6d3d-2688-4c13-9542-a6be0c8693da None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:42.046678 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e6d3d-2688-4c13-9542-a6be0c8693da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:42.047538 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e6d3d-2688-4c13-9542-a6be0c8693da None admin] RBAC: Adding query filter params (group.id=0b8a77f30f714b91b7590c55195bd47c, role.id=316da37136b4425f9ae486ae1e2bf4b4, scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:42.047853 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e6d3d-2688-4c13-9542-a6be0c8693da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:42.049338 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e6d3d-2688-4c13-9542-a6be0c8693da None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:42.050319 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 225/454] 10.222.0.32 () {56 vars in 1376 bytes} [Tue May 10 13:47:41 2022] GET /identity/v3/role_assignments?group.id=997c2677b3d1445e925c67ec44a0a059&scope.project.id=a83c1c4876b14f72a0e3d2113130a776&role.id=17e40821fc444dd0b040dcfce3eb222b => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:42.056281 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 230/455] 10.222.0.32 () {56 vars in 1376 bytes} [Tue May 10 13:47:41 2022] GET /identity/v3/role_assignments?group.id=0b8a77f30f714b91b7590c55195bd47c&scope.project.id=ec7d549ce6b14f7f8c85bf895eebadac&role.id=316da37136b4425f9ae486ae1e2bf4b4 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:45.016105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d82780-af1f-4e9d-98e4-25ed8bdb010e None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:45.016737 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d82780-af1f-4e9d-98e4-25ed8bdb010e None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:45.016737 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d82780-af1f-4e9d-98e4-25ed8bdb010e None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:45.018399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 226/456] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:45.025439 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8fd66-1030-4d7d-9a64-3a75b4d20c40 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:45.026922 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8fd66-1030-4d7d-9a64-3a75b4d20c40 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:45.027685 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8fd66-1030-4d7d-9a64-3a75b4d20c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:45.063622 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-95b8fd66-1030-4d7d-9a64-3a75b4d20c40 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:45.066230 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-95b8fd66-1030-4d7d-9a64-3a75b4d20c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:45.199699 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 231/457] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:45.251766 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d82780-af1f-4e9d-98e4-25ed8bdb010e None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:45.350278 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d3f43-94bb-4126-9107-3aa72e3b8137 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:45.350937 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d3f43-94bb-4126-9107-3aa72e3b8137 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:45.351418 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d3f43-94bb-4126-9107-3aa72e3b8137 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:45.353321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 232/458] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:45.359761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3a10e-7e42-43ca-beeb-c14c76e38c41 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:45.360047 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3a10e-7e42-43ca-beeb-c14c76e38c41 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:45.360493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3a10e-7e42-43ca-beeb-c14c76e38c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:45.413719 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-8db3a10e-7e42-43ca-beeb-c14c76e38c41 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:45.414982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-8db3a10e-7e42-43ca-beeb-c14c76e38c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:45.419066 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d82780-af1f-4e9d-98e4-25ed8bdb010e None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:45.483836 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b1ef3-5263-4b9d-b007-558ddab191c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:45.485568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b1ef3-5263-4b9d-b007-558ddab191c3 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:45.488375 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b1ef3-5263-4b9d-b007-558ddab191c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:45.488960 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b1ef3-5263-4b9d-b007-558ddab191c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:45.519409 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b1ef3-5263-4b9d-b007-558ddab191c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:45.520901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b1ef3-5263-4b9d-b007-558ddab191c3 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:45.530563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 233/459] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:47:45.559427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-dd3b1ef3-5263-4b9d-b007-558ddab191c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:45.559427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:45.559427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:45.559427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:45.559427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:45.559427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:45.559427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:45.559427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:45.559427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:45.559427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:45.559427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:45.559427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:45.559427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:45.559427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:45.559427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:45.561263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:45.561263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:45.561263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:45.561263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:45.561263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:45.561263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:45.561263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:45.561263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:45.561263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:45.561263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:45.561263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:45.561263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:45.561263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:45.561263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:45.561263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:45.561263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:45.561263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:45.562131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:45.562131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:45.562131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:45.562131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:45.562397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3a10e-7e42-43ca-beeb-c14c76e38c41 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:45.564636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 227/460] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:45.575557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b1ef3-5263-4b9d-b007-558ddab191c3 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:45.749530 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b1ef3-5263-4b9d-b007-558ddab191c3 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:45.749729 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3a10e-7e42-43ca-beeb-c14c76e38c41 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:45.789246 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee9f0c-51d0-482d-a68a-0cb250d164d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:45.790576 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee9f0c-51d0-482d-a68a-0cb250d164d2 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:45.791244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee9f0c-51d0-482d-a68a-0cb250d164d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:45.791745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee9f0c-51d0-482d-a68a-0cb250d164d2 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:45.792698 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee9f0c-51d0-482d-a68a-0cb250d164d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:45.793220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee9f0c-51d0-482d-a68a-0cb250d164d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:45.795365 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee9f0c-51d0-482d-a68a-0cb250d164d2 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:45.816961 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04775729-e2ae-449d-ac90-bb4bfd2a8300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:45.818387 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04775729-e2ae-449d-ac90-bb4bfd2a8300 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:45.818889 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04775729-e2ae-449d-ac90-bb4bfd2a8300 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:45.819394 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04775729-e2ae-449d-ac90-bb4bfd2a8300 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:45.826296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 228/461] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:45.828135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3e209-5e8f-4c97-b3bc-9aa03e8e2a6b None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:45.828661 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3e209-5e8f-4c97-b3bc-9aa03e8e2a6b None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:45.829144 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3e209-5e8f-4c97-b3bc-9aa03e8e2a6b None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:45.833957 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04775729-e2ae-449d-ac90-bb4bfd2a8300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:45.835383 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 229/462] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:45.836497 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3e209-5e8f-4c97-b3bc-9aa03e8e2a6b None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:45.836840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04775729-e2ae-449d-ac90-bb4bfd2a8300 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:45.868052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-04775729-e2ae-449d-ac90-bb4bfd2a8300 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:45.868052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:45.868052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:45.868052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:45.868052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:45.868052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:45.868052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:45.868052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:45.868052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:45.868052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:45.868052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:45.868052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:45.868052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:45.868052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:45.868052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:45.868995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:45.868995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:45.868995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:45.868995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:45.868995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:45.868995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:45.868995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:45.868995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:45.868995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:45.868995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:45.868995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:45.868995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:45.868995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:45.868995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:45.868995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:45.868995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:45.868995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:45.869838 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:45.869838 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:45.869838 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:45.869838 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:45.871099 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 234/463] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:45.880265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d1018-1e0b-48fe-8bf6-2e5322141c14 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:45.880754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d1018-1e0b-48fe-8bf6-2e5322141c14 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:45.881102 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d1018-1e0b-48fe-8bf6-2e5322141c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:45.907325 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-9a2d1018-1e0b-48fe-8bf6-2e5322141c14 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:45.909536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-9a2d1018-1e0b-48fe-8bf6-2e5322141c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:45.960710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3e209-5e8f-4c97-b3bc-9aa03e8e2a6b None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:46.000596 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c7d29-61f5-42c9-b2c5-7ece14d54e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:46.001586 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c7d29-61f5-42c9-b2c5-7ece14d54e0b None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:46.002060 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c7d29-61f5-42c9-b2c5-7ece14d54e0b None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:46.002553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c7d29-61f5-42c9-b2c5-7ece14d54e0b None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:46.003526 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c7d29-61f5-42c9-b2c5-7ece14d54e0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:46.005172 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c7d29-61f5-42c9-b2c5-7ece14d54e0b None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:46.038325 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 235/465] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:46.038325 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d1018-1e0b-48fe-8bf6-2e5322141c14 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:46.039438 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 230/465] 10.222.0.32 () {60 vars in 1132 bytes} [Tue May 10 13:47:45 2022] POST /identity/v3/users => generated 246 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:47:46.092723 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c7d29-61f5-42c9-b2c5-7ece14d54e0b None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:46.157430 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d1018-1e0b-48fe-8bf6-2e5322141c14 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:46.202243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19234116-c1fd-41bc-a51d-448f847cd698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:46.202243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19234116-c1fd-41bc-a51d-448f847cd698 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:46.202243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19234116-c1fd-41bc-a51d-448f847cd698 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:46.202243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19234116-c1fd-41bc-a51d-448f847cd698 None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:46.202953 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19234116-c1fd-41bc-a51d-448f847cd698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:46.202953 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19234116-c1fd-41bc-a51d-448f847cd698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:46.202953 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19234116-c1fd-41bc-a51d-448f847cd698 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:46.219623 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 236/466] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:46.225329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19234116-c1fd-41bc-a51d-448f847cd698 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:46.346549 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c7d29-61f5-42c9-b2c5-7ece14d54e0b None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:46.392529 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bddd14-7363-4925-8869-89c6bc95543f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:46.393349 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bddd14-7363-4925-8869-89c6bc95543f None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:46.393631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bddd14-7363-4925-8869-89c6bc95543f None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:46.393907 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bddd14-7363-4925-8869-89c6bc95543f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:46.406928 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bddd14-7363-4925-8869-89c6bc95543f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:46.408440 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bddd14-7363-4925-8869-89c6bc95543f None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:46.429487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-89bddd14-7363-4925-8869-89c6bc95543f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:46.429487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:46.429487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:46.429487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:46.429487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:46.429487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:46.429487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:46.429487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:46.429487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:46.429487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:46.429487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:46.429487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:46.429487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:46.429487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:46.429487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:46.434562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:46.434562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:46.434562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:46.434562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:46.434562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:46.434562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:46.434562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:46.434562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:46.434562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:46.434562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:46.434562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:46.434562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:46.434562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:46.434562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:46.434562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:46.434562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:46.434562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:46.438321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:46.438321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:46.438321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:46.438321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:46.438321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 231/467] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:46.438321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a194315-b9af-45f0-b851-b474c1ce8563 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:46.438321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a194315-b9af-45f0-b851-b474c1ce8563 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:46.438321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a194315-b9af-45f0-b851-b474c1ce8563 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:46.438321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 232/468] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:46.440844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a194315-b9af-45f0-b851-b474c1ce8563 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:46.446887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19234116-c1fd-41bc-a51d-448f847cd698 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:46.492939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc5b56-630b-4d64-ad98-01b6550075b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:46.493631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc5b56-630b-4d64-ad98-01b6550075b9 None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:46.493918 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc5b56-630b-4d64-ad98-01b6550075b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:46.494532 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc5b56-630b-4d64-ad98-01b6550075b9 None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:46.494947 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc5b56-630b-4d64-ad98-01b6550075b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:46.496433 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc5b56-630b-4d64-ad98-01b6550075b9 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:46.524089 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 237/469] 10.222.0.32 () {60 vars in 1132 bytes} [Tue May 10 13:47:46 2022] POST /identity/v3/users => generated 248 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:47:46.526502 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecfbe5-f275-4803-ad9e-e702ff24c5da None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:46.527021 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecfbe5-f275-4803-ad9e-e702ff24c5da None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:46.527522 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecfbe5-f275-4803-ad9e-e702ff24c5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:46.552488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-12ecfbe5-f275-4803-ad9e-e702ff24c5da None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:46.554135 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-12ecfbe5-f275-4803-ad9e-e702ff24c5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:46.570772 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a194315-b9af-45f0-b851-b474c1ce8563 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:46.613642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0478186-3395-4d7c-9b72-ab22c24232f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:46.614672 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0478186-3395-4d7c-9b72-ab22c24232f6 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:46.615140 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0478186-3395-4d7c-9b72-ab22c24232f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:46.615975 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0478186-3395-4d7c-9b72-ab22c24232f6 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:46.617276 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0478186-3395-4d7c-9b72-ab22c24232f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:46.617947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0478186-3395-4d7c-9b72-ab22c24232f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:46.619883 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0478186-3395-4d7c-9b72-ab22c24232f6 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:46.643463 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 233/470] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:46.645605 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511309a6-a5b3-4fd3-a4bd-8e2f53715e3f None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:46.646103 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511309a6-a5b3-4fd3-a4bd-8e2f53715e3f None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:46.646667 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 238/471] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:46.646995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511309a6-a5b3-4fd3-a4bd-8e2f53715e3f None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:46.647811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecfbe5-f275-4803-ad9e-e702ff24c5da None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:46.648802 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 234/472] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:46.654342 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb66924-0ce8-4ad8-ae88-9fb9c3018880 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:46.654847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb66924-0ce8-4ad8-ae88-9fb9c3018880 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:46.655307 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb66924-0ce8-4ad8-ae88-9fb9c3018880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:46.677881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-9fb66924-0ce8-4ad8-ae88-9fb9c3018880 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:46.680160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-9fb66924-0ce8-4ad8-ae88-9fb9c3018880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:46.766903 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecfbe5-f275-4803-ad9e-e702ff24c5da None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:46.769886 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 235/473] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:46.771139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb66924-0ce8-4ad8-ae88-9fb9c3018880 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:46.811317 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ac427-67ff-48dd-859b-aabf6eb1ce9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:46.812011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ac427-67ff-48dd-859b-aabf6eb1ce9f None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:46.812298 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ac427-67ff-48dd-859b-aabf6eb1ce9f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:46.812567 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ac427-67ff-48dd-859b-aabf6eb1ce9f None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:46.813292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ac427-67ff-48dd-859b-aabf6eb1ce9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:46.814840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ac427-67ff-48dd-859b-aabf6eb1ce9f None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:46.858364 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 239/474] 10.222.0.32 () {60 vars in 1132 bytes} [Tue May 10 13:47:46 2022] POST /identity/v3/users => generated 248 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:47:46.859283 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ac427-67ff-48dd-859b-aabf6eb1ce9f None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:46.900455 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb66924-0ce8-4ad8-ae88-9fb9c3018880 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:46.943964 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad664eb-5801-448e-9bc2-0e6b832fc821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:46.945582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad664eb-5801-448e-9bc2-0e6b832fc821 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:46.946430 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad664eb-5801-448e-9bc2-0e6b832fc821 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:46.947108 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad664eb-5801-448e-9bc2-0e6b832fc821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:46.960437 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad664eb-5801-448e-9bc2-0e6b832fc821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:46.962524 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad664eb-5801-448e-9bc2-0e6b832fc821 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:46.998739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-9ad664eb-5801-448e-9bc2-0e6b832fc821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:46.998739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:46.998739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:46.998739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:46.998739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:46.998739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:46.998739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:46.998739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:46.998739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:46.998739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:46.998739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:46.998739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:46.998739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:46.998739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:46.998739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:46.999657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:46.999657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:46.999657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:46.999657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:46.999657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:46.999657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:46.999657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:46.999657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:46.999657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:46.999657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:46.999657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:46.999657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:46.999657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:46.999657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:46.999657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:46.999657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:46.999657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:47.000501 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:47.000501 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:47.000501 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:47.000501 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:47.005579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ac427-67ff-48dd-859b-aabf6eb1ce9f None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:47.007438 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 236/475] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:47.013525 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad664eb-5801-448e-9bc2-0e6b832fc821 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:47.083920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b49c3-1de8-4deb-9ec9-4e7c00718c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:47.086686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b49c3-1de8-4deb-9ec9-4e7c00718c63 None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:47.088543 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b49c3-1de8-4deb-9ec9-4e7c00718c63 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:47.089059 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b49c3-1de8-4deb-9ec9-4e7c00718c63 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:47.090072 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b49c3-1de8-4deb-9ec9-4e7c00718c63 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:47.092409 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b49c3-1de8-4deb-9ec9-4e7c00718c63 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:47.108279 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.sql.core [None req-e39b49c3-1de8-4deb-9ec9-4e7c00718c63 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 13:47:47.108279 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 13:47:47.108279 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [parameters: {'id': '4978ef0e5cab49d49d899411f27d63c4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 13:47:47.108279 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79936) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 13:47:47.137564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-e39b49c3-1de8-4deb-9ec9-4e7c00718c63 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 13:47:47.137564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:47.137564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 13:47:47.137564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 13:47:47.137564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 13:47:47.137564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 13:47:47.137564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 13:47:47.137564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application result = self._query(query) May 10 13:47:47.137564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 13:47:47.137564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application conn.query(q) May 10 13:47:47.137564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 13:47:47.137564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 13:47:47.137564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 13:47:47.137564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application result.read() May 10 13:47:47.137564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 13:47:47.138611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 13:47:47.138611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 13:47:47.138611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 13:47:47.138611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 13:47:47.138611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 13:47:47.138611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 13:47:47.138611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 13:47:47.138611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 13:47:47.138611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:47.138611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 13:47:47.138611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:47.138611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:47.138611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 13:47:47.138611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 13:47:47.138611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 10 13:47:47.138611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return ref.to_dict() May 10 13:47:47.138611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 13:47:47.138611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application next(self.gen) May 10 13:47:47.139610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 13:47:47.139610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application yield resource May 10 13:47:47.139610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 13:47:47.139610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application next(self.gen) May 10 13:47:47.139610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 13:47:47.139610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self.session.rollback() May 10 13:47:47.139610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 13:47:47.139610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self.force_reraise() May 10 13:47:47.139610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 13:47:47.139610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise self.value May 10 13:47:47.139610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 13:47:47.139610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 13:47:47.139610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 13:47:47.139610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application session.commit() May 10 13:47:47.139610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 13:47:47.139610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 13:47:47.139610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 13:47:47.140479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._prepare_impl() May 10 13:47:47.140479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 13:47:47.140479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self.session.flush() May 10 13:47:47.140479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 13:47:47.140479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._flush(objects) May 10 13:47:47.140479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 13:47:47.140479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 13:47:47.140479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 13:47:47.140479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application compat.raise_( May 10 13:47:47.140479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 13:47:47.140479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception May 10 13:47:47.140479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 13:47:47.140479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application flush_context.execute() May 10 13:47:47.140479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 13:47:47.140479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rec.execute(self) May 10 13:47:47.140479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 13:47:47.140479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 13:47:47.141374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 13:47:47.141374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 13:47:47.141374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 13:47:47.141374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 13:47:47.141374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 13:47:47.141374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 13:47:47.141374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 13:47:47.141374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 13:47:47.141374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 13:47:47.141374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 13:47:47.141374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 13:47:47.141374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 13:47:47.141374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 13:47:47.141374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 13:47:47.141374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 13:47:47.141374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception May 10 13:47:47.142248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 13:47:47.142248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 13:47:47.142248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 13:47:47.142248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 13:47:47.142248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 13:47:47.142248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application result = self._query(query) May 10 13:47:47.142248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 13:47:47.142248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application conn.query(q) May 10 13:47:47.142248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 13:47:47.142248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 13:47:47.142248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 13:47:47.142248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application result.read() May 10 13:47:47.142248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 13:47:47.142248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 13:47:47.142248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 13:47:47.142248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 13:47:47.143040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 13:47:47.143040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 13:47:47.143040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 13:47:47.143040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 13:47:47.143040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 13:47:47.143040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 13:47:47.143040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [parameters: {'id': '4978ef0e5cab49d49d899411f27d63c4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 13:47:47.143040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 13:47:47.143040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:47.143040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:47.143040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:47.143040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:47.143040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:47.143040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:47.143040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:47.143040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:47.143818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:47.143818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:47.143818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:47.143818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:47.143818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:47.143818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:47.143818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 10 13:47:47.143818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 10 13:47:47.143818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:47.143818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:47.143818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 10 13:47:47.143818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 10 13:47:47.143818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 13:47:47.143818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 13:47:47.143818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 13:47:47.143818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:47.158932 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 240/476] 10.222.0.32 () {60 vars in 1131 bytes} [Tue May 10 13:47:46 2022] POST /identity/v3/roles => generated 144 bytes in 300 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:47.167613 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b49c3-1de8-4deb-9ec9-4e7c00718c63 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:47.182234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad664eb-5801-448e-9bc2-0e6b832fc821 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:47.231207 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e97e3-09f1-4d71-b0d3-f191689f5313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:47.233655 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e97e3-09f1-4d71-b0d3-f191689f5313 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:47.233655 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e97e3-09f1-4d71-b0d3-f191689f5313 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:47.233989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e97e3-09f1-4d71-b0d3-f191689f5313 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:47.235027 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e97e3-09f1-4d71-b0d3-f191689f5313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:47.235343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e97e3-09f1-4d71-b0d3-f191689f5313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:47.237097 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e97e3-09f1-4d71-b0d3-f191689f5313 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:47.252972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 237/477] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:47.259046 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e97e3-09f1-4d71-b0d3-f191689f5313 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:47.328387 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b49c3-1de8-4deb-9ec9-4e7c00718c63 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:47.384536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2a09d-ebc0-4ad9-8bc3-4e0fe8ed4114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:47.385318 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2a09d-ebc0-4ad9-8bc3-4e0fe8ed4114 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:47.385604 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2a09d-ebc0-4ad9-8bc3-4e0fe8ed4114 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:47.385888 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2a09d-ebc0-4ad9-8bc3-4e0fe8ed4114 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:47.400213 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2a09d-ebc0-4ad9-8bc3-4e0fe8ed4114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:47.411833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-2fe2a09d-ebc0-4ad9-8bc3-4e0fe8ed4114 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:47:47.411833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:47.411833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:47.411833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:47.411833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:47.411833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:47.411833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:47.411833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:47.411833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:47.411833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:47.411833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:47.411833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:47.411833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:47.411833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:47.411833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:47.411833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:47.412971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:47.412971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:47.412971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:47.412971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:47.412971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:47.412971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:47.412971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:47.412971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:47.412971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:47.412971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:47.412971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:47.412971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:47.412971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:47.412971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:47.412971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:47.412971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:47.413803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:47.413803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:47.413803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:47.413803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:47.413803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:47.413803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:47.413803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:47.413803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:47.413803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:47.413803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:47.413803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:47:47.413803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:47.413803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 241/478] 10.222.0.32 () {56 vars in 1114 bytes} [Tue May 10 13:47:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:47.423623 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2a09d-ebc0-4ad9-8bc3-4e0fe8ed4114 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:47.497950 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e97e3-09f1-4d71-b0d3-f191689f5313 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:47.553146 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef1e33-870b-4136-8d5b-fd662c28878b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:47.553766 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef1e33-870b-4136-8d5b-fd662c28878b None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:47.554102 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef1e33-870b-4136-8d5b-fd662c28878b None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:47.554405 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef1e33-870b-4136-8d5b-fd662c28878b None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:47.555142 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef1e33-870b-4136-8d5b-fd662c28878b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:47.556647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef1e33-870b-4136-8d5b-fd662c28878b None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:47.597194 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 238/479] 10.222.0.32 () {60 vars in 1132 bytes} [Tue May 10 13:47:47 2022] POST /identity/v3/users => generated 249 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:47:47.648807 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2a09d-ebc0-4ad9-8bc3-4e0fe8ed4114 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:47.712779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2429d-056d-4dbd-af4b-0f88d8fade4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:47.714264 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2429d-056d-4dbd-af4b-0f88d8fade4b None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:47.715038 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2429d-056d-4dbd-af4b-0f88d8fade4b None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:47.715666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2429d-056d-4dbd-af4b-0f88d8fade4b None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:47.717593 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2429d-056d-4dbd-af4b-0f88d8fade4b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:47.718392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2429d-056d-4dbd-af4b-0f88d8fade4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:47.720997 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2429d-056d-4dbd-af4b-0f88d8fade4b None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:47.738953 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 242/480] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:47:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:49.391845 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75880f3e-05ff-415e-8c7b-18cadf183ee2 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:49.392345 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75880f3e-05ff-415e-8c7b-18cadf183ee2 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:49.392449 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75880f3e-05ff-415e-8c7b-18cadf183ee2 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:49.394019 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 239/481] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:49.399151 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324388e7-499d-46da-99fc-5c10587a5120 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:49.399580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324388e7-499d-46da-99fc-5c10587a5120 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:49.399764 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324388e7-499d-46da-99fc-5c10587a5120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:49.417124 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-324388e7-499d-46da-99fc-5c10587a5120 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:49.422366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-324388e7-499d-46da-99fc-5c10587a5120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:49.435212 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e34734-4112-47c4-8b84-d865f6476d8a None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:49.435522 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e34734-4112-47c4-8b84-d865f6476d8a None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:49.435864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e34734-4112-47c4-8b84-d865f6476d8a None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:49.437486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 240/482] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:49.442810 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e0f24-f7b7-4d12-bf87-7239de1f429b None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:49.443095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e0f24-f7b7-4d12-bf87-7239de1f429b None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:49.443374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e0f24-f7b7-4d12-bf87-7239de1f429b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:49.485749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-171e0f24-f7b7-4d12-bf87-7239de1f429b None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:49.486970 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-171e0f24-f7b7-4d12-bf87-7239de1f429b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:49.523474 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 243/483] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:47:49.584187 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324388e7-499d-46da-99fc-5c10587a5120 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:49.596193 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 241/484] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:49.617715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e0f24-f7b7-4d12-bf87-7239de1f429b None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:49.754366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324388e7-499d-46da-99fc-5c10587a5120 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:49.803486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e0f24-f7b7-4d12-bf87-7239de1f429b None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:49.816065 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a461b07-772d-4fbe-b337-d99b8bae8826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:49.817222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a461b07-772d-4fbe-b337-d99b8bae8826 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:49.817702 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a461b07-772d-4fbe-b337-d99b8bae8826 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:49.818169 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a461b07-772d-4fbe-b337-d99b8bae8826 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:49.845971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a461b07-772d-4fbe-b337-d99b8bae8826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:49.864357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-7a461b07-772d-4fbe-b337-d99b8bae8826 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:49.864357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:49.864357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:49.864357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:49.864357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:49.864357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:49.864357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:49.864357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:49.864357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:49.864357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:49.864357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:49.864357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:49.864357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:49.864357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:49.864357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:49.864357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:49.865347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:49.865347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:49.865347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:49.865347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:49.865347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:49.865347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:49.865347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:49.865347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:49.865347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:49.865347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:49.865347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:49.865347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:49.865347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:49.865347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:49.865347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:49.865347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:49.866111 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:49.866111 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:49.866111 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:49.866111 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:49.866111 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:49.866111 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:49.866111 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:49.866111 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:49.866111 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:49.866111 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:49.866111 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:49.866111 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:49.875115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 244/485] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:47:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:49.880252 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a461b07-772d-4fbe-b337-d99b8bae8826 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:49.888773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673e84b-e57b-423c-9f1c-0d835418a0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:49.890368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673e84b-e57b-423c-9f1c-0d835418a0b4 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:49.891066 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673e84b-e57b-423c-9f1c-0d835418a0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:49.891682 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673e84b-e57b-423c-9f1c-0d835418a0b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:49.908776 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673e84b-e57b-423c-9f1c-0d835418a0b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:49.928131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-0673e84b-e57b-423c-9f1c-0d835418a0b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:49.928131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:49.928131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:49.928131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:49.928131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:49.928131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:49.928131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:49.928131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:49.928131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:49.928131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:49.928131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:49.928131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:49.928131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:49.928131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:49.928131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:49.928131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:49.929536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:49.929536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:49.929536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:49.929536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:49.929536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:49.929536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:49.929536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:49.929536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:49.929536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:49.929536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:49.929536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:49.929536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:49.929536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:49.929536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:49.929536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:49.929536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:49.930909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:49.930909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:49.930909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:49.930909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:49.930909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:49.930909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:49.930909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:49.930909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:49.930909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:49.930909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:49.930909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:49.930909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:49.941834 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 242/486] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:47:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:49.947240 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673e84b-e57b-423c-9f1c-0d835418a0b4 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:49.996979 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a461b07-772d-4fbe-b337-d99b8bae8826 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:50.034394 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aeadcf-9c95-4b17-9acb-549de8fc1994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:50.035005 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aeadcf-9c95-4b17-9acb-549de8fc1994 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:50.035775 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aeadcf-9c95-4b17-9acb-549de8fc1994 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:50.035775 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aeadcf-9c95-4b17-9acb-549de8fc1994 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:50.036287 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aeadcf-9c95-4b17-9acb-549de8fc1994 None admin] RBAC: Adding query filter params (name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:50.036592 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aeadcf-9c95-4b17-9acb-549de8fc1994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:50.037973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aeadcf-9c95-4b17-9acb-549de8fc1994 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:50.048128 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 245/487] 10.222.0.32 () {56 vars in 1103 bytes} [Tue May 10 13:47:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:50.049600 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115f6a9-ef45-4b45-ac17-4d178863460d None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:50.049884 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115f6a9-ef45-4b45-ac17-4d178863460d None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:50.050159 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115f6a9-ef45-4b45-ac17-4d178863460d None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:50.052227 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 246/488] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:50.053129 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115f6a9-ef45-4b45-ac17-4d178863460d None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:50.065078 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673e84b-e57b-423c-9f1c-0d835418a0b4 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:50.103532 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f9f09-d294-4803-b466-395eb33ff1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:50.104561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f9f09-d294-4803-b466-395eb33ff1b5 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:50.105043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f9f09-d294-4803-b466-395eb33ff1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:50.105507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f9f09-d294-4803-b466-395eb33ff1b5 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:50.106550 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f9f09-d294-4803-b466-395eb33ff1b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:50.108076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f9f09-d294-4803-b466-395eb33ff1b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:50.109791 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f9f09-d294-4803-b466-395eb33ff1b5 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:50.119214 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 243/489] 10.222.0.32 () {56 vars in 1103 bytes} [Tue May 10 13:47:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:50.120877 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654f303-139e-4a39-a7e8-ac50db87443d None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:50.121392 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654f303-139e-4a39-a7e8-ac50db87443d None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:50.122001 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654f303-139e-4a39-a7e8-ac50db87443d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:50.140758 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-3654f303-139e-4a39-a7e8-ac50db87443d None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:50.142349 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-3654f303-139e-4a39-a7e8-ac50db87443d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:50.197417 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115f6a9-ef45-4b45-ac17-4d178863460d None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:50.217851 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 244/490] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:50.219590 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654f303-139e-4a39-a7e8-ac50db87443d None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:50.259020 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab7acc-a422-4ecf-a454-2e3dbeda54fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:50.260114 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab7acc-a422-4ecf-a454-2e3dbeda54fa None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:50.260472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab7acc-a422-4ecf-a454-2e3dbeda54fa None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:50.260961 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab7acc-a422-4ecf-a454-2e3dbeda54fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:50.282803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab7acc-a422-4ecf-a454-2e3dbeda54fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:50.285585 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab7acc-a422-4ecf-a454-2e3dbeda54fa None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:50.320492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-8bab7acc-a422-4ecf-a454-2e3dbeda54fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:50.320492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:50.320492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:50.320492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:50.320492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:50.320492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:50.320492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:50.320492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:50.320492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:50.320492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:50.320492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:50.320492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:50.320492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:50.320492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:50.320492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:50.321493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:50.321493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:50.321493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:50.321493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:50.321493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:50.321493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:50.321493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:50.321493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:50.321493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:50.321493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:50.321493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:50.321493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:50.321493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:50.321493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:50.321493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:50.321493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:50.321493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:50.322407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:50.322407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:50.322407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:50.322407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:50.324092 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 247/491] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:50.324756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab7acc-a422-4ecf-a454-2e3dbeda54fa None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:50.356438 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654f303-139e-4a39-a7e8-ac50db87443d None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:50.395418 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bc549-fad1-4964-9a63-815092770415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:50.397021 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bc549-fad1-4964-9a63-815092770415 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:50.397560 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bc549-fad1-4964-9a63-815092770415 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:50.398044 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bc549-fad1-4964-9a63-815092770415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:50.410548 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bc549-fad1-4964-9a63-815092770415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:50.412378 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bc549-fad1-4964-9a63-815092770415 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:50.432702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-d53bc549-fad1-4964-9a63-815092770415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:50.432702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:50.432702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:50.432702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:50.432702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:50.432702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:50.432702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:50.432702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:50.432702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:50.432702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:50.432702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:50.432702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:50.432702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:50.432702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:50.432702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:50.433604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:50.433604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:50.433604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:50.433604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:50.433604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:50.433604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:50.433604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:50.433604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:50.433604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:50.433604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:50.433604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:50.433604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:50.433604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:50.433604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:50.433604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:50.433604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:50.433604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:50.434478 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:50.434478 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:50.434478 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:50.434478 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:50.437840 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 245/492] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:50.439033 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bc549-fad1-4964-9a63-815092770415 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:50.510582 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab7acc-a422-4ecf-a454-2e3dbeda54fa None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:50.552556 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bc549-fad1-4964-9a63-815092770415 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:50.568169 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3329296-3a51-49af-b07d-75c740836e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:50.568980 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3329296-3a51-49af-b07d-75c740836e77 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:50.569260 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3329296-3a51-49af-b07d-75c740836e77 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:50.569529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3329296-3a51-49af-b07d-75c740836e77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:50.582107 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3329296-3a51-49af-b07d-75c740836e77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:50.589925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-e3329296-3a51-49af-b07d-75c740836e77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:50.589925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:50.589925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:50.589925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:50.589925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:50.589925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:50.589925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:50.589925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:50.589925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:50.589925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:50.589925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:50.589925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:50.589925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:50.589925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:50.589925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:50.589925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:50.591737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:50.591737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:50.591737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:50.591737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:50.591737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:50.591737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:50.591737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:50.591737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:50.591737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:50.591737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:50.591737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:50.591737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:50.591737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:50.591737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:50.591737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:50.591737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:50.592617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:50.592617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:50.592617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:50.592617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:50.592617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:50.592617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:50.592617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:50.592617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:50.592617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:50.592617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:50.592617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:50.592617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:50.594494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5214a9-3f76-4d41-a62c-b7414a73b220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:50.594494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5214a9-3f76-4d41-a62c-b7414a73b220 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:50.595009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 248/493] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:47:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:50.595157 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5214a9-3f76-4d41-a62c-b7414a73b220 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:50.595157 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5214a9-3f76-4d41-a62c-b7414a73b220 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:50.595453 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3329296-3a51-49af-b07d-75c740836e77 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:50.595650 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5214a9-3f76-4d41-a62c-b7414a73b220 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:50.595650 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5214a9-3f76-4d41-a62c-b7414a73b220 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:50.595650 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5214a9-3f76-4d41-a62c-b7414a73b220 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:50.608225 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 246/494] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:50.613891 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb1a86-ad56-43c0-8be5-1322ad06aba0 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:50.614185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb1a86-ad56-43c0-8be5-1322ad06aba0 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:50.614636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb1a86-ad56-43c0-8be5-1322ad06aba0 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:50.618395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 247/495] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:50.618395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb1a86-ad56-43c0-8be5-1322ad06aba0 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:50.727633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3329296-3a51-49af-b07d-75c740836e77 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:50.739937 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb1a86-ad56-43c0-8be5-1322ad06aba0 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:50.768057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca47fa-b516-46b3-8535-f4888a1dc76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:50.768731 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca47fa-b516-46b3-8535-f4888a1dc76c None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:50.769019 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca47fa-b516-46b3-8535-f4888a1dc76c None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:50.769297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca47fa-b516-46b3-8535-f4888a1dc76c None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:50.770025 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca47fa-b516-46b3-8535-f4888a1dc76c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:50.770360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca47fa-b516-46b3-8535-f4888a1dc76c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:50.771824 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca47fa-b516-46b3-8535-f4888a1dc76c None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:50.786426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bdddc-2ee2-4f52-beb3-946e8afce89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:50.787111 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bdddc-2ee2-4f52-beb3-946e8afce89a None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:50.787388 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bdddc-2ee2-4f52-beb3-946e8afce89a None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:50.787659 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bdddc-2ee2-4f52-beb3-946e8afce89a None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:50.788424 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bdddc-2ee2-4f52-beb3-946e8afce89a None admin] RBAC: Adding query filter params (name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:50.788728 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bdddc-2ee2-4f52-beb3-946e8afce89a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:50.790139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bdddc-2ee2-4f52-beb3-946e8afce89a None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:50.795355 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 249/496] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:50.797030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca47fa-b516-46b3-8535-f4888a1dc76c None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:50.804271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 248/497] 10.222.0.32 () {56 vars in 1103 bytes} [Tue May 10 13:47:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:50.804271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76952d2-b6fb-43ac-8e96-ecabc2826bbb None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:50.804271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76952d2-b6fb-43ac-8e96-ecabc2826bbb None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:50.804271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76952d2-b6fb-43ac-8e96-ecabc2826bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:50.818960 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-c76952d2-b6fb-43ac-8e96-ecabc2826bbb None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:50.820073 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-c76952d2-b6fb-43ac-8e96-ecabc2826bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:50.894981 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 249/498] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:50.895837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76952d2-b6fb-43ac-8e96-ecabc2826bbb None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:50.925950 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca47fa-b516-46b3-8535-f4888a1dc76c None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:50.965160 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29361f35-3375-42f1-95ed-0944fc1a9640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:50.966046 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29361f35-3375-42f1-95ed-0944fc1a9640 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:50.966366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29361f35-3375-42f1-95ed-0944fc1a9640 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:50.966647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29361f35-3375-42f1-95ed-0944fc1a9640 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:50.974112 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29361f35-3375-42f1-95ed-0944fc1a9640 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:50.975598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29361f35-3375-42f1-95ed-0944fc1a9640 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:50.992389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-29361f35-3375-42f1-95ed-0944fc1a9640 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 13:47:50.992389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:50.992389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:50.992389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:50.992389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:50.992389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:50.992389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:50.992389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:50.992389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:50.992389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:50.992389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:50.992389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:50.992389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:50.992389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:50.992389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:50.992389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:50.993581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:50.993581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:50.993581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:50.993581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:50.993581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:50.993581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:50.993581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:50.993581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:50.993581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:50.993581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:50.993581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:50.993581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:50.993581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:50.993581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:50.993581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:50.993581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:50.993581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:50.993581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:50.999835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:50.999835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:50.999835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:50.999835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:50.999835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:50.999835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:50.999835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:50.999835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:50.999835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 13:47:50.999835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:50.999835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 250/499] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:50.999835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29361f35-3375-42f1-95ed-0944fc1a9640 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:51.015275 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76952d2-b6fb-43ac-8e96-ecabc2826bbb None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:51.053321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf7dd0-4a64-4703-a8b4-0994dcfa0dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:51.054076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf7dd0-4a64-4703-a8b4-0994dcfa0dba None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:51.054496 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf7dd0-4a64-4703-a8b4-0994dcfa0dba None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:51.054662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf7dd0-4a64-4703-a8b4-0994dcfa0dba None admin] PATH_INFO: `/v3/users/nova` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:51.063261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf7dd0-4a64-4703-a8b4-0994dcfa0dba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:51.064771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf7dd0-4a64-4703-a8b4-0994dcfa0dba None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:51.081632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-dbaf7dd0-4a64-4703-a8b4-0994dcfa0dba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 13:47:51.081632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:51.081632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:51.081632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:51.081632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:51.081632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:51.081632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:51.081632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:51.081632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:51.081632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:51.081632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:51.081632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:51.081632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:51.081632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:51.081632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:51.081632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:51.082771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:51.082771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:51.082771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:51.082771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:51.082771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:51.082771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:51.082771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:51.082771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:51.082771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:51.082771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:51.082771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:51.082771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:51.082771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:51.082771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:51.082771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:51.082771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:51.082771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:51.082771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:51.083630 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:51.083630 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:51.083630 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:51.083630 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:51.083630 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:51.083630 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:51.083630 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:51.083630 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:51.083630 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 13:47:51.083630 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:51.083630 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 250/500] 10.222.0.32 () {56 vars in 1093 bytes} [Tue May 10 13:47:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:51.084226 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a3fff-a4bf-488c-84f4-1dd6949b98c6 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:51.084509 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a3fff-a4bf-488c-84f4-1dd6949b98c6 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:51.084786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a3fff-a4bf-488c-84f4-1dd6949b98c6 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:51.086072 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 251/501] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:51.086801 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a3fff-a4bf-488c-84f4-1dd6949b98c6 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:51.107323 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29361f35-3375-42f1-95ed-0944fc1a9640 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:51.141033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c595e-6842-45b1-9b10-9071b3429510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:51.141829 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c595e-6842-45b1-9b10-9071b3429510 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:51.142107 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c595e-6842-45b1-9b10-9071b3429510 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:51.142402 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c595e-6842-45b1-9b10-9071b3429510 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:51.152201 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c595e-6842-45b1-9b10-9071b3429510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:51.153736 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c595e-6842-45b1-9b10-9071b3429510 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:51.171472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-830c595e-6842-45b1-9b10-9071b3429510 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:51.171472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:51.171472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:51.171472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:51.171472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:51.171472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:51.171472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:51.171472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:51.171472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:51.171472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:51.171472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:51.171472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:51.171472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:51.171472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:51.171472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:51.172366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:51.172366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:51.172366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:51.172366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:51.172366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:51.172366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:51.172366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:51.172366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:51.172366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:51.172366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:51.172366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:51.172366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:51.172366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:51.172366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:51.172366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:51.172366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:51.172366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:51.173193 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:51.173193 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:51.173193 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:51.173193 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:51.173193 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 251/502] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:51.173455 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c595e-6842-45b1-9b10-9071b3429510 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:51.204507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a3fff-a4bf-488c-84f4-1dd6949b98c6 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:51.237840 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc548f1c-02a1-4fc5-9c86-e007b567286e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:51.238665 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc548f1c-02a1-4fc5-9c86-e007b567286e None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:51.238945 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc548f1c-02a1-4fc5-9c86-e007b567286e None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:51.239223 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc548f1c-02a1-4fc5-9c86-e007b567286e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:51.249993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc548f1c-02a1-4fc5-9c86-e007b567286e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:51.251499 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc548f1c-02a1-4fc5-9c86-e007b567286e None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:51.268957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-dc548f1c-02a1-4fc5-9c86-e007b567286e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:51.268957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:51.268957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:51.268957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:51.268957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:51.268957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:51.268957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:51.268957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:51.268957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:51.268957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:51.268957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:51.268957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:51.268957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:51.268957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:51.268957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:51.269956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:51.269956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:51.269956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:51.269956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:51.269956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:51.269956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:51.269956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:51.269956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:51.269956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:51.269956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:51.269956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:51.269956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:51.269956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:51.269956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:51.269956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:51.269956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:51.269956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:51.271018 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:51.271018 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:51.271018 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:51.271018 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:51.271018 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 252/503] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:51.271018 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc548f1c-02a1-4fc5-9c86-e007b567286e None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:51.281876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c595e-6842-45b1-9b10-9071b3429510 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:51.317301 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90979872-1027-4390-a50d-de35af1a3c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:51.317903 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90979872-1027-4390-a50d-de35af1a3c57 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:51.318187 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90979872-1027-4390-a50d-de35af1a3c57 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:51.318493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90979872-1027-4390-a50d-de35af1a3c57 None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:51.319330 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90979872-1027-4390-a50d-de35af1a3c57 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:51.319645 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90979872-1027-4390-a50d-de35af1a3c57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:51.321081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90979872-1027-4390-a50d-de35af1a3c57 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:51.359864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 252/504] 10.222.0.32 () {56 vars in 1137 bytes} [Tue May 10 13:47:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:51.365655 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27af18e-7968-4eae-8281-076940313b21 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:51.365655 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27af18e-7968-4eae-8281-076940313b21 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:51.365655 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27af18e-7968-4eae-8281-076940313b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:51.371104 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc548f1c-02a1-4fc5-9c86-e007b567286e None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:51.380530 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-b27af18e-7968-4eae-8281-076940313b21 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:51.381756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-b27af18e-7968-4eae-8281-076940313b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:51.406333 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36741455-319f-4b77-8007-f0b200babec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:51.407020 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36741455-319f-4b77-8007-f0b200babec1 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:51.407301 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36741455-319f-4b77-8007-f0b200babec1 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:51.407577 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36741455-319f-4b77-8007-f0b200babec1 None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:51.408443 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36741455-319f-4b77-8007-f0b200babec1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:51.408747 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36741455-319f-4b77-8007-f0b200babec1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:51.410251 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36741455-319f-4b77-8007-f0b200babec1 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:51.453353 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 253/505] 10.222.0.32 () {56 vars in 1133 bytes} [Tue May 10 13:47:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:51.455184 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36741455-319f-4b77-8007-f0b200babec1 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:51.459985 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 253/506] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:51.461038 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27af18e-7968-4eae-8281-076940313b21 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:51.558537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36741455-319f-4b77-8007-f0b200babec1 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:51.563439 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27af18e-7968-4eae-8281-076940313b21 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:51.594851 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85ff96-4b50-4999-a4e9-3bf98fec2353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:51.595511 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85ff96-4b50-4999-a4e9-3bf98fec2353 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:51.595790 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85ff96-4b50-4999-a4e9-3bf98fec2353 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:51.596063 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85ff96-4b50-4999-a4e9-3bf98fec2353 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:51.596789 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85ff96-4b50-4999-a4e9-3bf98fec2353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:51.597088 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85ff96-4b50-4999-a4e9-3bf98fec2353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:51.597623 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc564cb-22c9-46c2-b3a2-ed3ca58058a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:51.598312 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc564cb-22c9-46c2-b3a2-ed3ca58058a1 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:51.598488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85ff96-4b50-4999-a4e9-3bf98fec2353 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:51.598605 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc564cb-22c9-46c2-b3a2-ed3ca58058a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:51.598861 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc564cb-22c9-46c2-b3a2-ed3ca58058a1 None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:51.599599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc564cb-22c9-46c2-b3a2-ed3ca58058a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:51.599900 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc564cb-22c9-46c2-b3a2-ed3ca58058a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:51.601259 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc564cb-22c9-46c2-b3a2-ed3ca58058a1 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:51.611629 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 254/507] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:51.612388 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85ff96-4b50-4999-a4e9-3bf98fec2353 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:51.614819 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 254/508] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:51.615855 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc564cb-22c9-46c2-b3a2-ed3ca58058a1 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:51.719891 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85ff96-4b50-4999-a4e9-3bf98fec2353 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:51.722072 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc564cb-22c9-46c2-b3a2-ed3ca58058a1 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:51.757760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae48e74-3e26-4c84-8796-af15c4fd4191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:51.758555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae48e74-3e26-4c84-8796-af15c4fd4191 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:51.758850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae48e74-3e26-4c84-8796-af15c4fd4191 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:51.759120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae48e74-3e26-4c84-8796-af15c4fd4191 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:51.764298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76f75d-d19b-4c61-9b7e-825df985946f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:51.764952 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76f75d-d19b-4c61-9b7e-825df985946f None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:51.765230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76f75d-d19b-4c61-9b7e-825df985946f None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:51.765502 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76f75d-d19b-4c61-9b7e-825df985946f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:51.826464 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae48e74-3e26-4c84-8796-af15c4fd4191 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:51.827927 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae48e74-3e26-4c84-8796-af15c4fd4191 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:51.831519 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76f75d-d19b-4c61-9b7e-825df985946f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:51.832988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76f75d-d19b-4c61-9b7e-825df985946f None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:51.925211 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 255/509] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:51.926064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae48e74-3e26-4c84-8796-af15c4fd4191 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:51.935768 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 255/510] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:51.936607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76f75d-d19b-4c61-9b7e-825df985946f None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:52.022607 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae48e74-3e26-4c84-8796-af15c4fd4191 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:52.041408 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76f75d-d19b-4c61-9b7e-825df985946f None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:52.058267 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a87540-6f63-4d7b-bd27-89de647e4a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:52.059205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a87540-6f63-4d7b-bd27-89de647e4a9b None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:52.059573 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a87540-6f63-4d7b-bd27-89de647e4a9b None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:52.060297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a87540-6f63-4d7b-bd27-89de647e4a9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:52.072874 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a87540-6f63-4d7b-bd27-89de647e4a9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:52.077352 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614cf33-5d92-4dbc-9cf0-04e7c3c7f4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:52.078145 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614cf33-5d92-4dbc-9cf0-04e7c3c7f4e4 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:52.078449 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614cf33-5d92-4dbc-9cf0-04e7c3c7f4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:52.078717 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614cf33-5d92-4dbc-9cf0-04e7c3c7f4e4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:52.081789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-67a87540-6f63-4d7b-bd27-89de647e4a9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:52.081789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:52.081789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:52.081789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:52.081789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:52.081789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:52.081789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:52.081789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:52.081789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:52.081789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:52.081789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:52.081789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:52.081789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:52.081789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:52.081789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:52.081789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:52.082754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:52.082754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:52.082754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:52.082754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:52.082754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:52.082754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:52.082754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:52.082754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:52.082754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:52.082754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:52.082754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:52.082754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:52.082754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:52.082754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:52.082754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:52.082754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:52.083804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:52.083804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:52.083804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:52.083804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:52.083804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:52.083804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:52.083804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:52.083804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:52.083804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:52.083804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:52.083804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:52.083804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:52.083804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 256/511] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:47:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:52.083804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a87540-6f63-4d7b-bd27-89de647e4a9b None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:52.087109 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614cf33-5d92-4dbc-9cf0-04e7c3c7f4e4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:52.088867 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614cf33-5d92-4dbc-9cf0-04e7c3c7f4e4 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:52.104864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-e614cf33-5d92-4dbc-9cf0-04e7c3c7f4e4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 13:47:52.104864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:52.104864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:52.104864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:52.104864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:52.104864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:52.104864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:52.104864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:52.104864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:52.104864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:52.104864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:52.104864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:52.104864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:52.104864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:52.104864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:52.104864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:52.105879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:52.105879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:52.105879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:52.105879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:52.105879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:52.105879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:52.105879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:52.105879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:52.105879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:52.105879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:52.105879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:52.105879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:52.105879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:52.105879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:52.105879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:52.105879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:52.105879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:52.105879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:52.107139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:52.107139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:52.107139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:52.107139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:52.107139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:52.107139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:52.107139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:52.107139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:52.107139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 13:47:52.107139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:52.107139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 256/512] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:52.107728 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614cf33-5d92-4dbc-9cf0-04e7c3c7f4e4 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:52.190576 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a87540-6f63-4d7b-bd27-89de647e4a9b None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:52.217004 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614cf33-5d92-4dbc-9cf0-04e7c3c7f4e4 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:52.224753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a991f-7d79-450d-b5a9-22e2201c2a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:52.225432 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a991f-7d79-450d-b5a9-22e2201c2a97 None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:52.225714 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a991f-7d79-450d-b5a9-22e2201c2a97 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:52.225986 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a991f-7d79-450d-b5a9-22e2201c2a97 None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:52.226734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a991f-7d79-450d-b5a9-22e2201c2a97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:52.228199 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a991f-7d79-450d-b5a9-22e2201c2a97 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:52.248735 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 257/513] 10.222.0.32 () {60 vars in 1132 bytes} [Tue May 10 13:47:52 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:47:52.249566 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a991f-7d79-450d-b5a9-22e2201c2a97 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:52.267741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37069521-8c76-40ff-b8b4-12bae8b26248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:52.268799 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37069521-8c76-40ff-b8b4-12bae8b26248 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:52.269210 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37069521-8c76-40ff-b8b4-12bae8b26248 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:52.269619 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37069521-8c76-40ff-b8b4-12bae8b26248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:52.282839 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37069521-8c76-40ff-b8b4-12bae8b26248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:52.284399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37069521-8c76-40ff-b8b4-12bae8b26248 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:52.304980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-37069521-8c76-40ff-b8b4-12bae8b26248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:52.304980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:52.304980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:52.304980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:52.304980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:52.304980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:52.304980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:52.304980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:52.304980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:52.304980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:52.304980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:52.304980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:52.304980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:52.304980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:52.304980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:52.305962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:52.305962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:52.305962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:52.305962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:52.305962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:52.305962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:52.305962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:52.305962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:52.305962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:52.305962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:52.305962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:52.305962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:52.305962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:52.305962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:52.305962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:52.305962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:52.305962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:52.306900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:52.306900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:52.306900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:52.306900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:52.306900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 257/514] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:52.307172 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37069521-8c76-40ff-b8b4-12bae8b26248 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:52.388721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a991f-7d79-450d-b5a9-22e2201c2a97 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:52.431155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee6027-2c3f-4e51-8d8d-0e581d2e94d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:52.432014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee6027-2c3f-4e51-8d8d-0e581d2e94d8 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:52.432302 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee6027-2c3f-4e51-8d8d-0e581d2e94d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:52.432622 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee6027-2c3f-4e51-8d8d-0e581d2e94d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:52.445419 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37069521-8c76-40ff-b8b4-12bae8b26248 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:52.445949 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee6027-2c3f-4e51-8d8d-0e581d2e94d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:52.447321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee6027-2c3f-4e51-8d8d-0e581d2e94d8 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:52.470999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-8bee6027-2c3f-4e51-8d8d-0e581d2e94d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:52.470999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:52.470999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:52.470999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:52.470999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:52.470999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:52.470999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:52.470999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:52.470999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:52.470999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:52.470999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:52.470999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:52.470999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:52.470999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:52.470999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:52.471916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:52.471916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:52.471916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:52.471916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:52.471916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:52.471916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:52.471916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:52.471916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:52.471916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:52.471916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:52.471916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:52.471916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:52.471916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:52.471916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:52.471916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:52.471916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:52.471916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:52.472765 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:52.472765 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:52.472765 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:52.472765 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:52.472765 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 258/515] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:52.474380 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee6027-2c3f-4e51-8d8d-0e581d2e94d8 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:52.485778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e2e22-86c8-4db4-995e-354ed496ee42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:52.486811 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e2e22-86c8-4db4-995e-354ed496ee42 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:52.487206 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e2e22-86c8-4db4-995e-354ed496ee42 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:52.487593 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e2e22-86c8-4db4-995e-354ed496ee42 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:52.488651 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e2e22-86c8-4db4-995e-354ed496ee42 None admin] RBAC: Adding query filter params (name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:52.489985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e2e22-86c8-4db4-995e-354ed496ee42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:52.491003 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e2e22-86c8-4db4-995e-354ed496ee42 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:52.509855 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 258/516] 10.222.0.32 () {56 vars in 1103 bytes} [Tue May 10 13:47:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:52.509855 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e2e22-86c8-4db4-995e-354ed496ee42 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:52.619212 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee6027-2c3f-4e51-8d8d-0e581d2e94d8 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:52.639431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e2e22-86c8-4db4-995e-354ed496ee42 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:52.667062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe936b-0d77-4c33-be3b-a86dae45e11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:52.667769 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe936b-0d77-4c33-be3b-a86dae45e11f None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:52.668056 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe936b-0d77-4c33-be3b-a86dae45e11f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:52.668336 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe936b-0d77-4c33-be3b-a86dae45e11f None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:52.670327 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe936b-0d77-4c33-be3b-a86dae45e11f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:52.670761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe936b-0d77-4c33-be3b-a86dae45e11f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:52.672285 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe936b-0d77-4c33-be3b-a86dae45e11f None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:52.678639 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeff394-7e2d-4a6c-8600-45acbc800ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:52.679319 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeff394-7e2d-4a6c-8600-45acbc800ea4 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:52.679601 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeff394-7e2d-4a6c-8600-45acbc800ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:52.679876 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeff394-7e2d-4a6c-8600-45acbc800ea4 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:52.680611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeff394-7e2d-4a6c-8600-45acbc800ea4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:52.680918 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeff394-7e2d-4a6c-8600-45acbc800ea4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:52.682322 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeff394-7e2d-4a6c-8600-45acbc800ea4 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:52.695897 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 259/517] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:52.697086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeff394-7e2d-4a6c-8600-45acbc800ea4 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:52.709014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 259/518] 10.222.0.32 () {56 vars in 1137 bytes} [Tue May 10 13:47:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:52.709014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe936b-0d77-4c33-be3b-a86dae45e11f None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:52.813628 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe936b-0d77-4c33-be3b-a86dae45e11f None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:52.819072 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeff394-7e2d-4a6c-8600-45acbc800ea4 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:52.857242 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f0020-f16d-4cf8-bb03-2a19da64c57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:52.858148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f0020-f16d-4cf8-bb03-2a19da64c57a None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:52.858467 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f0020-f16d-4cf8-bb03-2a19da64c57a None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:52.858745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f0020-f16d-4cf8-bb03-2a19da64c57a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:52.867995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79943d08-fe20-4dcc-b7df-0504bd1e2de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:52.868977 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79943d08-fe20-4dcc-b7df-0504bd1e2de1 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:52.869455 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79943d08-fe20-4dcc-b7df-0504bd1e2de1 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:52.869948 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79943d08-fe20-4dcc-b7df-0504bd1e2de1 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:52.871441 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79943d08-fe20-4dcc-b7df-0504bd1e2de1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:52.872035 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79943d08-fe20-4dcc-b7df-0504bd1e2de1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:52.872530 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f0020-f16d-4cf8-bb03-2a19da64c57a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:52.874008 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f0020-f16d-4cf8-bb03-2a19da64c57a None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:52.874768 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79943d08-fe20-4dcc-b7df-0504bd1e2de1 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:52.889080 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 260/519] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:52.890294 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79943d08-fe20-4dcc-b7df-0504bd1e2de1 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:52.893271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-a13f0020-f16d-4cf8-bb03-2a19da64c57a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:52.893271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:52.893271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:52.893271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:52.893271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:52.893271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:52.893271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:52.893271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:52.893271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:52.893271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:52.893271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:52.893271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:52.893271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:52.893271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:52.893271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:52.894115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:52.894115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:52.894115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:52.894115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:52.894115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:52.894115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:52.894115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:52.894115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:52.894115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:52.894115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:52.894115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:52.894115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:52.894115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:52.894115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:52.894115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:52.894115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:52.894115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:52.899823 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:52.899823 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:52.899823 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:52.899823 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:52.899823 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 260/520] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:52.899823 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f0020-f16d-4cf8-bb03-2a19da64c57a None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:53.003357 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79943d08-fe20-4dcc-b7df-0504bd1e2de1 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:53.014878 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f0020-f16d-4cf8-bb03-2a19da64c57a None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:53.039589 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c649c89-834c-4a02-8ce4-35a05b790b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:53.040375 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c649c89-834c-4a02-8ce4-35a05b790b6a None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:53.040650 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c649c89-834c-4a02-8ce4-35a05b790b6a None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:53.040916 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c649c89-834c-4a02-8ce4-35a05b790b6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:53.047812 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c649c89-834c-4a02-8ce4-35a05b790b6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:53.049257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c649c89-834c-4a02-8ce4-35a05b790b6a None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:53.049523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b34b0-4e8d-4e11-83ad-d5e4215eae83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:53.050181 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b34b0-4e8d-4e11-83ad-d5e4215eae83 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:53.050566 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b34b0-4e8d-4e11-83ad-d5e4215eae83 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:53.050841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b34b0-4e8d-4e11-83ad-d5e4215eae83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:53.065607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-5c649c89-834c-4a02-8ce4-35a05b790b6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:53.065607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:53.065607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:53.065607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:53.065607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:53.065607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:53.065607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:53.065607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:53.065607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:53.065607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:53.065607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:53.065607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:53.065607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:53.065607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:53.065607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:53.066696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:53.066696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:53.066696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:53.066696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:53.066696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:53.066696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:53.066696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:53.066696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:53.066696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:53.066696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:53.066696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:53.066696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:53.066696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:53.066696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:53.066696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:53.066696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:53.066696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:53.067745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:53.067745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:53.067745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:53.067745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:53.067745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:53.067745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:53.067745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:53.067745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:53.067745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 261/521] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:47:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:53.067745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c649c89-834c-4a02-8ce4-35a05b790b6a None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:53.122665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b34b0-4e8d-4e11-83ad-d5e4215eae83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:53.124242 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b34b0-4e8d-4e11-83ad-d5e4215eae83 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:53.168931 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c649c89-834c-4a02-8ce4-35a05b790b6a None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:53.206044 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e66ce3-9e03-4919-8de5-17c6232af85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:53.206877 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e66ce3-9e03-4919-8de5-17c6232af85d None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:53.207155 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e66ce3-9e03-4919-8de5-17c6232af85d None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:53.207433 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e66ce3-9e03-4919-8de5-17c6232af85d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:53.220752 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e66ce3-9e03-4919-8de5-17c6232af85d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:53.222429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e66ce3-9e03-4919-8de5-17c6232af85d None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:53.232502 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 261/522] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:53.233728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b34b0-4e8d-4e11-83ad-d5e4215eae83 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:53.237404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-b0e66ce3-9e03-4919-8de5-17c6232af85d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:53.237404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:53.237404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:53.237404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:53.237404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:53.237404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:53.237404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:53.237404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:53.237404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:53.237404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:53.237404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:53.237404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:53.237404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:53.237404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:53.237404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:53.238249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:53.238249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:53.238249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:53.238249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:53.238249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:53.238249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:53.238249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:53.238249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:53.238249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:53.238249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:53.238249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:53.238249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:53.238249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:53.238249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:53.238249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:53.238249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:53.238249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:53.239234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:53.239234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:53.239234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:53.239234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:53.239234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:53.239234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:53.239234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:53.239234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:53.243350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 262/523] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:47:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:53.244061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e66ce3-9e03-4919-8de5-17c6232af85d None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:53.351698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b34b0-4e8d-4e11-83ad-d5e4215eae83 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:53.357535 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e66ce3-9e03-4919-8de5-17c6232af85d None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:53.384694 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6aa95-feb9-4dc2-8a58-059b4024a96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:53.385362 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6aa95-feb9-4dc2-8a58-059b4024a96b None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:53.385640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6aa95-feb9-4dc2-8a58-059b4024a96b None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:53.385911 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6aa95-feb9-4dc2-8a58-059b4024a96b None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:53.386657 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6aa95-feb9-4dc2-8a58-059b4024a96b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:53.386960 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6aa95-feb9-4dc2-8a58-059b4024a96b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:53.388389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6aa95-feb9-4dc2-8a58-059b4024a96b None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:53.392401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f0cae-1e0b-44a1-828c-b73fd09ec084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:53.393282 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f0cae-1e0b-44a1-828c-b73fd09ec084 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:53.393704 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f0cae-1e0b-44a1-828c-b73fd09ec084 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:53.394139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f0cae-1e0b-44a1-828c-b73fd09ec084 None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:53.395105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f0cae-1e0b-44a1-828c-b73fd09ec084 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:53.395558 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f0cae-1e0b-44a1-828c-b73fd09ec084 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:53.397132 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f0cae-1e0b-44a1-828c-b73fd09ec084 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:53.399508 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 262/524] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:53.400320 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6aa95-feb9-4dc2-8a58-059b4024a96b None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:53.416909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 263/525] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:47:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:53.418008 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f0cae-1e0b-44a1-828c-b73fd09ec084 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:53.507490 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6aa95-feb9-4dc2-8a58-059b4024a96b None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:53.522875 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f0cae-1e0b-44a1-828c-b73fd09ec084 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:53.541284 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ad729-7051-43e0-a295-f212385508bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:53.542088 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ad729-7051-43e0-a295-f212385508bd None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:53.542403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ad729-7051-43e0-a295-f212385508bd None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:53.542682 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ad729-7051-43e0-a295-f212385508bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:53.554184 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ad729-7051-43e0-a295-f212385508bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:53.555481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ad729-7051-43e0-a295-f212385508bd None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:53.558724 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4069b9-d4de-406c-ab73-380c8a48c5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:53.559392 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4069b9-d4de-406c-ab73-380c8a48c5ed None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:53.560351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4069b9-d4de-406c-ab73-380c8a48c5ed None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:53.560704 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4069b9-d4de-406c-ab73-380c8a48c5ed None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:53.561556 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4069b9-d4de-406c-ab73-380c8a48c5ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:53.561865 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4069b9-d4de-406c-ab73-380c8a48c5ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:53.563386 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4069b9-d4de-406c-ab73-380c8a48c5ed None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:53.573067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-601ad729-7051-43e0-a295-f212385508bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:53.573067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:53.573067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:53.573067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:53.573067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:53.573067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:53.573067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:53.573067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:53.573067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:53.573067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:53.573067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:53.573067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:53.573067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:53.573067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:53.573067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:53.574084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:53.574084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:53.574084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:53.574084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:53.574084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:53.574084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:53.574084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:53.574084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:53.574084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:53.574084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:53.574084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:53.574084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:53.574084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:53.574084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:53.574084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:53.574084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:53.574084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:53.575118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:53.575118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:53.575118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:53.575118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:53.575118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 263/526] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:53.575118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ad729-7051-43e0-a295-f212385508bd None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:53.580560 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 264/527] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:47:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:53.581741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4069b9-d4de-406c-ab73-380c8a48c5ed None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:53.674734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ad729-7051-43e0-a295-f212385508bd None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:53.680546 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4069b9-d4de-406c-ab73-380c8a48c5ed None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:53.709045 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e71262-bb0f-4918-a0a2-53dde773e4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:53.709848 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e71262-bb0f-4918-a0a2-53dde773e4c3 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:53.710130 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e71262-bb0f-4918-a0a2-53dde773e4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:53.710429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e71262-bb0f-4918-a0a2-53dde773e4c3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:53.714370 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b70249-061f-4410-9cb5-a7a4042c04c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:53.715030 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b70249-061f-4410-9cb5-a7a4042c04c9 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:53.715312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b70249-061f-4410-9cb5-a7a4042c04c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:53.715586 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b70249-061f-4410-9cb5-a7a4042c04c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:53.717096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b70249-061f-4410-9cb5-a7a4042c04c9 None admin] RBAC: Adding query filter params (role.id=567077e602b043f8b81abc208831228a, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=e5d4fd26c21f4170a6790369344f8334) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:53.717326 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b70249-061f-4410-9cb5-a7a4042c04c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:53.718618 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e71262-bb0f-4918-a0a2-53dde773e4c3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:53.718821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b70249-061f-4410-9cb5-a7a4042c04c9 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:53.720040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e71262-bb0f-4918-a0a2-53dde773e4c3 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:53.734248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 265/528] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:47:53 2022] GET /identity/v3/role_assignments?user.id=e5d4fd26c21f4170a6790369344f8334&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=567077e602b043f8b81abc208831228a => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:53.734248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b70249-061f-4410-9cb5-a7a4042c04c9 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:53.734563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-f5e71262-bb0f-4918-a0a2-53dde773e4c3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 13:47:53.734563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:53.734563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:53.734563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:53.734563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:53.734563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:53.734563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:53.734563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:53.734563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:53.734563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:53.734563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:53.734563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:53.734563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:53.734563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:53.734563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:53.734563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:53.735568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:53.735568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:53.735568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:53.735568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:53.735568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:53.735568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:53.735568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:53.735568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:53.735568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:53.735568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:53.735568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:53.735568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:53.735568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:53.735568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:53.735568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:53.735568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:53.735568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:53.735568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:53.736469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:53.736469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:53.736469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:53.736469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:53.736469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:53.736469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:53.736469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:53.736469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:53.736469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 13:47:53.736469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:53.736469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 264/529] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:47:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:53.736469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e71262-bb0f-4918-a0a2-53dde773e4c3 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:53.876500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e71262-bb0f-4918-a0a2-53dde773e4c3 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:53.890851 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b70249-061f-4410-9cb5-a7a4042c04c9 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:53.927432 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9d614-a724-47c1-8de9-b0bd23344f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:53.928176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9d614-a724-47c1-8de9-b0bd23344f9a None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:53.928403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9d614-a724-47c1-8de9-b0bd23344f9a None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:53.928808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9d614-a724-47c1-8de9-b0bd23344f9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:53.929291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721de25b-255c-4dbb-a095-b079f63f7cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:53.929664 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9d614-a724-47c1-8de9-b0bd23344f9a None admin] RBAC: Adding query filter params (role.id=567077e602b043f8b81abc208831228a, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=ada4e799ead24839b109377db3c6393b) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:53.929959 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721de25b-255c-4dbb-a095-b079f63f7cf7 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:53.930055 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9d614-a724-47c1-8de9-b0bd23344f9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:53.930277 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721de25b-255c-4dbb-a095-b079f63f7cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:53.930545 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721de25b-255c-4dbb-a095-b079f63f7cf7 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:53.931268 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721de25b-255c-4dbb-a095-b079f63f7cf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:53.931568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721de25b-255c-4dbb-a095-b079f63f7cf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:53.931664 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9d614-a724-47c1-8de9-b0bd23344f9a None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:53.934410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721de25b-255c-4dbb-a095-b079f63f7cf7 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:53.940322 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 265/530] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:47:53 2022] GET /identity/v3/role_assignments?user.id=ada4e799ead24839b109377db3c6393b&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=567077e602b043f8b81abc208831228a => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:53.941023 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9d614-a724-47c1-8de9-b0bd23344f9a None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:53.959851 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 266/531] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:53.965682 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721de25b-255c-4dbb-a095-b079f63f7cf7 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:54.108678 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9d614-a724-47c1-8de9-b0bd23344f9a None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:54.144464 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721de25b-255c-4dbb-a095-b079f63f7cf7 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:54.185651 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b112c2-6009-40f5-93b5-320cd7a290c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:54.185978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b112c2-6009-40f5-93b5-320cd7a290c8 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:54.186329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b112c2-6009-40f5-93b5-320cd7a290c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:54.186522 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b112c2-6009-40f5-93b5-320cd7a290c8 None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:54.187374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b112c2-6009-40f5-93b5-320cd7a290c8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:54.187685 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b112c2-6009-40f5-93b5-320cd7a290c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:54.189149 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b112c2-6009-40f5-93b5-320cd7a290c8 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:54.208007 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5505d87-ddf5-4030-835e-bb9a00b85f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:54.209199 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5505d87-ddf5-4030-835e-bb9a00b85f14 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:54.209691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5505d87-ddf5-4030-835e-bb9a00b85f14 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:54.210163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5505d87-ddf5-4030-835e-bb9a00b85f14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:54.220516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5505d87-ddf5-4030-835e-bb9a00b85f14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:54.222298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5505d87-ddf5-4030-835e-bb9a00b85f14 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:54.224012 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 266/532] 10.222.0.32 () {56 vars in 1139 bytes} [Tue May 10 13:47:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:54.229291 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b112c2-6009-40f5-93b5-320cd7a290c8 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:54.238971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-c5505d87-ddf5-4030-835e-bb9a00b85f14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:54.238971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:54.238971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:54.238971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:54.238971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:54.238971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:54.238971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:54.238971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:54.238971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:54.238971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:54.238971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:54.238971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:54.238971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:54.238971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:54.238971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:54.239861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:54.239861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:54.239861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:54.239861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:54.239861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:54.239861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:54.239861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:54.239861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:54.239861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:54.239861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:54.239861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:54.239861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:54.239861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:54.239861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:54.239861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:54.239861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:54.239861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:54.240782 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:54.240782 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:54.240782 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:54.240782 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:54.240782 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:54.240782 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:54.240782 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:54.240782 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:54.243280 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 267/533] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:47:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:54.249740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5505d87-ddf5-4030-835e-bb9a00b85f14 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:54.365216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5505d87-ddf5-4030-835e-bb9a00b85f14 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:54.402359 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4245975-84ff-43fb-bdfc-368e41927f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:54.404053 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4245975-84ff-43fb-bdfc-368e41927f0e None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:54.404762 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4245975-84ff-43fb-bdfc-368e41927f0e None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:54.405440 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4245975-84ff-43fb-bdfc-368e41927f0e None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:54.406476 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4245975-84ff-43fb-bdfc-368e41927f0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:54.407016 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4245975-84ff-43fb-bdfc-368e41927f0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:54.408670 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4245975-84ff-43fb-bdfc-368e41927f0e None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:54.414526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b112c2-6009-40f5-93b5-320cd7a290c8 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:54.423324 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 268/534] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:47:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:54.429417 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4245975-84ff-43fb-bdfc-368e41927f0e None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:54.470829 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8942d-1c89-45cf-8c00-2a21bf426dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:54.471524 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8942d-1c89-45cf-8c00-2a21bf426dc2 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:54.471811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8942d-1c89-45cf-8c00-2a21bf426dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:54.472091 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8942d-1c89-45cf-8c00-2a21bf426dc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:54.547036 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4245975-84ff-43fb-bdfc-368e41927f0e None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:54.585981 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067639a-efbe-4053-9922-72de76c0bdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:54.587027 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067639a-efbe-4053-9922-72de76c0bdc3 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:54.587521 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067639a-efbe-4053-9922-72de76c0bdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:54.587994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067639a-efbe-4053-9922-72de76c0bdc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:54.589054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067639a-efbe-4053-9922-72de76c0bdc3 None admin] RBAC: Adding query filter params (role.id=567077e602b043f8b81abc208831228a, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=42629678b7dd40fe8013b9644ac337d3) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:54.589566 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067639a-efbe-4053-9922-72de76c0bdc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:54.591993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067639a-efbe-4053-9922-72de76c0bdc3 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:54.602595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 269/535] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:47:54 2022] GET /identity/v3/role_assignments?user.id=42629678b7dd40fe8013b9644ac337d3&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=567077e602b043f8b81abc208831228a => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:54.639324 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8942d-1c89-45cf-8c00-2a21bf426dc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:54.640773 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8942d-1c89-45cf-8c00-2a21bf426dc2 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:54.644632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a140e-d2a5-4fc6-b2ed-0d1389bc3d50 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:54.644913 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a140e-d2a5-4fc6-b2ed-0d1389bc3d50 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:54.645191 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a140e-d2a5-4fc6-b2ed-0d1389bc3d50 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:54.646738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 270/536] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:54.653047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b2724-4a21-44cf-93f1-ab3009619539 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:54.653905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b2724-4a21-44cf-93f1-ab3009619539 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:54.654458 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b2724-4a21-44cf-93f1-ab3009619539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:54.673129 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-771b2724-4a21-44cf-93f1-ab3009619539 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:54.674809 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-771b2724-4a21-44cf-93f1-ab3009619539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:54.751366 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 271/537] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:47:54.780326 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b2724-4a21-44cf-93f1-ab3009619539 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:54.834233 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 267/538] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 13:47:54.840462 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8942d-1c89-45cf-8c00-2a21bf426dc2 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:54.905349 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b2724-4a21-44cf-93f1-ab3009619539 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:54.956415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a404c-5f00-4a29-807e-61a08bda09d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:54.957587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a404c-5f00-4a29-807e-61a08bda09d3 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:54.958070 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a404c-5f00-4a29-807e-61a08bda09d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:54.958576 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a404c-5f00-4a29-807e-61a08bda09d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:54.978378 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a404c-5f00-4a29-807e-61a08bda09d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:54.990684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-493a404c-5f00-4a29-807e-61a08bda09d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:54.990684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:54.990684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:54.990684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:54.990684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:54.990684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:54.990684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:54.990684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:54.990684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:54.990684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:54.990684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:54.990684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:54.990684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:54.990684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:54.990684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:54.990684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:54.991616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:54.991616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:54.991616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:54.991616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:54.991616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:54.991616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:54.991616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:54.991616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:54.991616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:54.991616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:54.991616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:54.991616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:54.991616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:54.991616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:54.991616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:54.991616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:54.992382 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:54.992382 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:54.992382 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:54.992382 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:54.992382 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:54.992382 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:54.992382 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:54.992382 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:54.992382 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:54.992382 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:54.992382 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:54.992382 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:54.995870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 272/539] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:47:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:55.002499 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a404c-5f00-4a29-807e-61a08bda09d3 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:55.080687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8942d-1c89-45cf-8c00-2a21bf426dc2 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:55.128856 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19204d78-1474-4d60-ab2a-249492db23bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:55.130048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19204d78-1474-4d60-ab2a-249492db23bc None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:55.130574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19204d78-1474-4d60-ab2a-249492db23bc None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:55.131045 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19204d78-1474-4d60-ab2a-249492db23bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:55.155582 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19204d78-1474-4d60-ab2a-249492db23bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:55.158912 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19204d78-1474-4d60-ab2a-249492db23bc None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:55.206552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-19204d78-1474-4d60-ab2a-249492db23bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:55.206552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:55.206552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:55.206552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:55.206552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:55.206552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:55.206552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:55.206552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:55.206552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:55.206552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:55.206552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:55.206552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:55.206552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:55.206552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:55.206552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:55.207998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:55.207998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:55.207998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:55.207998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:55.207998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:55.207998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:55.207998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:55.207998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:55.207998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:55.207998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:55.207998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:55.207998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:55.207998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:55.207998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:55.207998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:55.207998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:55.207998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:55.209500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:55.209500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:55.209500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:55.209500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:55.215743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 268/540] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:55.223087 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19204d78-1474-4d60-ab2a-249492db23bc None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:55.265053 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a404c-5f00-4a29-807e-61a08bda09d3 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:55.349668 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19204d78-1474-4d60-ab2a-249492db23bc None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:55.366916 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6d03a-4325-461f-9e07-7f9f9caab985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:55.367658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6d03a-4325-461f-9e07-7f9f9caab985 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:55.367948 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6d03a-4325-461f-9e07-7f9f9caab985 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:55.368229 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6d03a-4325-461f-9e07-7f9f9caab985 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:55.369055 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6d03a-4325-461f-9e07-7f9f9caab985 None admin] RBAC: Adding query filter params (name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:55.369320 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6d03a-4325-461f-9e07-7f9f9caab985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:55.370867 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6d03a-4325-461f-9e07-7f9f9caab985 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:55.394223 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 273/541] 10.222.0.32 () {56 vars in 1103 bytes} [Tue May 10 13:47:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:55.395071 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6d03a-4325-461f-9e07-7f9f9caab985 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:55.398456 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a97023-58e1-487c-a968-518fd1a71294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:55.400264 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a97023-58e1-487c-a968-518fd1a71294 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:55.400777 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a97023-58e1-487c-a968-518fd1a71294 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:55.401265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a97023-58e1-487c-a968-518fd1a71294 None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:55.402222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a97023-58e1-487c-a968-518fd1a71294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:55.402731 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a97023-58e1-487c-a968-518fd1a71294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:55.404913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a97023-58e1-487c-a968-518fd1a71294 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:55.426915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 269/542] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:55.435897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a97023-58e1-487c-a968-518fd1a71294 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:55.536752 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6d03a-4325-461f-9e07-7f9f9caab985 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:55.578186 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e54b1-39f7-47fc-9617-cad8a283ebf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:55.579024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e54b1-39f7-47fc-9617-cad8a283ebf7 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:55.579308 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e54b1-39f7-47fc-9617-cad8a283ebf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:55.579585 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e54b1-39f7-47fc-9617-cad8a283ebf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:55.592871 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e54b1-39f7-47fc-9617-cad8a283ebf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:55.594376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e54b1-39f7-47fc-9617-cad8a283ebf7 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:55.617279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-0d3e54b1-39f7-47fc-9617-cad8a283ebf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:55.617279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:55.617279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:55.617279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:55.617279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:55.617279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:55.617279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:55.617279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:55.617279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:55.617279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:55.617279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:55.617279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:55.617279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:55.617279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:55.617279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:55.618176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:55.618176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:55.618176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:55.618176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:55.618176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:55.618176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:55.618176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:55.618176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:55.618176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:55.618176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:55.618176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:55.618176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:55.618176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:55.618176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:55.618176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:55.618176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:55.618176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:55.619032 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:55.619032 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:55.619032 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:55.619032 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:55.619032 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 274/543] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:55.625328 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e54b1-39f7-47fc-9617-cad8a283ebf7 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:55.657331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a97023-58e1-487c-a968-518fd1a71294 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:55.726656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb7fca-54c4-4c9d-8ce4-9bc9ab639834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:55.727394 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb7fca-54c4-4c9d-8ce4-9bc9ab639834 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:55.727677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb7fca-54c4-4c9d-8ce4-9bc9ab639834 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:55.727956 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb7fca-54c4-4c9d-8ce4-9bc9ab639834 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:55.744895 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb7fca-54c4-4c9d-8ce4-9bc9ab639834 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:55.746417 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb7fca-54c4-4c9d-8ce4-9bc9ab639834 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:55.777513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-b8eb7fca-54c4-4c9d-8ce4-9bc9ab639834 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:55.777513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:55.777513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:55.777513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:55.777513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:55.777513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:55.777513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:55.777513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:55.777513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:55.777513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:55.777513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:55.777513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:55.777513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:55.777513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:55.777513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:55.779672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:55.779672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:55.779672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:55.779672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:55.779672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:55.779672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:55.779672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:55.779672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:55.779672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:55.779672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:55.779672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:55.779672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:55.779672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:55.779672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:55.779672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:55.779672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:55.779672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:55.781338 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:55.781338 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:55.781338 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:55.781338 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:55.781338 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:55.781338 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:55.781338 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:55.781338 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:55.781338 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 270/544] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:47:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:55.787516 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb7fca-54c4-4c9d-8ce4-9bc9ab639834 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:55.880198 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e54b1-39f7-47fc-9617-cad8a283ebf7 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:55.933618 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb7fca-54c4-4c9d-8ce4-9bc9ab639834 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:55.982128 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc117e7-eee2-4ed9-bae5-7d3a70189311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:55.982747 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc117e7-eee2-4ed9-bae5-7d3a70189311 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:55.983033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc117e7-eee2-4ed9-bae5-7d3a70189311 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:55.983314 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc117e7-eee2-4ed9-bae5-7d3a70189311 None admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:55.984141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc117e7-eee2-4ed9-bae5-7d3a70189311 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:55.984456 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc117e7-eee2-4ed9-bae5-7d3a70189311 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:55.985973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc117e7-eee2-4ed9-bae5-7d3a70189311 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:55.990587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95ef4f-c8f8-420c-b9e8-eabec958ea82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:55.991279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95ef4f-c8f8-420c-b9e8-eabec958ea82 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:55.991561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95ef4f-c8f8-420c-b9e8-eabec958ea82 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:55.991836 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95ef4f-c8f8-420c-b9e8-eabec958ea82 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:55.992585 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95ef4f-c8f8-420c-b9e8-eabec958ea82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:55.992890 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95ef4f-c8f8-420c-b9e8-eabec958ea82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:55.994306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95ef4f-c8f8-420c-b9e8-eabec958ea82 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:56.023880 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 275/545] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:56.029822 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95ef4f-c8f8-420c-b9e8-eabec958ea82 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:56.033018 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 271/546] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:47:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:56.036540 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc117e7-eee2-4ed9-bae5-7d3a70189311 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:56.256732 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95ef4f-c8f8-420c-b9e8-eabec958ea82 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:56.276162 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc117e7-eee2-4ed9-bae5-7d3a70189311 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:56.335144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a2b30-357d-4d2b-bfc8-b35476789860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:56.335892 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a2b30-357d-4d2b-bfc8-b35476789860 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:56.336060 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617afb3-db63-4859-9597-4e24f83889b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:56.336250 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a2b30-357d-4d2b-bfc8-b35476789860 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:56.336444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a2b30-357d-4d2b-bfc8-b35476789860 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:56.336698 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617afb3-db63-4859-9597-4e24f83889b0 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:56.336983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617afb3-db63-4859-9597-4e24f83889b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:56.337254 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617afb3-db63-4859-9597-4e24f83889b0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:56.337404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a2b30-357d-4d2b-bfc8-b35476789860 None admin] RBAC: Adding query filter params (role.id=567077e602b043f8b81abc208831228a, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=12eb1c001b5e44d8b5b5bc658ed464f5) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:56.337607 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a2b30-357d-4d2b-bfc8-b35476789860 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:56.339263 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a2b30-357d-4d2b-bfc8-b35476789860 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:56.347164 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617afb3-db63-4859-9597-4e24f83889b0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:56.348659 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617afb3-db63-4859-9597-4e24f83889b0 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:56.354444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 272/547] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:47:56 2022] GET /identity/v3/role_assignments?user.id=12eb1c001b5e44d8b5b5bc658ed464f5&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=567077e602b043f8b81abc208831228a => generated 259 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:56.365999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-c617afb3-db63-4859-9597-4e24f83889b0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 13:47:56.365999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:56.365999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:56.365999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:56.365999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:56.365999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:56.365999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:56.365999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:56.365999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:56.365999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:56.365999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:56.365999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:56.365999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:56.365999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:56.365999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:56.365999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:56.368170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:56.368170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:56.368170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:56.368170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:56.368170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:56.368170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:56.368170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:56.368170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:56.368170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:56.368170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:56.368170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:56.368170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:56.368170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:56.368170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:56.368170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:56.368170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:56.368170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:56.368170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:56.370452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:56.370452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:56.370452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:56.370452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:56.370452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:56.370452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:56.370452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:56.370452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:56.370452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 13:47:56.370452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:56.370452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 276/548] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:47:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:56.378233 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a2b30-357d-4d2b-bfc8-b35476789860 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:56.508603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a2b30-357d-4d2b-bfc8-b35476789860 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:56.537140 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d1f95-22c4-47a4-8856-2e33fce02519 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:56.537654 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d1f95-22c4-47a4-8856-2e33fce02519 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:56.538112 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d1f95-22c4-47a4-8856-2e33fce02519 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:56.550235 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 277/549] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:56 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:56.552636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4f297-d8d7-4af8-86fa-3e10702b875a None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:56.553125 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4f297-d8d7-4af8-86fa-3e10702b875a None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:56.553626 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4f297-d8d7-4af8-86fa-3e10702b875a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:56.559085 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d2c72-aed0-4cf8-95a9-1e854188d7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:56.560874 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d2c72-aed0-4cf8-95a9-1e854188d7c6 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:56.560874 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d2c72-aed0-4cf8-95a9-1e854188d7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:56.560874 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d2c72-aed0-4cf8-95a9-1e854188d7c6 None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:56.561839 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d2c72-aed0-4cf8-95a9-1e854188d7c6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:56.562150 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d2c72-aed0-4cf8-95a9-1e854188d7c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:56.563755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d2c72-aed0-4cf8-95a9-1e854188d7c6 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:56.586019 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 273/550] 10.222.0.32 () {56 vars in 1135 bytes} [Tue May 10 13:47:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:56.594373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d2c72-aed0-4cf8-95a9-1e854188d7c6 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:56.601406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-cef4f297-d8d7-4af8-86fa-3e10702b875a None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:56.602660 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-cef4f297-d8d7-4af8-86fa-3e10702b875a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:56.729483 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 278/551] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:56.766149 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d2c72-aed0-4cf8-95a9-1e854188d7c6 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:56.787377 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4f297-d8d7-4af8-86fa-3e10702b875a None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:56.807666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307589b6-f060-421b-8d96-aa669e2f7d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:56.808909 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307589b6-f060-421b-8d96-aa669e2f7d5d None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:56.809420 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307589b6-f060-421b-8d96-aa669e2f7d5d None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:56.810544 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307589b6-f060-421b-8d96-aa669e2f7d5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:56.898029 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307589b6-f060-421b-8d96-aa669e2f7d5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:56.899560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307589b6-f060-421b-8d96-aa669e2f7d5d None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:56.993452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4f297-d8d7-4af8-86fa-3e10702b875a None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:57.037308 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 274/552] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:47:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 13:47:57.040100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c09619-0b02-45a5-b9c3-47d84b5dc0c9 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:57.040812 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c09619-0b02-45a5-b9c3-47d84b5dc0c9 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:57.041123 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af53e56-0792-4d95-8420-cde2232b4aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:57.041566 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c09619-0b02-45a5-b9c3-47d84b5dc0c9 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:57.041937 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af53e56-0792-4d95-8420-cde2232b4aa4 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:57.042244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af53e56-0792-4d95-8420-cde2232b4aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:57.042523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af53e56-0792-4d95-8420-cde2232b4aa4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:57.049280 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 275/553] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:57.051117 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c09619-0b02-45a5-b9c3-47d84b5dc0c9 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:57.055151 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af53e56-0792-4d95-8420-cde2232b4aa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:57.065878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-8af53e56-0792-4d95-8420-cde2232b4aa4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:57.065878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:57.065878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:57.065878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:57.065878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:57.065878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:57.065878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:57.065878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:57.065878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:57.065878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:57.065878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:57.065878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:57.065878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:57.065878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:57.065878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:57.065878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:57.067691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:57.067691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:57.067691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:57.067691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:57.067691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:57.067691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:57.067691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:57.067691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:57.067691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:57.067691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:57.067691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:57.067691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:57.067691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:57.067691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:57.067691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:57.067691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:57.068468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:57.068468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:57.068468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:57.068468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:57.068468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:57.068468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:57.068468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:57.068468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:57.068468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:57.068468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:57.068468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:57.068468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:57.068468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 279/554] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:47:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:57.069151 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cbf44-c093-4947-b059-a55367d738b8 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:57.069151 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cbf44-c093-4947-b059-a55367d738b8 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:57.069833 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cbf44-c093-4947-b059-a55367d738b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:57.094588 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-206cbf44-c093-4947-b059-a55367d738b8 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:57.095911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-206cbf44-c093-4947-b059-a55367d738b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:57.202001 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 280/555] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:57.202918 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cbf44-c093-4947-b059-a55367d738b8 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:57.218988 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c09619-0b02-45a5-b9c3-47d84b5dc0c9 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:57.276696 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85fcea-177b-453e-9aea-20ae17ec8426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:57.278577 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85fcea-177b-453e-9aea-20ae17ec8426 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:57.279115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85fcea-177b-453e-9aea-20ae17ec8426 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:57.279589 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85fcea-177b-453e-9aea-20ae17ec8426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:57.294967 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85fcea-177b-453e-9aea-20ae17ec8426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:57.297629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85fcea-177b-453e-9aea-20ae17ec8426 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:57.325746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-5b85fcea-177b-453e-9aea-20ae17ec8426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:57.325746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:57.325746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:57.325746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:57.325746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:57.325746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:57.325746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:57.325746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:57.325746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:57.325746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:57.325746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:57.325746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:57.325746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:57.325746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:57.325746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:57.326840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:57.326840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:57.326840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:57.326840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:57.326840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:57.326840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:57.326840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:57.326840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:57.326840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:57.326840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:57.326840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:57.326840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:57.326840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:57.326840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:57.326840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:57.326840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:57.326840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:57.327652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:57.327652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:57.327652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:57.327652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:57.331005 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 276/556] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:57.332233 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85fcea-177b-453e-9aea-20ae17ec8426 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:57.351149 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cbf44-c093-4947-b059-a55367d738b8 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:57.392321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbf43b-67b6-4fb7-9ae6-d28a670a1a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:57.393004 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbf43b-67b6-4fb7-9ae6-d28a670a1a0c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:57.393287 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbf43b-67b6-4fb7-9ae6-d28a670a1a0c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:57.393556 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbf43b-67b6-4fb7-9ae6-d28a670a1a0c None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:57.394357 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbf43b-67b6-4fb7-9ae6-d28a670a1a0c None admin] RBAC: Adding query filter params (name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:57.394661 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbf43b-67b6-4fb7-9ae6-d28a670a1a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:57.396046 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbf43b-67b6-4fb7-9ae6-d28a670a1a0c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:57.411290 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 281/557] 10.222.0.32 () {56 vars in 1103 bytes} [Tue May 10 13:47:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:57.411290 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbf43b-67b6-4fb7-9ae6-d28a670a1a0c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:57.457835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85fcea-177b-453e-9aea-20ae17ec8426 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:57.500520 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67686f-eb2a-433f-9c20-9431debcef73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:57.502041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67686f-eb2a-433f-9c20-9431debcef73 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:57.502596 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67686f-eb2a-433f-9c20-9431debcef73 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:57.503044 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67686f-eb2a-433f-9c20-9431debcef73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:57.516730 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c67686f-eb2a-433f-9c20-9431debcef73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:57.525022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-3c67686f-eb2a-433f-9c20-9431debcef73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:57.525022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:57.525022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:57.525022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:57.525022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:57.525022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:57.525022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:57.525022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:57.525022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:57.525022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:57.525022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:57.525022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:57.525022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:57.525022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:57.525022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:57.525022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:57.526053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:57.526053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:57.526053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:57.526053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:57.526053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:57.526053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:57.526053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:57.526053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:57.526053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:57.526053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:57.526053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:57.526053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:57.526053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:57.526053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:57.526053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:57.526053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:57.526887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:57.526887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:57.526887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:57.526887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:57.526887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:57.526887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:57.526887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:57.526887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:57.526887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:57.526887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:57.526887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:57.526887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:57.527984 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 277/558] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:47:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:57.530394 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87222a3c-9a58-49ca-beb4-6d76e1ff08b0 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:57.530745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87222a3c-9a58-49ca-beb4-6d76e1ff08b0 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:57.531025 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87222a3c-9a58-49ca-beb4-6d76e1ff08b0 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:57.534227 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 278/559] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:57.534227 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87222a3c-9a58-49ca-beb4-6d76e1ff08b0 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:57.556262 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbf43b-67b6-4fb7-9ae6-d28a670a1a0c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:57.604727 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29459e55-35b9-44aa-a474-86ec9470c4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:57.605781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29459e55-35b9-44aa-a474-86ec9470c4bf None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:57.606222 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29459e55-35b9-44aa-a474-86ec9470c4bf None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:57.606934 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29459e55-35b9-44aa-a474-86ec9470c4bf None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:57.608217 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29459e55-35b9-44aa-a474-86ec9470c4bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:57.608633 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29459e55-35b9-44aa-a474-86ec9470c4bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:57.611006 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29459e55-35b9-44aa-a474-86ec9470c4bf None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:57.631719 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 282/560] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:57.632993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29459e55-35b9-44aa-a474-86ec9470c4bf None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:57.693233 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87222a3c-9a58-49ca-beb4-6d76e1ff08b0 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:57.732536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6e53a-d4fb-4b34-8338-2860bf68e744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:57.733336 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6e53a-d4fb-4b34-8338-2860bf68e744 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:57.733616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6e53a-d4fb-4b34-8338-2860bf68e744 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:57.733890 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6e53a-d4fb-4b34-8338-2860bf68e744 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:57.745395 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6e53a-d4fb-4b34-8338-2860bf68e744 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:57.746921 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6e53a-d4fb-4b34-8338-2860bf68e744 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:57.767670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-9cc6e53a-d4fb-4b34-8338-2860bf68e744 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:57.767670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:57.767670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:57.767670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:57.767670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:57.767670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:57.767670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:57.767670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:57.767670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:57.767670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:57.767670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:57.767670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:57.767670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:57.767670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:57.767670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:57.768881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:57.768881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:57.768881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:57.768881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:57.768881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:57.768881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:57.768881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:57.768881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:57.768881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:57.768881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:57.768881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:57.768881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:57.768881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:57.768881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:57.768881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:57.768881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:57.768881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:57.769799 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:57.769799 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:57.769799 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:57.769799 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:57.769799 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 279/561] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:57.770698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5fa9b-f166-49e9-b0aa-53eda6123e67 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:57.770989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5fa9b-f166-49e9-b0aa-53eda6123e67 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:57.771262 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5fa9b-f166-49e9-b0aa-53eda6123e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:57.783907 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29459e55-35b9-44aa-a474-86ec9470c4bf None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:57.788507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-2ad5fa9b-f166-49e9-b0aa-53eda6123e67 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:57.789690 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-2ad5fa9b-f166-49e9-b0aa-53eda6123e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:57.830459 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70be059-e535-439c-affc-f56570a85c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:57.831410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70be059-e535-439c-affc-f56570a85c3e None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:57.831876 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70be059-e535-439c-affc-f56570a85c3e None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:57.832330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70be059-e535-439c-affc-f56570a85c3e None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:57.833645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70be059-e535-439c-affc-f56570a85c3e None admin] RBAC: Adding query filter params (name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:57.834056 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70be059-e535-439c-affc-f56570a85c3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:57.835730 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70be059-e535-439c-affc-f56570a85c3e None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:57.845826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 283/562] 10.222.0.32 () {56 vars in 1103 bytes} [Tue May 10 13:47:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:57.846890 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70be059-e535-439c-affc-f56570a85c3e None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:57.884847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 280/563] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:57.885738 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5fa9b-f166-49e9-b0aa-53eda6123e67 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:57.971121 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70be059-e535-439c-affc-f56570a85c3e None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:58.010001 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb65f3a-8438-4cc7-8083-b97410fb909c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:58.010916 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb65f3a-8438-4cc7-8083-b97410fb909c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:58.011263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb65f3a-8438-4cc7-8083-b97410fb909c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:58.011595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb65f3a-8438-4cc7-8083-b97410fb909c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:58.019578 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb65f3a-8438-4cc7-8083-b97410fb909c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:58.021246 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb65f3a-8438-4cc7-8083-b97410fb909c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:58.036490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-4cb65f3a-8438-4cc7-8083-b97410fb909c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:58.036490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:58.036490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:58.036490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:58.036490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:58.036490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:58.036490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:58.036490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:58.036490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:58.036490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:58.036490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:58.036490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:58.036490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:58.036490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:58.036490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:58.038760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:58.038760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:58.038760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:58.038760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:58.038760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:58.038760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:58.038760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:58.038760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:58.038760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:58.038760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:58.038760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:58.038760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:58.038760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:58.038760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:58.038760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:58.038760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:58.038760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:58.040773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:58.040773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:58.040773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:58.040773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:58.040773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:58.040773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:58.040773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:58.040773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:58.042414 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5fa9b-f166-49e9-b0aa-53eda6123e67 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:58.043708 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 284/564] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:47:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:58.044666 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb65f3a-8438-4cc7-8083-b97410fb909c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:58.085105 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ea394-19e1-42a5-a442-30a87e440cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:58.085919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ea394-19e1-42a5-a442-30a87e440cee None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:58.086435 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ea394-19e1-42a5-a442-30a87e440cee None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:58.086798 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ea394-19e1-42a5-a442-30a87e440cee None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:58.087682 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ea394-19e1-42a5-a442-30a87e440cee None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:58.088124 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ea394-19e1-42a5-a442-30a87e440cee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:58.089705 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ea394-19e1-42a5-a442-30a87e440cee None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:58.106395 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 281/565] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:58.108439 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ea394-19e1-42a5-a442-30a87e440cee None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:58.157249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb65f3a-8438-4cc7-8083-b97410fb909c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:58.194523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061271b-ab4f-4072-af57-aea9e6413afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:58.195320 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061271b-ab4f-4072-af57-aea9e6413afa None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:58.195594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061271b-ab4f-4072-af57-aea9e6413afa None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:58.195860 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061271b-ab4f-4072-af57-aea9e6413afa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:58.206266 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061271b-ab4f-4072-af57-aea9e6413afa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:58.207735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061271b-ab4f-4072-af57-aea9e6413afa None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:58.236492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-7061271b-ab4f-4072-af57-aea9e6413afa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:58.236492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:58.236492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:58.236492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:58.236492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:58.236492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:58.236492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:58.236492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:58.236492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:58.236492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:58.236492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:58.236492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:58.236492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:58.236492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:58.236492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:58.237702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:58.237702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:58.237702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:58.237702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:58.237702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:58.237702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:58.237702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:58.237702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:58.237702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:58.237702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:58.237702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:58.237702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:58.237702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:58.237702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:58.237702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:58.237702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:58.237702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:58.238932 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:58.238932 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:58.238932 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:58.238932 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:58.241756 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 285/566] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:58.243415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061271b-ab4f-4072-af57-aea9e6413afa None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:58.277391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ea394-19e1-42a5-a442-30a87e440cee None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:58.320874 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b999098-1d8b-4c63-b7d6-8be4f7d3e415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:58.321787 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b999098-1d8b-4c63-b7d6-8be4f7d3e415 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:58.322078 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b999098-1d8b-4c63-b7d6-8be4f7d3e415 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:58.322392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b999098-1d8b-4c63-b7d6-8be4f7d3e415 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:58.336645 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b999098-1d8b-4c63-b7d6-8be4f7d3e415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:58.345804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-7b999098-1d8b-4c63-b7d6-8be4f7d3e415 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:58.345804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:58.345804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:58.345804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:58.345804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:58.345804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:58.345804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:58.345804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:58.345804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:58.345804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:58.345804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:58.345804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:58.345804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:58.345804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:58.345804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:58.345804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:58.346841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:58.346841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:58.346841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:58.346841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:58.346841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:58.346841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:58.346841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:58.346841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:58.346841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:58.346841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:58.346841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:58.346841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:58.346841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:58.346841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:58.346841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:58.346841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:58.347627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:58.347627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:58.347627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:58.347627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:58.347627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:58.347627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:58.347627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:58.347627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:58.347627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:58.347627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:58.347627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:58.347627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:58.347627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 282/567] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:47:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:58.348397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b999098-1d8b-4c63-b7d6-8be4f7d3e415 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:58.436784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061271b-ab4f-4072-af57-aea9e6413afa None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:58.491880 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebac61f-2f61-4648-b333-918ec4598ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:58.493051 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebac61f-2f61-4648-b333-918ec4598ba0 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:58.493589 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebac61f-2f61-4648-b333-918ec4598ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:58.494123 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebac61f-2f61-4648-b333-918ec4598ba0 None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:58.496054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebac61f-2f61-4648-b333-918ec4598ba0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:58.496054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebac61f-2f61-4648-b333-918ec4598ba0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:58.498291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebac61f-2f61-4648-b333-918ec4598ba0 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:58.522834 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 286/568] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:47:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:58.522834 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebac61f-2f61-4648-b333-918ec4598ba0 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:58.523109 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b999098-1d8b-4c63-b7d6-8be4f7d3e415 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:58.564861 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cd45a-e86a-4aac-b321-b45c19e337a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:58.565810 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cd45a-e86a-4aac-b321-b45c19e337a3 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:58.566165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cd45a-e86a-4aac-b321-b45c19e337a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:58.566631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cd45a-e86a-4aac-b321-b45c19e337a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:58.576638 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cd45a-e86a-4aac-b321-b45c19e337a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:58.578140 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cd45a-e86a-4aac-b321-b45c19e337a3 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:58.593064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-b04cd45a-e86a-4aac-b321-b45c19e337a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 13:47:58.593064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:58.593064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:58.593064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:58.593064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:58.593064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:58.593064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:58.593064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:58.593064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:58.593064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:58.593064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:58.593064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:58.593064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:58.593064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:58.593064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:58.593064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:58.594643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:58.594643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:58.594643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:58.594643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:58.594643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:58.594643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:58.594643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:58.594643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:58.594643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:58.594643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:58.594643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:58.594643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:58.594643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:58.594643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:58.594643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:58.594643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:58.594643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:58.594643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:58.595913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:58.595913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:58.595913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:58.595913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:58.595913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:58.595913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:58.595913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:58.595913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:58.595913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 13:47:58.595913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:58.598629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 283/569] 10.222.0.32 () {56 vars in 1093 bytes} [Tue May 10 13:47:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:58.600243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cd45a-e86a-4aac-b321-b45c19e337a3 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:58.650334 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebac61f-2f61-4648-b333-918ec4598ba0 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:58.708051 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c3ce2-78fa-4b83-9024-7bd71e56e8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:58.708732 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c3ce2-78fa-4b83-9024-7bd71e56e8a4 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:58.709013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c3ce2-78fa-4b83-9024-7bd71e56e8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:58.709289 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c3ce2-78fa-4b83-9024-7bd71e56e8a4 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:58.710035 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c3ce2-78fa-4b83-9024-7bd71e56e8a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:58.710370 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c3ce2-78fa-4b83-9024-7bd71e56e8a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:58.711816 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c3ce2-78fa-4b83-9024-7bd71e56e8a4 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:58.725697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 287/570] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:58.726601 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c3ce2-78fa-4b83-9024-7bd71e56e8a4 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:58.755354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cd45a-e86a-4aac-b321-b45c19e337a3 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:58.812263 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7238acc-919e-4f6c-8827-9865a19b5d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:58.813160 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7238acc-919e-4f6c-8827-9865a19b5d80 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:58.813554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7238acc-919e-4f6c-8827-9865a19b5d80 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:58.813932 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7238acc-919e-4f6c-8827-9865a19b5d80 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:58.814816 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7238acc-919e-4f6c-8827-9865a19b5d80 None admin] RBAC: Adding query filter params (name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:58.815130 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7238acc-919e-4f6c-8827-9865a19b5d80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:58.816587 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7238acc-919e-4f6c-8827-9865a19b5d80 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:58.831034 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 284/571] 10.222.0.32 () {56 vars in 1103 bytes} [Tue May 10 13:47:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:58.831034 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7238acc-919e-4f6c-8827-9865a19b5d80 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:58.886301 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c3ce2-78fa-4b83-9024-7bd71e56e8a4 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:58.943398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4033e-d75c-4b7e-83fa-829805dd23f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:58.944070 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4033e-d75c-4b7e-83fa-829805dd23f2 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:58.944344 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4033e-d75c-4b7e-83fa-829805dd23f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:58.944611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4033e-d75c-4b7e-83fa-829805dd23f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:58.945439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4033e-d75c-4b7e-83fa-829805dd23f2 None admin] RBAC: Adding query filter params (role.id=567077e602b043f8b81abc208831228a, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=47bbad5318b6417087d7ce6906f8281f) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:58.945749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4033e-d75c-4b7e-83fa-829805dd23f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:58.947245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4033e-d75c-4b7e-83fa-829805dd23f2 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:58.955535 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 288/572] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:47:58 2022] GET /identity/v3/role_assignments?user.id=47bbad5318b6417087d7ce6906f8281f&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=567077e602b043f8b81abc208831228a => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:58.956726 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4033e-d75c-4b7e-83fa-829805dd23f2 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:58.959160 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7238acc-919e-4f6c-8827-9865a19b5d80 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:59.015972 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dfe8e-077e-4d1d-8ec3-d69c1b1553a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:59.017129 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dfe8e-077e-4d1d-8ec3-d69c1b1553a1 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:59.017129 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dfe8e-077e-4d1d-8ec3-d69c1b1553a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:59.017364 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dfe8e-077e-4d1d-8ec3-d69c1b1553a1 None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:59.018143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974dfe8e-077e-4d1d-8ec3-d69c1b1553a1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:59.018419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974dfe8e-077e-4d1d-8ec3-d69c1b1553a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:59.019948 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974dfe8e-077e-4d1d-8ec3-d69c1b1553a1 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:59.046398 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 285/573] 10.222.0.32 () {56 vars in 1133 bytes} [Tue May 10 13:47:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:59.047422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dfe8e-077e-4d1d-8ec3-d69c1b1553a1 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:59.115602 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4033e-d75c-4b7e-83fa-829805dd23f2 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:59.169796 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313299ea-a704-47e3-9059-afb913d1defe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:59.170825 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313299ea-a704-47e3-9059-afb913d1defe None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:59.171460 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313299ea-a704-47e3-9059-afb913d1defe None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:59.171736 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313299ea-a704-47e3-9059-afb913d1defe None admin] PATH_INFO: `/v3/users/glance` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:59.179726 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313299ea-a704-47e3-9059-afb913d1defe None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:59.181182 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313299ea-a704-47e3-9059-afb913d1defe None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:59.192248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dfe8e-077e-4d1d-8ec3-d69c1b1553a1 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:59.196784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-313299ea-a704-47e3-9059-afb913d1defe None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 13:47:59.196784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:59.196784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:59.196784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:59.196784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:59.196784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:59.196784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:59.196784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:59.196784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:59.196784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:59.196784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:59.196784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:59.196784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:59.196784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:59.196784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:59.196784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:59.197894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:59.197894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:59.197894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:59.197894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:59.197894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:59.197894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:59.197894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:59.197894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:59.197894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:59.197894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:59.197894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:59.197894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:59.197894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:59.197894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:59.197894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:59.197894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:59.197894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:59.197894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:59.199106 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:59.199106 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:59.199106 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:59.199106 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:59.199106 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:59.199106 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:59.199106 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:59.199106 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:59.199106 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 13:47:59.199106 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:59.200810 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 289/574] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:59.202225 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b98f6-8c29-4eb5-8e84-ed6fa3812108 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:59.202604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b98f6-8c29-4eb5-8e84-ed6fa3812108 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:59.202991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b98f6-8c29-4eb5-8e84-ed6fa3812108 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:59.205026 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 290/575] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:59.205498 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b98f6-8c29-4eb5-8e84-ed6fa3812108 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:59.250227 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176799a-9148-4d30-b36b-3d537612b89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:59.250227 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176799a-9148-4d30-b36b-3d537612b89b None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:59.250227 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176799a-9148-4d30-b36b-3d537612b89b None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:59.250227 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176799a-9148-4d30-b36b-3d537612b89b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:59.259995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176799a-9148-4d30-b36b-3d537612b89b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:59.261461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176799a-9148-4d30-b36b-3d537612b89b None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:59.281353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-6176799a-9148-4d30-b36b-3d537612b89b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:59.281353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:59.281353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:59.281353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:59.281353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:59.281353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:59.281353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:59.281353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:59.281353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:59.281353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:59.281353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:59.281353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:59.281353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:59.281353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:59.281353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:59.282331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:59.282331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:59.282331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:59.282331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:59.282331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:59.282331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:59.282331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:59.282331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:59.282331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:59.282331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:59.282331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:59.282331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:59.282331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:59.282331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:59.282331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:59.282331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:59.282331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:59.283221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:59.283221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:59.283221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:59.283221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:59.283221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 286/576] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:59.283491 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176799a-9148-4d30-b36b-3d537612b89b None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:59.336641 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b98f6-8c29-4eb5-8e84-ed6fa3812108 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:59.374291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe4814-aaad-4650-890f-8c470c9a3ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:59.375003 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe4814-aaad-4650-890f-8c470c9a3ca1 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:59.375282 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe4814-aaad-4650-890f-8c470c9a3ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:59.375547 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe4814-aaad-4650-890f-8c470c9a3ca1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:59.386164 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe4814-aaad-4650-890f-8c470c9a3ca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:59.388288 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe4814-aaad-4650-890f-8c470c9a3ca1 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:59.402381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176799a-9148-4d30-b36b-3d537612b89b None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:59.408813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-4bfe4814-aaad-4650-890f-8c470c9a3ca1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:59.408813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:59.408813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:59.408813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:59.408813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:59.408813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:59.408813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:59.408813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:59.408813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:59.408813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:59.408813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:59.408813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:59.408813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:59.408813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:59.408813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:59.418295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:59.418295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:59.418295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:59.418295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:59.418295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:59.418295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:59.418295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:59.418295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:59.418295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:59.418295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:59.418295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:59.418295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:59.418295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:59.418295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:59.418295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:59.418295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:59.418295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:59.420534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:59.420534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:59.420534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:59.420534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:59.420534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 291/577] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:59.420534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d8365-064c-4e4d-b329-d28a55c5b93a None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:59.420534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d8365-064c-4e4d-b329-d28a55c5b93a None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:59.420534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d8365-064c-4e4d-b329-d28a55c5b93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:59.439209 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-b74d8365-064c-4e4d-b329-d28a55c5b93a None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:59.440329 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b74d8365-064c-4e4d-b329-d28a55c5b93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:59.440858 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03921c87-3edd-434d-8a06-5faab3db922c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:59.441543 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03921c87-3edd-434d-8a06-5faab3db922c None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:59.441824 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03921c87-3edd-434d-8a06-5faab3db922c None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:59.442097 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03921c87-3edd-434d-8a06-5faab3db922c None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:59.442975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03921c87-3edd-434d-8a06-5faab3db922c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:59.443286 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03921c87-3edd-434d-8a06-5faab3db922c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:59.444726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03921c87-3edd-434d-8a06-5faab3db922c None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:59.463634 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 287/578] 10.222.0.32 () {56 vars in 1137 bytes} [Tue May 10 13:47:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:59.464495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03921c87-3edd-434d-8a06-5faab3db922c None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:59.532311 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 292/579] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:47:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:59.533169 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d8365-064c-4e4d-b329-d28a55c5b93a None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:59.597854 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03921c87-3edd-434d-8a06-5faab3db922c None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:59.644557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d8365-064c-4e4d-b329-d28a55c5b93a None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:59.644975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb6820-4780-4796-a69c-2ace3ca6720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:59.645772 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb6820-4780-4796-a69c-2ace3ca6720a None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:59.646154 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb6820-4780-4796-a69c-2ace3ca6720a None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:59.646587 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb6820-4780-4796-a69c-2ace3ca6720a None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:59.647560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb6820-4780-4796-a69c-2ace3ca6720a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:59.647971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb6820-4780-4796-a69c-2ace3ca6720a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:59.649465 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb6820-4780-4796-a69c-2ace3ca6720a None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:59.667035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 288/580] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:59.668278 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb6820-4780-4796-a69c-2ace3ca6720a None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:59.687592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd62dad-f6cb-440e-9ad2-6a71582996e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:59.688292 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd62dad-f6cb-440e-9ad2-6a71582996e7 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:59.688544 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd62dad-f6cb-440e-9ad2-6a71582996e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:59.688809 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd62dad-f6cb-440e-9ad2-6a71582996e7 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:59.689549 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd62dad-f6cb-440e-9ad2-6a71582996e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:59.689850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd62dad-f6cb-440e-9ad2-6a71582996e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:59.691280 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd62dad-f6cb-440e-9ad2-6a71582996e7 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:59.709432 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 293/581] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:59.709432 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd62dad-f6cb-440e-9ad2-6a71582996e7 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:59.794722 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb6820-4780-4796-a69c-2ace3ca6720a None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:59.838551 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd62dad-f6cb-440e-9ad2-6a71582996e7 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:59.838756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58191e3a-2244-4382-8db8-a1e788e1e185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:59.839575 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58191e3a-2244-4382-8db8-a1e788e1e185 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:59.839836 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58191e3a-2244-4382-8db8-a1e788e1e185 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:59.840105 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58191e3a-2244-4382-8db8-a1e788e1e185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:59.852365 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58191e3a-2244-4382-8db8-a1e788e1e185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:59.854216 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58191e3a-2244-4382-8db8-a1e788e1e185 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:59.873228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-58191e3a-2244-4382-8db8-a1e788e1e185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:59.873228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:59.873228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:59.873228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:59.873228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:59.873228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:59.873228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:59.873228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:59.873228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:59.873228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:59.873228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:59.873228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:59.873228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:59.873228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:59.873228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:59.875001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:59.875001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:59.875001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:59.875001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:59.875001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:59.875001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:59.875001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:59.875001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:59.875001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:47:59.875001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:59.875001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:59.875001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:59.875001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:59.875001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:59.875001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:59.875001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:59.875001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:59.876447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:59.876447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:59.876447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:59.876447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:47:59.876447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 289/582] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:59.876447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58191e3a-2244-4382-8db8-a1e788e1e185 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:59.890641 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe8086-d81f-44fe-9c87-d5e247178b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:59.891448 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe8086-d81f-44fe-9c87-d5e247178b7d None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:59.891724 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe8086-d81f-44fe-9c87-d5e247178b7d None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:59.891987 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe8086-d81f-44fe-9c87-d5e247178b7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:59.904415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe8086-d81f-44fe-9c87-d5e247178b7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:59.912350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-1dbe8086-d81f-44fe-9c87-d5e247178b7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:59.912350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:59.912350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:59.912350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:59.912350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:59.912350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:59.912350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:59.912350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:59.912350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:59.912350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:59.912350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:59.912350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:59.912350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:59.912350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:59.912350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:59.912350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:59.913503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:59.913503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:59.913503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:59.913503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:59.913503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:59.913503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:59.913503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:59.913503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:59.913503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:59.913503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:59.913503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:59.913503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:47:59.913503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:59.913503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:59.913503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:59.913503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:59.914374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:59.914374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:59.914374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:59.914374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:59.914374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:59.914374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:59.914374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:59.914374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:59.914374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:59.914374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:59.914374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:59.914374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:47:59.914374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 294/583] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:47:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:59.914374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe8086-d81f-44fe-9c87-d5e247178b7d None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:59.991322 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58191e3a-2244-4382-8db8-a1e788e1e185 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:00.026096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe8086-d81f-44fe-9c87-d5e247178b7d None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:00.033477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb1348-8904-4a5e-af7a-fbbad104935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:00.034324 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb1348-8904-4a5e-af7a-fbbad104935e None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:00.034606 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb1348-8904-4a5e-af7a-fbbad104935e None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:00.034878 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb1348-8904-4a5e-af7a-fbbad104935e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:00.043828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb1348-8904-4a5e-af7a-fbbad104935e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:00.045306 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb1348-8904-4a5e-af7a-fbbad104935e None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:00.061205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-0eeb1348-8904-4a5e-af7a-fbbad104935e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 13:48:00.061205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:00.061205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:00.061205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:00.061205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:00.061205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:00.061205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:00.061205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:00.061205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:00.061205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:00.061205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:00.061205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:00.061205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:48:00.061205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:48:00.061205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:48:00.061205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:48:00.063030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:00.063030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:00.063030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:00.063030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:00.063030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:00.063030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:00.063030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:00.063030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:00.063030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:00.063030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:00.063030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:00.063030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:00.063030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:00.063030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:00.063030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:00.063030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:00.063030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:00.063030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:00.063989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:00.063989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:00.063989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:48:00.063989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:48:00.063989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:48:00.063989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:48:00.063989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:48:00.063989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:48:00.063989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 13:48:00.063989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:00.063989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 290/584] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:47:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:00.063989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb1348-8904-4a5e-af7a-fbbad104935e None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:00.070681 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cc498-a5ab-4561-bed2-5f50527c2b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:00.071538 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cc498-a5ab-4561-bed2-5f50527c2b2f None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:00.071817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cc498-a5ab-4561-bed2-5f50527c2b2f None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:00.072120 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cc498-a5ab-4561-bed2-5f50527c2b2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:00.083208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cc498-a5ab-4561-bed2-5f50527c2b2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:00.086064 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cc498-a5ab-4561-bed2-5f50527c2b2f None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:00.107534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-8f8cc498-a5ab-4561-bed2-5f50527c2b2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:00.107534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:00.107534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:00.107534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:00.107534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:00.107534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:00.107534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:00.107534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:00.107534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:00.107534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:00.107534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:00.107534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:00.107534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:00.107534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:00.107534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:00.108663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:00.108663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:00.108663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:00.108663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:00.108663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:00.108663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:00.108663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:00.108663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:00.108663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:00.108663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:00.108663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:00.108663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:00.108663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:00.108663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:00.108663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:00.108663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:00.108663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:00.114488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:00.114488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:00.114488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:00.114488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:00.114488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:00.114488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:00.114488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:00.114488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:00.114488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 295/585] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:47:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:00.114488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cc498-a5ab-4561-bed2-5f50527c2b2f None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:00.168238 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb1348-8904-4a5e-af7a-fbbad104935e None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:00.203534 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07769c97-f976-4795-a472-53f36ccf5a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:00.204205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07769c97-f976-4795-a472-53f36ccf5a0a None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:00.204484 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07769c97-f976-4795-a472-53f36ccf5a0a None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:00.204757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07769c97-f976-4795-a472-53f36ccf5a0a None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:00.205481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07769c97-f976-4795-a472-53f36ccf5a0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:00.205783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07769c97-f976-4795-a472-53f36ccf5a0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:00.207174 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07769c97-f976-4795-a472-53f36ccf5a0a None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:00.223506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 291/586] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:00.223506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07769c97-f976-4795-a472-53f36ccf5a0a None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:00.229193 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cc498-a5ab-4561-bed2-5f50527c2b2f None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:00.264165 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cf7dc-bdea-4ddb-b28b-5b81db55fb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:00.264890 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cf7dc-bdea-4ddb-b28b-5b81db55fb0c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:00.265173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cf7dc-bdea-4ddb-b28b-5b81db55fb0c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:00.265492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cf7dc-bdea-4ddb-b28b-5b81db55fb0c None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:00.266299 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cf7dc-bdea-4ddb-b28b-5b81db55fb0c None admin] RBAC: Adding query filter params (name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:00.266599 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cf7dc-bdea-4ddb-b28b-5b81db55fb0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:00.267964 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cf7dc-bdea-4ddb-b28b-5b81db55fb0c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:00.281412 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 296/587] 10.222.0.32 () {56 vars in 1103 bytes} [Tue May 10 13:48:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:00.281412 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cf7dc-bdea-4ddb-b28b-5b81db55fb0c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:00.320993 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07769c97-f976-4795-a472-53f36ccf5a0a None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:00.354875 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb0f89-4fb0-4343-809d-173dcce1e9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:00.355558 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb0f89-4fb0-4343-809d-173dcce1e9c9 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:00.355840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb0f89-4fb0-4343-809d-173dcce1e9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:00.356160 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb0f89-4fb0-4343-809d-173dcce1e9c9 None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:00.357728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb0f89-4fb0-4343-809d-173dcce1e9c9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:00.358039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb0f89-4fb0-4343-809d-173dcce1e9c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:00.359515 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb0f89-4fb0-4343-809d-173dcce1e9c9 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:00.377795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 292/588] 10.222.0.32 () {56 vars in 1137 bytes} [Tue May 10 13:48:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:00.379079 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb0f89-4fb0-4343-809d-173dcce1e9c9 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:00.388778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cf7dc-bdea-4ddb-b28b-5b81db55fb0c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:00.423380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef804cd3-602c-407d-ad20-869705366f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:00.423959 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef804cd3-602c-407d-ad20-869705366f16 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:00.424241 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef804cd3-602c-407d-ad20-869705366f16 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:00.424513 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef804cd3-602c-407d-ad20-869705366f16 None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:00.425326 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef804cd3-602c-407d-ad20-869705366f16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:00.425640 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef804cd3-602c-407d-ad20-869705366f16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:00.427093 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef804cd3-602c-407d-ad20-869705366f16 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:00.444779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 297/589] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:48:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:00.445645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef804cd3-602c-407d-ad20-869705366f16 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:00.477503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb0f89-4fb0-4343-809d-173dcce1e9c9 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:00.512756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2348271-78d5-4829-a3bf-15380fa5c520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:00.513697 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2348271-78d5-4829-a3bf-15380fa5c520 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:00.513986 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2348271-78d5-4829-a3bf-15380fa5c520 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:00.514299 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2348271-78d5-4829-a3bf-15380fa5c520 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:00.521306 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2348271-78d5-4829-a3bf-15380fa5c520 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:00.522840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2348271-78d5-4829-a3bf-15380fa5c520 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:00.537784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-f2348271-78d5-4829-a3bf-15380fa5c520 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:00.537784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:00.537784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:00.537784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:00.537784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:00.537784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:00.537784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:00.537784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:00.537784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:00.537784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:00.537784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:00.537784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:00.537784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:00.537784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:00.537784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:00.538863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:00.538863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:00.538863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:00.538863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:00.538863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:00.538863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:00.538863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:00.538863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:00.538863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:00.538863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:00.538863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:00.538863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:00.538863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:00.538863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:00.538863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:00.538863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:00.538863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:00.539795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:00.539795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:00.539795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:00.539795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:00.539795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:00.539795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:00.539795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:00.539795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:00.542532 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 293/590] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:00.543552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2348271-78d5-4829-a3bf-15380fa5c520 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:00.552537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef804cd3-602c-407d-ad20-869705366f16 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:00.585781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9265890-5c80-4025-b50c-e52f6a2915f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:00.586608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9265890-5c80-4025-b50c-e52f6a2915f6 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:00.586888 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9265890-5c80-4025-b50c-e52f6a2915f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:00.587159 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9265890-5c80-4025-b50c-e52f6a2915f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:00.597897 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9265890-5c80-4025-b50c-e52f6a2915f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:00.599499 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9265890-5c80-4025-b50c-e52f6a2915f6 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:00.617673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-f9265890-5c80-4025-b50c-e52f6a2915f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:00.617673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:00.617673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:00.617673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:00.617673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:00.617673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:00.617673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:00.617673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:00.617673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:00.617673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:00.617673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:00.617673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:00.617673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:00.617673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:00.617673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:00.618854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:00.618854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:00.618854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:00.618854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:00.618854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:00.618854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:00.618854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:00.618854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:00.618854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:00.618854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:00.618854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:00.618854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:00.618854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:00.618854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:00.618854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:00.618854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:00.618854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:00.619936 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:00.619936 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:00.619936 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:00.619936 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:00.622546 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 298/591] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:00.623534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9265890-5c80-4025-b50c-e52f6a2915f6 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:00.652468 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2348271-78d5-4829-a3bf-15380fa5c520 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:00.687825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78521626-b24e-420d-af93-db090a7af818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:00.688549 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78521626-b24e-420d-af93-db090a7af818 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:00.688831 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78521626-b24e-420d-af93-db090a7af818 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:00.689112 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78521626-b24e-420d-af93-db090a7af818 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:00.701341 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78521626-b24e-420d-af93-db090a7af818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:00.702852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78521626-b24e-420d-af93-db090a7af818 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:00.721100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-78521626-b24e-420d-af93-db090a7af818 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:00.721100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:00.721100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:00.721100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:00.721100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:00.721100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:00.721100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:00.721100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:00.721100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:00.721100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:00.721100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:00.721100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:00.721100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:00.721100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:00.721100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:00.722257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:00.722257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:00.722257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:00.722257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:00.722257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:00.722257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:00.722257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:00.722257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:00.722257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:00.722257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:00.722257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:00.722257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:00.722257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:00.722257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:00.722257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:00.722257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:00.722257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:00.723466 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:00.723466 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:00.723466 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:00.723466 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:00.729245 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 294/592] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:00.729245 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78521626-b24e-420d-af93-db090a7af818 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:00.729481 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9265890-5c80-4025-b50c-e52f6a2915f6 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:00.768883 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefdfbd-c2c6-4f55-b593-ddda3040aecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:00.769919 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefdfbd-c2c6-4f55-b593-ddda3040aecb None admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:00.770345 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefdfbd-c2c6-4f55-b593-ddda3040aecb None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:00.771128 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefdfbd-c2c6-4f55-b593-ddda3040aecb None admin] PATH_INFO: `/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/e5d4fd26c21f4170a6790369344f8334/roles/567077e602b043f8b81abc208831228a` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:00.786630 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefdfbd-c2c6-4f55-b593-ddda3040aecb None admin] RBAC: Authorizing `identity:create_grant(project_id=d1cda14bca5c497dba2d18685dfe6cc2, user_id=e5d4fd26c21f4170a6790369344f8334, role_id=567077e602b043f8b81abc208831228a)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:00.788212 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefdfbd-c2c6-4f55-b593-ddda3040aecb None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:00.801746 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 299/593] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:48:00 2022] PUT /identity/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/e5d4fd26c21f4170a6790369344f8334/roles/567077e602b043f8b81abc208831228a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:48:00.802609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefdfbd-c2c6-4f55-b593-ddda3040aecb None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:00.847398 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78521626-b24e-420d-af93-db090a7af818 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:00.889562 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf350e7-1527-4509-b374-cec7b554e7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:00.890577 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf350e7-1527-4509-b374-cec7b554e7fb None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:00.891012 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf350e7-1527-4509-b374-cec7b554e7fb None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:00.891457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf350e7-1527-4509-b374-cec7b554e7fb None admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:00.892524 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf350e7-1527-4509-b374-cec7b554e7fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:00.892991 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf350e7-1527-4509-b374-cec7b554e7fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:00.894712 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf350e7-1527-4509-b374-cec7b554e7fb None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:00.910042 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 295/594] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:48:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:00.911383 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf350e7-1527-4509-b374-cec7b554e7fb None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:00.925299 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefdfbd-c2c6-4f55-b593-ddda3040aecb None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:00.962293 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17566c58-0766-48d3-babb-92383339707a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:00.962904 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17566c58-0766-48d3-babb-92383339707a None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:00.963184 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17566c58-0766-48d3-babb-92383339707a None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:00.963456 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17566c58-0766-48d3-babb-92383339707a None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:00.964202 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17566c58-0766-48d3-babb-92383339707a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:00.964498 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17566c58-0766-48d3-babb-92383339707a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:00.965966 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17566c58-0766-48d3-babb-92383339707a None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:00.983662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 300/595] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:00.983662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17566c58-0766-48d3-babb-92383339707a None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:01.034037 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf350e7-1527-4509-b374-cec7b554e7fb None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:01.076741 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f16f2-de2b-416d-8711-40ca7fd1168e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:01.077589 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f16f2-de2b-416d-8711-40ca7fd1168e None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:01.077967 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f16f2-de2b-416d-8711-40ca7fd1168e None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:01.078395 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f16f2-de2b-416d-8711-40ca7fd1168e None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:01.079232 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f16f2-de2b-416d-8711-40ca7fd1168e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:01.079710 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f16f2-de2b-416d-8711-40ca7fd1168e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:01.081231 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f16f2-de2b-416d-8711-40ca7fd1168e None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:01.093878 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 296/596] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:01.094941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f16f2-de2b-416d-8711-40ca7fd1168e None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:01.104418 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17566c58-0766-48d3-babb-92383339707a None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:01.155419 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f012d-7797-4579-a46f-3683c362e8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:01.156562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f012d-7797-4579-a46f-3683c362e8ff None admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:01.157151 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f012d-7797-4579-a46f-3683c362e8ff None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:01.158252 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f012d-7797-4579-a46f-3683c362e8ff None admin] PATH_INFO: `/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/ada4e799ead24839b109377db3c6393b/roles/567077e602b043f8b81abc208831228a` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:01.175629 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f012d-7797-4579-a46f-3683c362e8ff None admin] RBAC: Authorizing `identity:create_grant(project_id=d1cda14bca5c497dba2d18685dfe6cc2, user_id=ada4e799ead24839b109377db3c6393b, role_id=567077e602b043f8b81abc208831228a)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:01.177407 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f012d-7797-4579-a46f-3683c362e8ff None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:01.194251 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 301/597] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:48:00 2022] PUT /identity/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/ada4e799ead24839b109377db3c6393b/roles/567077e602b043f8b81abc208831228a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:48:01.194683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f012d-7797-4579-a46f-3683c362e8ff None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:01.264137 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f16f2-de2b-416d-8711-40ca7fd1168e None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:01.314453 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68885e5e-a4eb-4841-bd66-8785a7cf9035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:01.315455 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68885e5e-a4eb-4841-bd66-8785a7cf9035 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:01.315837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68885e5e-a4eb-4841-bd66-8785a7cf9035 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:01.316213 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68885e5e-a4eb-4841-bd66-8785a7cf9035 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:01.324698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68885e5e-a4eb-4841-bd66-8785a7cf9035 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:01.327025 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68885e5e-a4eb-4841-bd66-8785a7cf9035 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:01.342437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-68885e5e-a4eb-4841-bd66-8785a7cf9035 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 13:48:01.342437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:01.342437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:01.342437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:01.342437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:01.342437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:01.342437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:01.342437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:01.342437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:01.342437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:01.342437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:01.342437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:01.342437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:48:01.342437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:48:01.342437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:48:01.342437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:48:01.343670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:01.343670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:01.343670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:01.343670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:01.343670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:01.343670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:01.343670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:01.343670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:01.343670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:01.343670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:01.343670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:01.343670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:01.343670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:01.343670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:01.343670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:01.343670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:01.343670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:01.343670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:01.344825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:01.344825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:01.344825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:48:01.344825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:48:01.344825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:48:01.344825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:48:01.344825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:48:01.344825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:48:01.344825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 13:48:01.344825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:01.346009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 297/598] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:48:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:01.347408 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14653e3-4f8d-4da5-b40c-f29240ee4c94 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:01.347766 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14653e3-4f8d-4da5-b40c-f29240ee4c94 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:01.348114 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14653e3-4f8d-4da5-b40c-f29240ee4c94 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:01.349692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 298/599] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:01.351267 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14653e3-4f8d-4da5-b40c-f29240ee4c94 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:01.384078 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f012d-7797-4579-a46f-3683c362e8ff None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:01.433512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618561ff-7565-4624-b572-6eaa3b7195d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:01.436275 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618561ff-7565-4624-b572-6eaa3b7195d4 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:01.436618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618561ff-7565-4624-b572-6eaa3b7195d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:01.436847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618561ff-7565-4624-b572-6eaa3b7195d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:01.444383 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618561ff-7565-4624-b572-6eaa3b7195d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:01.445847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618561ff-7565-4624-b572-6eaa3b7195d4 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:01.463767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-618561ff-7565-4624-b572-6eaa3b7195d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:01.463767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:01.463767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:01.463767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:01.463767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:01.463767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:01.463767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:01.463767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:01.463767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:01.463767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:01.463767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:01.463767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:01.463767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:01.463767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:01.463767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:01.464697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:01.464697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:01.464697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:01.464697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:01.464697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:01.464697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:01.464697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:01.464697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:01.464697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:01.464697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:01.464697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:01.464697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:01.464697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:01.464697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:01.464697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:01.464697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:01.464697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:01.465570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:01.465570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:01.465570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:01.465570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:01.465570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:01.465570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:01.465570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:01.465570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:01.465570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 302/600] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:01.467351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df045a69-e1f0-4f61-bbb5-40727f5f2f5d None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:01.468117 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df045a69-e1f0-4f61-bbb5-40727f5f2f5d None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:01.468117 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df045a69-e1f0-4f61-bbb5-40727f5f2f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:01.471516 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14653e3-4f8d-4da5-b40c-f29240ee4c94 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:01.488247 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-df045a69-e1f0-4f61-bbb5-40727f5f2f5d None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:01.489445 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-df045a69-e1f0-4f61-bbb5-40727f5f2f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:01.509958 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cca82-9f27-408f-9482-4a71271657a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:01.510680 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cca82-9f27-408f-9482-4a71271657a3 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:01.510963 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cca82-9f27-408f-9482-4a71271657a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:01.511239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cca82-9f27-408f-9482-4a71271657a3 None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:01.512085 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cca82-9f27-408f-9482-4a71271657a3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:01.512396 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cca82-9f27-408f-9482-4a71271657a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:01.514686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cca82-9f27-408f-9482-4a71271657a3 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:01.533681 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 299/601] 10.222.0.32 () {56 vars in 1139 bytes} [Tue May 10 13:48:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:01.534547 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cca82-9f27-408f-9482-4a71271657a3 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:01.571806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 303/602] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:48:01.572997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df045a69-e1f0-4f61-bbb5-40727f5f2f5d None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:01.635062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cca82-9f27-408f-9482-4a71271657a3 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:01.671242 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a51ecc-ad1c-4f0d-84b9-d737fefdfe39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:01.671921 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a51ecc-ad1c-4f0d-84b9-d737fefdfe39 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:01.672203 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a51ecc-ad1c-4f0d-84b9-d737fefdfe39 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:01.672555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a51ecc-ad1c-4f0d-84b9-d737fefdfe39 None admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:01.673269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a51ecc-ad1c-4f0d-84b9-d737fefdfe39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:01.673576 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a51ecc-ad1c-4f0d-84b9-d737fefdfe39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:01.675052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a51ecc-ad1c-4f0d-84b9-d737fefdfe39 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:01.685102 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df045a69-e1f0-4f61-bbb5-40727f5f2f5d None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:01.694772 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 300/603] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:48:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:01.695538 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a51ecc-ad1c-4f0d-84b9-d737fefdfe39 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:01.746709 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f7be7-c3f0-4fe4-ad6e-23973ab988c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:01.749617 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f7be7-c3f0-4fe4-ad6e-23973ab988c6 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:01.750076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f7be7-c3f0-4fe4-ad6e-23973ab988c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:01.750568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f7be7-c3f0-4fe4-ad6e-23973ab988c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:01.770150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f7be7-c3f0-4fe4-ad6e-23973ab988c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:01.774989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f7be7-c3f0-4fe4-ad6e-23973ab988c6 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:01.802514 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a51ecc-ad1c-4f0d-84b9-d737fefdfe39 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:01.812742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-287f7be7-c3f0-4fe4-ad6e-23973ab988c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:01.812742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:01.812742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:01.812742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:01.812742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:01.812742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:01.812742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:01.812742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:01.812742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:01.812742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:01.812742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:01.812742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:01.812742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:01.812742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:01.812742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:01.813722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:01.813722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:01.813722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:01.813722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:01.813722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:01.813722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:01.813722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:01.813722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:01.813722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:01.813722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:01.813722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:01.813722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:01.813722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:01.813722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:01.813722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:01.813722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:01.813722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:01.814644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:01.814644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:01.814644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:01.814644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:01.816867 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 304/604] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:01.817818 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f7be7-c3f0-4fe4-ad6e-23973ab988c6 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:01.843059 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674aef1a-fb0e-4b3c-b708-c436b2605e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:01.844070 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674aef1a-fb0e-4b3c-b708-c436b2605e7a None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:01.844249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674aef1a-fb0e-4b3c-b708-c436b2605e7a None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:01.844529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674aef1a-fb0e-4b3c-b708-c436b2605e7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:01.866030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674aef1a-fb0e-4b3c-b708-c436b2605e7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:01.881910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-674aef1a-fb0e-4b3c-b708-c436b2605e7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:48:01.881910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:01.881910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:01.881910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:01.881910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:01.881910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:01.881910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:01.881910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:01.881910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:01.881910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:01.881910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:01.881910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:01.881910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:01.881910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:01.881910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:01.881910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:01.882920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:01.882920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:01.882920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:01.882920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:01.882920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:01.882920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:01.882920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:01.882920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:01.882920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:01.882920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:01.882920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:01.882920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:01.882920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:01.882920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:01.882920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:01.882920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:01.883743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:01.883743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:01.883743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:01.883743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:01.883743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:01.883743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:01.883743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:01.883743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:01.883743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:01.883743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:01.883743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:48:01.883743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:01.884363 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 301/605] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:48:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:01.885235 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674aef1a-fb0e-4b3c-b708-c436b2605e7a None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:02.038313 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f7be7-c3f0-4fe4-ad6e-23973ab988c6 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:02.081173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674aef1a-fb0e-4b3c-b708-c436b2605e7a None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:02.107544 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912a1aa-2ec0-4a87-97cc-33befee7527a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:02.108613 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912a1aa-2ec0-4a87-97cc-33befee7527a None admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:02.108969 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912a1aa-2ec0-4a87-97cc-33befee7527a None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:02.109341 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912a1aa-2ec0-4a87-97cc-33befee7527a None admin] PATH_INFO: `/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/42629678b7dd40fe8013b9644ac337d3/roles/567077e602b043f8b81abc208831228a` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:02.125839 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3b621-ae73-4a5d-a052-1a20006c8a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:02.127578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3b621-ae73-4a5d-a052-1a20006c8a47 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:02.127578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3b621-ae73-4a5d-a052-1a20006c8a47 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:02.127578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3b621-ae73-4a5d-a052-1a20006c8a47 None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:02.127804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3b621-ae73-4a5d-a052-1a20006c8a47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:02.129023 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3b621-ae73-4a5d-a052-1a20006c8a47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:02.129483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3b621-ae73-4a5d-a052-1a20006c8a47 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:02.132350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912a1aa-2ec0-4a87-97cc-33befee7527a None admin] RBAC: Authorizing `identity:create_grant(project_id=d1cda14bca5c497dba2d18685dfe6cc2, user_id=42629678b7dd40fe8013b9644ac337d3, role_id=567077e602b043f8b81abc208831228a)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:02.133955 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912a1aa-2ec0-4a87-97cc-33befee7527a None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:02.155869 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 305/606] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:48:01 2022] PUT /identity/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/42629678b7dd40fe8013b9644ac337d3/roles/567077e602b043f8b81abc208831228a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:48:02.156820 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912a1aa-2ec0-4a87-97cc-33befee7527a None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:02.177159 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 302/607] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:02.183334 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3b621-ae73-4a5d-a052-1a20006c8a47 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:02.438139 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3b621-ae73-4a5d-a052-1a20006c8a47 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:02.443004 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912a1aa-2ec0-4a87-97cc-33befee7527a None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:02.476583 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1300bf2-abdb-478a-abf6-ed98392882af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:02.477382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1300bf2-abdb-478a-abf6-ed98392882af None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:02.477659 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1300bf2-abdb-478a-abf6-ed98392882af None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:02.477931 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1300bf2-abdb-478a-abf6-ed98392882af None admin] PATH_INFO: `/v3/projects/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:02.479558 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f873af-ac27-4a73-ae83-f9142d2f174b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:02.480233 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f873af-ac27-4a73-ae83-f9142d2f174b None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:02.480515 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f873af-ac27-4a73-ae83-f9142d2f174b None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:02.480790 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f873af-ac27-4a73-ae83-f9142d2f174b None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:02.482706 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f873af-ac27-4a73-ae83-f9142d2f174b None admin] RBAC: Adding query filter params (name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:02.482706 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f873af-ac27-4a73-ae83-f9142d2f174b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:02.484876 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f873af-ac27-4a73-ae83-f9142d2f174b None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:02.490970 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1300bf2-abdb-478a-abf6-ed98392882af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:02.492904 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1300bf2-abdb-478a-abf6-ed98392882af None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:02.502454 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 306/608] 10.222.0.32 () {56 vars in 1103 bytes} [Tue May 10 13:48:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:02.503747 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f873af-ac27-4a73-ae83-f9142d2f174b None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:02.520891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-c1300bf2-abdb-478a-abf6-ed98392882af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:02.520891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:02.520891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:02.520891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:02.520891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:02.520891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:02.520891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:02.520891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:02.520891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:02.520891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:02.520891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:02.520891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:02.520891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:02.520891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:02.520891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:02.521847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:02.521847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:02.521847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:02.521847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:02.521847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:02.521847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:02.521847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:02.521847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:02.521847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:02.521847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:02.521847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:02.521847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:02.521847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:02.521847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:02.521847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:02.521847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:02.521847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:02.522761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:02.522761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:02.522761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:02.522761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:02.522761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:02.522761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:02.522761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:02.522761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:02.522761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 303/609] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:02.527804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1300bf2-abdb-478a-abf6-ed98392882af None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:02.606131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f873af-ac27-4a73-ae83-f9142d2f174b None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:02.637450 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1300bf2-abdb-478a-abf6-ed98392882af None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:02.643772 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166830d-22c2-401e-a9dc-ab176621f105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:02.644573 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166830d-22c2-401e-a9dc-ab176621f105 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:02.644853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166830d-22c2-401e-a9dc-ab176621f105 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:02.645131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166830d-22c2-401e-a9dc-ab176621f105 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:02.656459 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166830d-22c2-401e-a9dc-ab176621f105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:02.657933 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166830d-22c2-401e-a9dc-ab176621f105 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:02.671867 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851e2a2-60ec-4984-8292-d87e93b93e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:02.672538 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851e2a2-60ec-4984-8292-d87e93b93e46 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:02.672816 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851e2a2-60ec-4984-8292-d87e93b93e46 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:02.673087 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851e2a2-60ec-4984-8292-d87e93b93e46 None admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:02.673882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851e2a2-60ec-4984-8292-d87e93b93e46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:02.674187 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851e2a2-60ec-4984-8292-d87e93b93e46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:02.675876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851e2a2-60ec-4984-8292-d87e93b93e46 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:02.676537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-d166830d-22c2-401e-a9dc-ab176621f105 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:02.676537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:02.676537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:02.676537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:02.676537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:02.676537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:02.676537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:02.676537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:02.676537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:02.676537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:02.676537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:02.676537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:02.676537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:02.676537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:02.676537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:02.678683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:02.678683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:02.678683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:02.678683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:02.678683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:02.678683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:02.678683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:02.678683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:02.678683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:02.678683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:02.678683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:02.678683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:02.678683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:02.678683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:02.678683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:02.678683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:02.678683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:02.680878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:02.680878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:02.680878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:02.680878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:02.686253 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 307/610] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:02.686253 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166830d-22c2-401e-a9dc-ab176621f105 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:02.689725 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 304/611] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:48:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:02.699200 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851e2a2-60ec-4984-8292-d87e93b93e46 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:02.798239 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166830d-22c2-401e-a9dc-ab176621f105 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:02.839320 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21f676-1ccc-43b8-b52d-382b5778ef8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:02.839320 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21f676-1ccc-43b8-b52d-382b5778ef8c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:02.839820 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21f676-1ccc-43b8-b52d-382b5778ef8c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:02.839820 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21f676-1ccc-43b8-b52d-382b5778ef8c None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:02.840531 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21f676-1ccc-43b8-b52d-382b5778ef8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:02.845936 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21f676-1ccc-43b8-b52d-382b5778ef8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:02.845936 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21f676-1ccc-43b8-b52d-382b5778ef8c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:02.874671 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 308/612] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:02.877179 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21f676-1ccc-43b8-b52d-382b5778ef8c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:02.910457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851e2a2-60ec-4984-8292-d87e93b93e46 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:02.975152 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21600c-39fa-4261-b276-159847d617fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:02.976116 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21600c-39fa-4261-b276-159847d617fd None admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:02.976398 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21600c-39fa-4261-b276-159847d617fd None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:02.976836 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21600c-39fa-4261-b276-159847d617fd None admin] PATH_INFO: `/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/12eb1c001b5e44d8b5b5bc658ed464f5/roles/567077e602b043f8b81abc208831228a` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:02.993971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21f676-1ccc-43b8-b52d-382b5778ef8c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:03.019635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21600c-39fa-4261-b276-159847d617fd None admin] RBAC: Authorizing `identity:create_grant(project_id=d1cda14bca5c497dba2d18685dfe6cc2, user_id=12eb1c001b5e44d8b5b5bc658ed464f5, role_id=567077e602b043f8b81abc208831228a)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:03.021086 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21600c-39fa-4261-b276-159847d617fd None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:03.040483 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb7b43-22a1-4a79-af6c-06502f3e08b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:03.041332 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb7b43-22a1-4a79-af6c-06502f3e08b2 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:03.041662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb7b43-22a1-4a79-af6c-06502f3e08b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:03.041943 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb7b43-22a1-4a79-af6c-06502f3e08b2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:03.042146 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 305/613] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:48:02 2022] PUT /identity/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/12eb1c001b5e44d8b5b5bc658ed464f5/roles/567077e602b043f8b81abc208831228a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:48:03.051407 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb7b43-22a1-4a79-af6c-06502f3e08b2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:03.052954 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb7b43-22a1-4a79-af6c-06502f3e08b2 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:03.070114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-71cb7b43-22a1-4a79-af6c-06502f3e08b2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 13:48:03.070114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:03.070114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:03.070114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:03.070114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:03.070114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:03.070114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:03.070114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:03.070114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:03.070114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:03.070114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:03.070114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:03.070114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:48:03.070114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:48:03.070114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:48:03.070114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:48:03.072469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:03.072469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:03.072469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:03.072469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:03.072469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:03.072469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:03.072469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:03.072469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:03.072469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:03.072469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:03.072469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:03.072469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:03.072469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:03.072469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:03.072469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:03.072469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:03.072469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:03.072469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:03.074217 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:03.074217 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:03.074217 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:48:03.074217 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:48:03.074217 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:48:03.074217 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:48:03.074217 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:48:03.074217 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:48:03.074217 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 13:48:03.074217 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:03.074217 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 309/614] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:48:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:03.077731 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21600c-39fa-4261-b276-159847d617fd None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:03.250215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21600c-39fa-4261-b276-159847d617fd None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:03.295782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f15ff-34d1-4924-8103-b5fc21e184b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:03.296473 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f15ff-34d1-4924-8103-b5fc21e184b1 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:03.296759 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f15ff-34d1-4924-8103-b5fc21e184b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:03.297035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f15ff-34d1-4924-8103-b5fc21e184b1 None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:03.297916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f15ff-34d1-4924-8103-b5fc21e184b1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:03.298242 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f15ff-34d1-4924-8103-b5fc21e184b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:03.299856 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f15ff-34d1-4924-8103-b5fc21e184b1 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:03.324813 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 306/615] 10.222.0.32 () {56 vars in 1135 bytes} [Tue May 10 13:48:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:03.330914 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb7b43-22a1-4a79-af6c-06502f3e08b2 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:03.380884 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f991e8-e9fb-46e6-80a4-bad5c7e37e96 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:03.381238 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f991e8-e9fb-46e6-80a4-bad5c7e37e96 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:03.381450 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f991e8-e9fb-46e6-80a4-bad5c7e37e96 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:03.383157 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 307/616] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:48:03.388954 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb6199-719f-4bba-84d0-7389fe50f758 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:03.389215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb6199-719f-4bba-84d0-7389fe50f758 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:03.389499 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb6199-719f-4bba-84d0-7389fe50f758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:03.420072 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-10eb6199-719f-4bba-84d0-7389fe50f758 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:03.421308 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-10eb6199-719f-4bba-84d0-7389fe50f758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:03.529851 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb7b43-22a1-4a79-af6c-06502f3e08b2 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:03.576326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 308/617] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:48:03.597742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eefd88-02c4-4450-aeb0-8e03bc84e82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:03.598639 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eefd88-02c4-4450-aeb0-8e03bc84e82d None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:03.598920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eefd88-02c4-4450-aeb0-8e03bc84e82d None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:03.599191 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eefd88-02c4-4450-aeb0-8e03bc84e82d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:03.599305 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb6199-719f-4bba-84d0-7389fe50f758 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:03.613206 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eefd88-02c4-4450-aeb0-8e03bc84e82d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:03.614766 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eefd88-02c4-4450-aeb0-8e03bc84e82d None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:03.648516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-59eefd88-02c4-4450-aeb0-8e03bc84e82d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:03.648516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:03.648516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:03.648516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:03.648516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:03.648516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:03.648516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:03.648516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:03.648516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:03.648516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:03.648516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:03.648516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:03.648516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:03.648516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:03.648516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:03.649487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:03.649487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:03.649487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:03.649487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:03.649487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:03.649487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:03.649487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:03.649487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:03.649487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:03.649487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:03.649487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:03.649487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:03.649487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:03.649487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:03.649487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:03.649487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:03.649487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:03.650371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:03.650371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:03.650371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:03.650371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:03.650371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 310/618] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:03.663925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eefd88-02c4-4450-aeb0-8e03bc84e82d None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:03.706130 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb6199-719f-4bba-84d0-7389fe50f758 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:03.752542 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5dc8da-3c26-496f-8f05-ce523a457ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:03.753419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5dc8da-3c26-496f-8f05-ce523a457ec9 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:03.753706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5dc8da-3c26-496f-8f05-ce523a457ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:03.753980 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5dc8da-3c26-496f-8f05-ce523a457ec9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:03.771015 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eefd88-02c4-4450-aeb0-8e03bc84e82d None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:03.771479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5dc8da-3c26-496f-8f05-ce523a457ec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:03.786423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-5c5dc8da-3c26-496f-8f05-ce523a457ec9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:48:03.786423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:03.786423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:03.786423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:03.786423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:03.786423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:03.786423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:03.786423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:03.786423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:03.786423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:03.786423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:03.786423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:03.786423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:03.786423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:03.786423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:03.786423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:03.788608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:03.788608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:03.788608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:03.788608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:03.788608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:03.788608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:03.788608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:03.788608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:03.788608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:03.788608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:03.788608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:03.788608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:03.788608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:03.788608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:03.788608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:03.788608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:03.790654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:03.790654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:03.790654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:03.790654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:03.790654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:03.790654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:03.790654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:03.790654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:03.790654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:03.790654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:03.790654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:48:03.790654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:03.794591 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 309/619] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:48:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:03.794910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5dc8da-3c26-496f-8f05-ce523a457ec9 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:03.819493 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96909059-8145-442a-81d7-6a076ee08bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:03.820272 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96909059-8145-442a-81d7-6a076ee08bb0 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:03.820465 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96909059-8145-442a-81d7-6a076ee08bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:03.820695 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96909059-8145-442a-81d7-6a076ee08bb0 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:03.821429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96909059-8145-442a-81d7-6a076ee08bb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:03.821733 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96909059-8145-442a-81d7-6a076ee08bb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:03.823138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96909059-8145-442a-81d7-6a076ee08bb0 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:03.861098 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 311/620] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:03.874874 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96909059-8145-442a-81d7-6a076ee08bb0 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:03.917056 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5dc8da-3c26-496f-8f05-ce523a457ec9 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:03.967008 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d021390-6164-4abb-9c53-88cde30e0e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:03.968122 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d021390-6164-4abb-9c53-88cde30e0e4a None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:03.968608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d021390-6164-4abb-9c53-88cde30e0e4a None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:03.969084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d021390-6164-4abb-9c53-88cde30e0e4a None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:03.970041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d021390-6164-4abb-9c53-88cde30e0e4a None admin] RBAC: Adding query filter params (name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:03.970580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d021390-6164-4abb-9c53-88cde30e0e4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:03.972210 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d021390-6164-4abb-9c53-88cde30e0e4a None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:03.989199 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 310/621] 10.222.0.32 () {56 vars in 1103 bytes} [Tue May 10 13:48:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:03.995326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d021390-6164-4abb-9c53-88cde30e0e4a None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:04.097875 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96909059-8145-442a-81d7-6a076ee08bb0 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:04.139828 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd096288-0008-4158-b2e8-4cb479e883ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:04.140612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd096288-0008-4158-b2e8-4cb479e883ec None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:04.140889 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd096288-0008-4158-b2e8-4cb479e883ec None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:04.141156 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd096288-0008-4158-b2e8-4cb479e883ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:04.149394 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d021390-6164-4abb-9c53-88cde30e0e4a None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:04.150911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd096288-0008-4158-b2e8-4cb479e883ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:04.153490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd096288-0008-4158-b2e8-4cb479e883ec None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:04.174826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-cd096288-0008-4158-b2e8-4cb479e883ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:04.174826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:04.174826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:04.174826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:04.174826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:04.174826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:04.174826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:04.174826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:04.174826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:04.174826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:04.174826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:04.174826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:04.174826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:04.174826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:04.174826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:04.175894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:04.175894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:04.175894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:04.175894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:04.175894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:04.175894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:04.175894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:04.175894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:04.175894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:04.175894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:04.175894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:04.175894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:04.175894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:04.175894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:04.175894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:04.175894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:04.175894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:04.176778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:04.176778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:04.176778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:04.176778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:04.176778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:04.176778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:04.176778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:04.176778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:04.179829 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 312/622] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:04.181558 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c807f7b-a630-496f-b0dd-7ecf97ea8171 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:04.182336 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c807f7b-a630-496f-b0dd-7ecf97ea8171 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:04.183025 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c807f7b-a630-496f-b0dd-7ecf97ea8171 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:04.185960 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 313/623] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:04.186855 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c807f7b-a630-496f-b0dd-7ecf97ea8171 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:04.192628 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d557d-5dab-4cc7-8b32-34d46dfcc202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:04.193544 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d557d-5dab-4cc7-8b32-34d46dfcc202 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:04.193920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d557d-5dab-4cc7-8b32-34d46dfcc202 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:04.194321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d557d-5dab-4cc7-8b32-34d46dfcc202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:04.206807 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d557d-5dab-4cc7-8b32-34d46dfcc202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:04.208446 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d557d-5dab-4cc7-8b32-34d46dfcc202 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:04.226944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-fb2d557d-5dab-4cc7-8b32-34d46dfcc202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:04.226944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:04.226944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:04.226944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:04.226944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:04.226944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:04.226944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:04.226944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:04.226944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:04.226944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:04.226944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:04.226944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:04.226944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:04.226944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:04.226944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:04.228640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:04.228640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:04.228640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:04.228640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:04.228640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:04.228640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:04.228640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:04.228640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:04.228640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:04.228640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:04.228640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:04.228640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:04.228640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:04.228640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:04.228640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:04.228640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:04.228640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:04.230433 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:04.230433 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:04.230433 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:04.230433 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:04.230925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 311/624] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:04.233160 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799631e1-877b-4d04-92f9-e74812f907dc None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:04.233563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799631e1-877b-4d04-92f9-e74812f907dc None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:04.233935 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799631e1-877b-4d04-92f9-e74812f907dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:04.253515 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-799631e1-877b-4d04-92f9-e74812f907dc None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:04.254991 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-799631e1-877b-4d04-92f9-e74812f907dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:04.334482 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 312/625] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:48:04.335714 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799631e1-877b-4d04-92f9-e74812f907dc None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:04.356347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c807f7b-a630-496f-b0dd-7ecf97ea8171 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:04.400960 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae98aa7-d60d-4318-bea0-0617b09b44e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:04.402152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae98aa7-d60d-4318-bea0-0617b09b44e1 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:04.402620 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae98aa7-d60d-4318-bea0-0617b09b44e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:04.403588 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae98aa7-d60d-4318-bea0-0617b09b44e1 None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:04.405433 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae98aa7-d60d-4318-bea0-0617b09b44e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:04.405960 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae98aa7-d60d-4318-bea0-0617b09b44e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:04.408092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae98aa7-d60d-4318-bea0-0617b09b44e1 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:04.425800 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 314/626] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:48:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:04.426958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae98aa7-d60d-4318-bea0-0617b09b44e1 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:04.465472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799631e1-877b-4d04-92f9-e74812f907dc None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:04.512399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa6662-8e60-4d58-9a80-df3f097f2562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:04.514056 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa6662-8e60-4d58-9a80-df3f097f2562 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:04.514538 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa6662-8e60-4d58-9a80-df3f097f2562 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:04.515172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa6662-8e60-4d58-9a80-df3f097f2562 None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:04.516531 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa6662-8e60-4d58-9a80-df3f097f2562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:04.517071 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa6662-8e60-4d58-9a80-df3f097f2562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:04.518734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa6662-8e60-4d58-9a80-df3f097f2562 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:04.533390 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae98aa7-d60d-4318-bea0-0617b09b44e1 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:04.536999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 313/627] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:04.538029 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa6662-8e60-4d58-9a80-df3f097f2562 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:04.570339 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e403b-c85a-4969-af90-6070c3dbdcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:04.571313 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e403b-c85a-4969-af90-6070c3dbdcd1 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:04.571686 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e403b-c85a-4969-af90-6070c3dbdcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:04.572056 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e403b-c85a-4969-af90-6070c3dbdcd1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:04.583843 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e403b-c85a-4969-af90-6070c3dbdcd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:04.593216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-253e403b-c85a-4969-af90-6070c3dbdcd1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:48:04.593216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:04.593216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:04.593216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:04.593216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:04.593216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:04.593216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:04.593216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:04.593216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:04.593216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:04.593216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:04.593216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:04.593216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:04.593216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:04.593216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:04.593216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:04.594261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:04.594261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:04.594261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:04.594261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:04.594261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:04.594261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:04.594261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:04.594261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:04.594261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:04.594261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:04.594261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:04.594261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:04.594261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:04.594261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:04.594261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:04.594261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:04.595095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:04.595095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:04.595095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:04.595095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:04.595095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:04.595095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:04.595095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:04.595095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:04.595095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:04.595095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:04.595095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:48:04.595095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:04.602931 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 315/628] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:48:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:04.604251 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e403b-c85a-4969-af90-6070c3dbdcd1 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:04.645327 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa6662-8e60-4d58-9a80-df3f097f2562 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:04.680885 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a6232-3d7f-42e2-9da4-80e86a7e1470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:04.681782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a6232-3d7f-42e2-9da4-80e86a7e1470 None admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:04.682065 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a6232-3d7f-42e2-9da4-80e86a7e1470 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:04.682371 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a6232-3d7f-42e2-9da4-80e86a7e1470 None admin] PATH_INFO: `/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/47bbad5318b6417087d7ce6906f8281f/roles/567077e602b043f8b81abc208831228a` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:04.698671 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a6232-3d7f-42e2-9da4-80e86a7e1470 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1cda14bca5c497dba2d18685dfe6cc2, user_id=47bbad5318b6417087d7ce6906f8281f, role_id=567077e602b043f8b81abc208831228a)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:04.700188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a6232-3d7f-42e2-9da4-80e86a7e1470 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:04.722322 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 314/629] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:48:04 2022] PUT /identity/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/47bbad5318b6417087d7ce6906f8281f/roles/567077e602b043f8b81abc208831228a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:48:04.724010 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a6232-3d7f-42e2-9da4-80e86a7e1470 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:04.729870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e403b-c85a-4969-af90-6070c3dbdcd1 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:04.809508 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109943f-f47a-43df-a356-f826da8ad0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:04.810890 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109943f-f47a-43df-a356-f826da8ad0df None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:04.811173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109943f-f47a-43df-a356-f826da8ad0df None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:04.811443 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109943f-f47a-43df-a356-f826da8ad0df None admin] PATH_INFO: `/v3/users/nova` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:04.824022 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109943f-f47a-43df-a356-f826da8ad0df None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:04.825933 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109943f-f47a-43df-a356-f826da8ad0df None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:04.858423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-d109943f-f47a-43df-a356-f826da8ad0df None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 13:48:04.858423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:04.858423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:04.858423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:04.858423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:04.858423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:04.858423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:04.858423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:04.858423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:04.858423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:04.858423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:04.858423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:04.858423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:48:04.858423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:48:04.858423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:48:04.858423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:48:04.859473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:04.859473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:04.859473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:04.859473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:04.859473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:04.859473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:04.859473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:04.859473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:04.859473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:04.859473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:04.859473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:04.859473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:04.859473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:04.859473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:04.859473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:04.859473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:04.859473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:04.859473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:04.860608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:04.860608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:04.860608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:48:04.860608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:48:04.860608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:48:04.860608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:48:04.860608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:48:04.860608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:48:04.860608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 13:48:04.860608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:04.861815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 316/630] 10.222.0.32 () {56 vars in 1093 bytes} [Tue May 10 13:48:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:04.867766 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109943f-f47a-43df-a356-f826da8ad0df None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:04.961175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a6232-3d7f-42e2-9da4-80e86a7e1470 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:05.014105 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46585326-6cd9-4187-a947-b2a67d822e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:05.014831 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46585326-6cd9-4187-a947-b2a67d822e6d None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:05.015118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46585326-6cd9-4187-a947-b2a67d822e6d None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:05.015393 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46585326-6cd9-4187-a947-b2a67d822e6d None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:05.016169 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46585326-6cd9-4187-a947-b2a67d822e6d None admin] RBAC: Adding query filter params (name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:05.016473 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46585326-6cd9-4187-a947-b2a67d822e6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:05.017865 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46585326-6cd9-4187-a947-b2a67d822e6d None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:05.032087 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 315/631] 10.222.0.32 () {56 vars in 1103 bytes} [Tue May 10 13:48:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:05.032087 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d15fa-22e9-4cdf-aa3f-8b202d358904 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:05.032087 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d15fa-22e9-4cdf-aa3f-8b202d358904 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:05.032087 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d15fa-22e9-4cdf-aa3f-8b202d358904 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:05.032087 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 316/632] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:05.033356 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d15fa-22e9-4cdf-aa3f-8b202d358904 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:05.044390 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109943f-f47a-43df-a356-f826da8ad0df None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:05.086404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63f840-591a-463c-a46a-242c126369e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:05.087358 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63f840-591a-463c-a46a-242c126369e0 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:05.087716 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63f840-591a-463c-a46a-242c126369e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:05.088063 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63f840-591a-463c-a46a-242c126369e0 None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:05.089292 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63f840-591a-463c-a46a-242c126369e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:05.089676 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63f840-591a-463c-a46a-242c126369e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:05.091829 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63f840-591a-463c-a46a-242c126369e0 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:05.122286 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 317/633] 10.222.0.32 () {56 vars in 1133 bytes} [Tue May 10 13:48:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:05.125409 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fbf17-01a2-4b6d-899a-6d1fa7f1638c None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:05.125806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fbf17-01a2-4b6d-899a-6d1fa7f1638c None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:05.126187 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fbf17-01a2-4b6d-899a-6d1fa7f1638c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:05.144795 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-531fbf17-01a2-4b6d-899a-6d1fa7f1638c None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:05.146190 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-531fbf17-01a2-4b6d-899a-6d1fa7f1638c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:05.159360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d15fa-22e9-4cdf-aa3f-8b202d358904 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:05.205204 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bce71-4bed-4429-8f9b-910dd01aeb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:05.206187 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bce71-4bed-4429-8f9b-910dd01aeb72 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:05.206500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bce71-4bed-4429-8f9b-910dd01aeb72 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:05.206777 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bce71-4bed-4429-8f9b-910dd01aeb72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:05.218236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 318/634] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:48:05.219375 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fbf17-01a2-4b6d-899a-6d1fa7f1638c None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:05.222107 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36bce71-4bed-4429-8f9b-910dd01aeb72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:05.224540 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36bce71-4bed-4429-8f9b-910dd01aeb72 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:05.250846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-a36bce71-4bed-4429-8f9b-910dd01aeb72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:05.250846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:05.250846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:05.250846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:05.250846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:05.250846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:05.250846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:05.250846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:05.250846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:05.250846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:05.250846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:05.250846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:05.250846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:05.250846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:05.250846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:05.251789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:05.251789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:05.251789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:05.251789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:05.251789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:05.251789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:05.251789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:05.251789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:05.251789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:05.251789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:05.251789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:05.251789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:05.251789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:05.251789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:05.251789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:05.251789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:05.251789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:05.252639 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:05.252639 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:05.252639 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:05.252639 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:05.255001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 317/635] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:05.260698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bce71-4bed-4429-8f9b-910dd01aeb72 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:05.346249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fbf17-01a2-4b6d-899a-6d1fa7f1638c None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:05.369289 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bce71-4bed-4429-8f9b-910dd01aeb72 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:05.394696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b6b70-ad7b-4767-858d-37fa93c860ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:05.395710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b6b70-ad7b-4767-858d-37fa93c860ff None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:05.396100 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b6b70-ad7b-4767-858d-37fa93c860ff None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:05.396480 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b6b70-ad7b-4767-858d-37fa93c860ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:05.415581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5917a31-1b2c-4456-b0ea-9d9236a7bacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:05.416411 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5917a31-1b2c-4456-b0ea-9d9236a7bacd None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:05.416694 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5917a31-1b2c-4456-b0ea-9d9236a7bacd None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:05.416966 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5917a31-1b2c-4456-b0ea-9d9236a7bacd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:05.432177 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5917a31-1b2c-4456-b0ea-9d9236a7bacd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:05.442321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-b5917a31-1b2c-4456-b0ea-9d9236a7bacd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:48:05.442321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:05.442321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:05.442321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:05.442321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:05.442321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:05.442321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:05.442321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:05.442321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:05.442321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:05.442321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:05.442321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:05.442321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:05.442321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:05.442321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:05.442321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:05.444144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:05.444144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:05.444144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:05.444144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:05.444144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:05.444144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:05.444144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:05.444144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:05.444144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:05.444144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:05.444144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:05.444144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:05.444144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:05.444144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:05.444144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:05.444144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:05.445947 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:05.445947 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:05.445947 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:05.445947 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:05.445947 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:05.445947 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:05.445947 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:05.445947 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:05.445947 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:05.445947 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:05.445947 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:48:05.445947 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:05.448516 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 318/636] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:48:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:05.449473 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5917a31-1b2c-4456-b0ea-9d9236a7bacd None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:05.493658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b6b70-ad7b-4767-858d-37fa93c860ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:05.495848 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b6b70-ad7b-4767-858d-37fa93c860ff None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:05.562723 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5917a31-1b2c-4456-b0ea-9d9236a7bacd None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:05.614333 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d263e-d521-4c77-a18a-bf12f437ee1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:05.619168 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 319/637] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:48:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:48:05.619168 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b6b70-ad7b-4767-858d-37fa93c860ff None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:05.619391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d263e-d521-4c77-a18a-bf12f437ee1f None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:05.619391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d263e-d521-4c77-a18a-bf12f437ee1f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:05.619391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d263e-d521-4c77-a18a-bf12f437ee1f None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:05.620327 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d263e-d521-4c77-a18a-bf12f437ee1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:05.620459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d263e-d521-4c77-a18a-bf12f437ee1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:05.623107 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d263e-d521-4c77-a18a-bf12f437ee1f None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:05.635061 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 319/638] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:05.635987 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d263e-d521-4c77-a18a-bf12f437ee1f None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:05.751481 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b6b70-ad7b-4767-858d-37fa93c860ff None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:05.753279 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d263e-d521-4c77-a18a-bf12f437ee1f None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:05.789747 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34c4d9-5271-4744-8e4c-d43751f53f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:05.790110 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91eedf-e83c-4004-8e32-08ea1c42a1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:05.790447 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91eedf-e83c-4004-8e32-08ea1c42a1cf None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:05.790645 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34c4d9-5271-4744-8e4c-d43751f53f1a None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:05.790825 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91eedf-e83c-4004-8e32-08ea1c42a1cf None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:05.790974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34c4d9-5271-4744-8e4c-d43751f53f1a None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:05.791124 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91eedf-e83c-4004-8e32-08ea1c42a1cf None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:05.791268 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34c4d9-5271-4744-8e4c-d43751f53f1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:05.791732 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91eedf-e83c-4004-8e32-08ea1c42a1cf None admin] RBAC: Adding query filter params (name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:05.792037 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91eedf-e83c-4004-8e32-08ea1c42a1cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:05.793405 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91eedf-e83c-4004-8e32-08ea1c42a1cf None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:05.807322 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 320/639] 10.222.0.32 () {56 vars in 1103 bytes} [Tue May 10 13:48:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:05.807623 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34c4d9-5271-4744-8e4c-d43751f53f1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:05.807809 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91eedf-e83c-4004-8e32-08ea1c42a1cf None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:05.807993 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34c4d9-5271-4744-8e4c-d43751f53f1a None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:05.827459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-7d34c4d9-5271-4744-8e4c-d43751f53f1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:05.827459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:05.827459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:05.827459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:05.827459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:05.827459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:05.827459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:05.827459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:05.827459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:05.827459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:05.827459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:05.827459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:05.827459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:05.827459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:05.827459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:05.828391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:05.828391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:05.828391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:05.828391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:05.828391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:05.828391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:05.828391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:05.828391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:05.828391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:05.828391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:05.828391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:05.828391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:05.828391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:05.828391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:05.828391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:05.828391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:05.828391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:05.829275 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:05.829275 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:05.829275 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:05.829275 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:05.829275 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 320/640] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:05.830226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ce8a0-fd0e-4410-bcb9-c3c202d620cf None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:05.830514 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ce8a0-fd0e-4410-bcb9-c3c202d620cf None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:05.830788 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ce8a0-fd0e-4410-bcb9-c3c202d620cf None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:05.834341 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 321/641] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:05.834341 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ce8a0-fd0e-4410-bcb9-c3c202d620cf None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:05.920519 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91eedf-e83c-4004-8e32-08ea1c42a1cf None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:05.948323 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ce8a0-fd0e-4410-bcb9-c3c202d620cf None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:05.954260 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952cc6b-a965-4405-8e98-31f596738479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:05.955130 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952cc6b-a965-4405-8e98-31f596738479 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:05.955338 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952cc6b-a965-4405-8e98-31f596738479 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:05.955616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952cc6b-a965-4405-8e98-31f596738479 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:05.963456 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952cc6b-a965-4405-8e98-31f596738479 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:05.964905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952cc6b-a965-4405-8e98-31f596738479 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:05.979076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-f952cc6b-a965-4405-8e98-31f596738479 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 13:48:05.979076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:05.979076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:05.979076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:05.979076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:05.979076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:05.979076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:05.979076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:05.979076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:05.979076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:05.979076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:05.979076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:05.979076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:48:05.979076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:48:05.979076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:48:05.979076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:48:05.980285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:05.980285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:05.980285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:05.980285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:05.980285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:05.980285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:05.980285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:05.980285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:05.980285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:05.980285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:05.980285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:05.980285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:05.980285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:05.980285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:05.980285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:05.980285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:05.980285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:05.980285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:05.981602 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:05.981602 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:05.981602 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:48:05.981602 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:48:05.981602 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:48:05.981602 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:48:05.981602 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:48:05.981602 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:48:05.981602 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 13:48:05.981602 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:05.981602 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 321/642] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:48:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:05.981602 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952cc6b-a965-4405-8e98-31f596738479 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:06.010365 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6654ce-d624-4456-94a5-4ddb22394d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:06.011226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6654ce-d624-4456-94a5-4ddb22394d9f None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:06.011516 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6654ce-d624-4456-94a5-4ddb22394d9f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:06.011796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6654ce-d624-4456-94a5-4ddb22394d9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:06.026295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6654ce-d624-4456-94a5-4ddb22394d9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:06.027787 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6654ce-d624-4456-94a5-4ddb22394d9f None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:06.048548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-fe6654ce-d624-4456-94a5-4ddb22394d9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:06.048548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:06.048548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:06.048548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:06.048548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:06.048548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:06.048548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:06.048548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:06.048548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:06.048548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:06.048548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:06.048548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:06.048548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:06.048548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:06.048548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:06.049672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:06.049672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:06.049672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:06.049672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:06.049672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:06.049672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:06.049672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:06.049672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:06.049672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:06.049672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:06.049672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:06.049672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:06.049672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:06.049672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:06.049672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:06.049672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:06.049672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:06.050811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:06.050811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:06.050811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:06.050811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:06.050811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 322/643] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:06.051095 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dad30e-c8d7-4ab7-8e18-59d0bcebbc2f None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:06.051617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dad30e-c8d7-4ab7-8e18-59d0bcebbc2f None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:06.051617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dad30e-c8d7-4ab7-8e18-59d0bcebbc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:06.078245 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-46dad30e-c8d7-4ab7-8e18-59d0bcebbc2f None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:06.078245 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-46dad30e-c8d7-4ab7-8e18-59d0bcebbc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:06.110044 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952cc6b-a965-4405-8e98-31f596738479 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:06.149103 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 323/644] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:48:06.149299 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d6b1d-dc7c-4f1f-8149-42b2c41b9fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:06.149805 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d6b1d-dc7c-4f1f-8149-42b2c41b9fe1 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:06.150068 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d6b1d-dc7c-4f1f-8149-42b2c41b9fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:06.150374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d6b1d-dc7c-4f1f-8149-42b2c41b9fe1 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:06.150795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dad30e-c8d7-4ab7-8e18-59d0bcebbc2f None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:06.151111 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d6b1d-dc7c-4f1f-8149-42b2c41b9fe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:06.151431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d6b1d-dc7c-4f1f-8149-42b2c41b9fe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:06.152808 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d6b1d-dc7c-4f1f-8149-42b2c41b9fe1 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:06.170304 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 322/645] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:06.170304 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d6b1d-dc7c-4f1f-8149-42b2c41b9fe1 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:06.281978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dad30e-c8d7-4ab7-8e18-59d0bcebbc2f None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:06.284974 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d6b1d-dc7c-4f1f-8149-42b2c41b9fe1 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:06.323655 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9b42a-13a3-4c45-80a8-e8095273a874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:06.324333 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9b42a-13a3-4c45-80a8-e8095273a874 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:06.324616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9b42a-13a3-4c45-80a8-e8095273a874 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:06.324891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9b42a-13a3-4c45-80a8-e8095273a874 None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:06.326500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9b42a-13a3-4c45-80a8-e8095273a874 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:06.326915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9b42a-13a3-4c45-80a8-e8095273a874 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:06.327032 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5bcd2-4f3b-4a41-a6ee-7fd0814a511c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:06.328002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5bcd2-4f3b-4a41-a6ee-7fd0814a511c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:06.328392 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5bcd2-4f3b-4a41-a6ee-7fd0814a511c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:06.328894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5bcd2-4f3b-4a41-a6ee-7fd0814a511c None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:06.330220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5bcd2-4f3b-4a41-a6ee-7fd0814a511c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:06.330779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5bcd2-4f3b-4a41-a6ee-7fd0814a511c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:06.332045 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9b42a-13a3-4c45-80a8-e8095273a874 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:06.333390 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5bcd2-4f3b-4a41-a6ee-7fd0814a511c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:06.354681 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 324/646] 10.222.0.32 () {56 vars in 1137 bytes} [Tue May 10 13:48:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:06.355626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9b42a-13a3-4c45-80a8-e8095273a874 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:06.357846 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 323/647] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:06.359036 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5bcd2-4f3b-4a41-a6ee-7fd0814a511c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:06.468992 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5bcd2-4f3b-4a41-a6ee-7fd0814a511c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:06.472715 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9b42a-13a3-4c45-80a8-e8095273a874 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:06.506112 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206d8a8-5d45-4f96-b387-1ff86115caab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:06.506948 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206d8a8-5d45-4f96-b387-1ff86115caab None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:06.507232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206d8a8-5d45-4f96-b387-1ff86115caab None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:06.507507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206d8a8-5d45-4f96-b387-1ff86115caab None admin] PATH_INFO: `/v3/roles/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:06.509554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb59f00-9958-4b32-b45f-bad4c712e94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:06.510367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb59f00-9958-4b32-b45f-bad4c712e94c None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:06.510650 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb59f00-9958-4b32-b45f-bad4c712e94c None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:06.510919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb59f00-9958-4b32-b45f-bad4c712e94c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:06.518158 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb59f00-9958-4b32-b45f-bad4c712e94c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:06.518405 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206d8a8-5d45-4f96-b387-1ff86115caab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:06.523305 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb59f00-9958-4b32-b45f-bad4c712e94c None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:06.526177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-4206d8a8-5d45-4f96-b387-1ff86115caab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:48:06.526177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:06.526177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:06.526177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:06.526177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:06.526177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:06.526177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:06.526177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:06.526177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:06.526177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:06.526177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:06.526177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:06.526177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:06.526177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:06.526177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:06.526177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:06.527343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:06.527343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:06.527343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:06.527343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:06.527343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:06.527343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:06.527343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:06.527343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:06.527343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:06.527343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:06.527343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:06.527343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:06.527343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:06.527343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:06.527343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:06.527343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:06.529394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:06.529394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:06.529394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:06.529394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:06.529394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:06.529394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:06.529394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:06.529394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:06.529394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:06.529394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:06.529394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:48:06.529394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:06.529394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 324/648] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:48:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:06.529394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206d8a8-5d45-4f96-b387-1ff86115caab None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:06.542834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-fdb59f00-9958-4b32-b45f-bad4c712e94c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:06.542834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:06.542834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:06.542834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:06.542834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:06.542834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:06.542834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:06.542834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:06.542834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:06.542834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:06.542834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:06.542834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:06.542834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:06.542834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:06.542834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:06.544796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:06.544796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:06.544796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:06.544796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:06.544796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:06.544796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:06.544796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:06.544796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:06.544796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:06.544796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:06.544796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:06.544796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:06.544796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:06.544796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:06.544796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:06.544796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:06.544796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:06.546656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:06.546656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:06.546656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:06.546656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:06.546656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:06.546656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:06.546656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:06.546656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:06.546656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 325/649] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:06.546656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb59f00-9958-4b32-b45f-bad4c712e94c None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:06.642161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206d8a8-5d45-4f96-b387-1ff86115caab None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:06.656314 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb59f00-9958-4b32-b45f-bad4c712e94c None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:06.678079 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38316056-128d-4ff4-a813-d6ff0e8725d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:06.678743 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38316056-128d-4ff4-a813-d6ff0e8725d7 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:06.679023 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38316056-128d-4ff4-a813-d6ff0e8725d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:06.679294 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38316056-128d-4ff4-a813-d6ff0e8725d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:06.691624 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b689340-3b5a-4856-a594-7eaeef64aeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:06.692417 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b689340-3b5a-4856-a594-7eaeef64aeba None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:06.692712 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b689340-3b5a-4856-a594-7eaeef64aeba None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:06.692977 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b689340-3b5a-4856-a594-7eaeef64aeba None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:06.701643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b689340-3b5a-4856-a594-7eaeef64aeba None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:06.703133 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b689340-3b5a-4856-a594-7eaeef64aeba None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:06.718526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-5b689340-3b5a-4856-a594-7eaeef64aeba None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 13:48:06.718526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:06.718526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:06.718526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:06.718526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:06.718526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:06.718526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:06.718526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:06.718526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:06.718526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:06.718526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:06.718526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:06.718526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:48:06.718526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:48:06.718526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:48:06.718526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:48:06.719603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:06.719603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:06.719603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:06.719603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:06.719603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:06.719603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:06.719603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:06.719603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:06.719603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:06.719603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:06.719603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:06.719603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:06.719603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:06.719603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:06.719603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:06.719603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:06.719603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:06.719603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:06.725423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:06.725423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:06.725423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:48:06.725423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:48:06.725423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:48:06.725423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:48:06.725423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:48:06.725423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:48:06.725423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 13:48:06.725423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:06.725423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 326/650] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:48:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:06.725423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b689340-3b5a-4856-a594-7eaeef64aeba None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:06.767438 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38316056-128d-4ff4-a813-d6ff0e8725d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:06.768895 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38316056-128d-4ff4-a813-d6ff0e8725d7 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:06.839709 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b689340-3b5a-4856-a594-7eaeef64aeba None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:06.879878 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa688f-b9f7-41e3-a0be-dcf086d472d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:06.880085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 325/651] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:48:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:48:06.880168 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa688f-b9f7-41e3-a0be-dcf086d472d9 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:06.880269 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38316056-128d-4ff4-a813-d6ff0e8725d7 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:06.880342 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa688f-b9f7-41e3-a0be-dcf086d472d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:06.880342 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa688f-b9f7-41e3-a0be-dcf086d472d9 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:06.880342 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa688f-b9f7-41e3-a0be-dcf086d472d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:06.880342 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa688f-b9f7-41e3-a0be-dcf086d472d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:06.880342 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa688f-b9f7-41e3-a0be-dcf086d472d9 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:06.888193 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 327/652] 10.222.0.32 () {56 vars in 1103 bytes} [Tue May 10 13:48:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:06.889101 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa688f-b9f7-41e3-a0be-dcf086d472d9 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:06.987319 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38316056-128d-4ff4-a813-d6ff0e8725d7 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:07.007702 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa688f-b9f7-41e3-a0be-dcf086d472d9 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:07.025783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4149f-c727-4592-afb5-b74b40701aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:07.026459 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4149f-c727-4592-afb5-b74b40701aec None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:07.026739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4149f-c727-4592-afb5-b74b40701aec None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:07.027009 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4149f-c727-4592-afb5-b74b40701aec None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:07.027798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4149f-c727-4592-afb5-b74b40701aec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:07.028107 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4149f-c727-4592-afb5-b74b40701aec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:07.030193 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4149f-c727-4592-afb5-b74b40701aec None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:07.042045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 326/653] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:48:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:07.042773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4149f-c727-4592-afb5-b74b40701aec None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:07.049567 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f4f7c-3e00-414d-b7ad-fea71c6ec673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:07.050560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f4f7c-3e00-414d-b7ad-fea71c6ec673 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:07.050847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f4f7c-3e00-414d-b7ad-fea71c6ec673 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:07.051126 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f4f7c-3e00-414d-b7ad-fea71c6ec673 None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:07.051978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f4f7c-3e00-414d-b7ad-fea71c6ec673 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:07.052293 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f4f7c-3e00-414d-b7ad-fea71c6ec673 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:07.053735 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f4f7c-3e00-414d-b7ad-fea71c6ec673 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:07.076450 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 328/654] 10.222.0.32 () {56 vars in 1137 bytes} [Tue May 10 13:48:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:07.076450 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f4f7c-3e00-414d-b7ad-fea71c6ec673 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:07.160599 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4149f-c727-4592-afb5-b74b40701aec None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:07.178620 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f4f7c-3e00-414d-b7ad-fea71c6ec673 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:07.193924 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fd356-9008-4d29-bdbf-48b941d4cd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:07.194743 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fd356-9008-4d29-bdbf-48b941d4cd6a None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:07.195024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fd356-9008-4d29-bdbf-48b941d4cd6a None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:07.195298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fd356-9008-4d29-bdbf-48b941d4cd6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:07.206491 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fd356-9008-4d29-bdbf-48b941d4cd6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:07.207927 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fd356-9008-4d29-bdbf-48b941d4cd6a None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:07.211543 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c196d-e60c-410e-86d2-d7b4f945f95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:07.212339 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c196d-e60c-410e-86d2-d7b4f945f95e None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:07.212618 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c196d-e60c-410e-86d2-d7b4f945f95e None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:07.212889 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c196d-e60c-410e-86d2-d7b4f945f95e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:07.223380 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c196d-e60c-410e-86d2-d7b4f945f95e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:07.224805 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c196d-e60c-410e-86d2-d7b4f945f95e None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:07.225592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-266fd356-9008-4d29-bdbf-48b941d4cd6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:07.225592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:07.225592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:07.225592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:07.225592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:07.225592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:07.225592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:07.225592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:07.225592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:07.225592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:07.225592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:07.225592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:07.225592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:07.225592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:07.225592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:07.226645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:07.226645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:07.226645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:07.226645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:07.226645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:07.226645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:07.226645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:07.226645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:07.226645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:07.226645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:07.226645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:07.226645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:07.226645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:07.226645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:07.226645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:07.226645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:07.226645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:07.227528 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:07.227528 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:07.227528 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:07.227528 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:07.227528 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 327/655] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:07.227881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fd356-9008-4d29-bdbf-48b941d4cd6a None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:07.246165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-559c196d-e60c-410e-86d2-d7b4f945f95e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:07.246165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:07.246165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:07.246165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:07.246165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:07.246165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:07.246165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:07.246165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:07.246165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:07.246165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:07.246165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:07.246165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:07.246165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:07.246165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:07.246165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:07.247350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:07.247350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:07.247350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:07.247350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:07.247350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:07.247350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:07.247350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:07.247350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:07.247350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:07.247350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:07.247350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:07.247350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:07.247350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:07.247350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:07.247350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:07.247350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:07.247350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:07.248503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:07.248503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:07.248503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:07.248503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:07.248503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 329/656] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:07.248878 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c196d-e60c-410e-86d2-d7b4f945f95e None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:07.342299 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fd356-9008-4d29-bdbf-48b941d4cd6a None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:07.350619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c196d-e60c-410e-86d2-d7b4f945f95e None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:07.377543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0235b3c-53f9-403a-b95e-878c9d593720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:07.378211 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0235b3c-53f9-403a-b95e-878c9d593720 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:07.378495 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0235b3c-53f9-403a-b95e-878c9d593720 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:07.378766 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0235b3c-53f9-403a-b95e-878c9d593720 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:07.379591 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0235b3c-53f9-403a-b95e-878c9d593720 None admin] RBAC: Adding query filter params (role.id=567077e602b043f8b81abc208831228a, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=e5d4fd26c21f4170a6790369344f8334) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:07.379898 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0235b3c-53f9-403a-b95e-878c9d593720 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:07.381315 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0235b3c-53f9-403a-b95e-878c9d593720 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:07.387019 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 328/657] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:48:07 2022] GET /identity/v3/role_assignments?user.id=e5d4fd26c21f4170a6790369344f8334&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=567077e602b043f8b81abc208831228a => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:07.387302 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b62dff-58b9-4ba1-86ba-39036efdf25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:07.388666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b62dff-58b9-4ba1-86ba-39036efdf25a None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:07.388873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bf029-0a33-43bc-8d3e-b44415a1d072 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:07.388973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b62dff-58b9-4ba1-86ba-39036efdf25a None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:07.389123 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bf029-0a33-43bc-8d3e-b44415a1d072 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:07.389224 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b62dff-58b9-4ba1-86ba-39036efdf25a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:07.389398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bf029-0a33-43bc-8d3e-b44415a1d072 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:07.390827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 329/658] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:07.395721 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bf029-0a33-43bc-8d3e-b44415a1d072 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:07.471132 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b62dff-58b9-4ba1-86ba-39036efdf25a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:07.472712 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b62dff-58b9-4ba1-86ba-39036efdf25a None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:07.518242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bf029-0a33-43bc-8d3e-b44415a1d072 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:07.552989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6f1d8-4918-4121-9e7e-fbd0af558196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:07.553663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6f1d8-4918-4121-9e7e-fbd0af558196 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:07.553983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6f1d8-4918-4121-9e7e-fbd0af558196 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:07.554256 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6f1d8-4918-4121-9e7e-fbd0af558196 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:07.554965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6f1d8-4918-4121-9e7e-fbd0af558196 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:07.555270 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6f1d8-4918-4121-9e7e-fbd0af558196 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:07.556662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6f1d8-4918-4121-9e7e-fbd0af558196 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:07.571147 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 330/659] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:07.572002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6f1d8-4918-4121-9e7e-fbd0af558196 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:07.592138 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 330/660] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:48:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:48:07.593824 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee38ed-37b2-4171-84ec-33962eb46ee1 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:07.594118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee38ed-37b2-4171-84ec-33962eb46ee1 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:07.594420 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee38ed-37b2-4171-84ec-33962eb46ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:07.612318 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-96ee38ed-37b2-4171-84ec-33962eb46ee1 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:07.613662 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-96ee38ed-37b2-4171-84ec-33962eb46ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:07.681498 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6f1d8-4918-4121-9e7e-fbd0af558196 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:07.694229 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 331/661] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:48:07.694229 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee38ed-37b2-4171-84ec-33962eb46ee1 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:07.719934 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4ed3a-9827-492f-a483-157eb22269cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:07.720605 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4ed3a-9827-492f-a483-157eb22269cc None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:07.720884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4ed3a-9827-492f-a483-157eb22269cc None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:07.721207 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4ed3a-9827-492f-a483-157eb22269cc None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:07.721873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4ed3a-9827-492f-a483-157eb22269cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:07.722173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4ed3a-9827-492f-a483-157eb22269cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:07.723565 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4ed3a-9827-492f-a483-157eb22269cc None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:07.740234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 331/662] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:07.740234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4ed3a-9827-492f-a483-157eb22269cc None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:07.802870 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee38ed-37b2-4171-84ec-33962eb46ee1 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:07.841462 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9bf33-5dfc-4141-a4a6-aad9eebee8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:07.842312 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9bf33-5dfc-4141-a4a6-aad9eebee8a6 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:07.842598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9bf33-5dfc-4141-a4a6-aad9eebee8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:07.842873 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9bf33-5dfc-4141-a4a6-aad9eebee8a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:07.843871 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4ed3a-9827-492f-a483-157eb22269cc None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:07.850183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9bf33-5dfc-4141-a4a6-aad9eebee8a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:07.851790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9bf33-5dfc-4141-a4a6-aad9eebee8a6 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:07.870297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-68f9bf33-5dfc-4141-a4a6-aad9eebee8a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:07.870297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:07.870297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:07.870297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:07.870297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:07.870297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:07.870297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:07.870297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:07.870297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:07.870297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:07.870297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:07.870297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:07.870297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:07.870297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:07.870297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:07.871507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:07.871507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:07.871507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:07.871507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:07.871507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:07.871507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:07.871507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:07.871507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:07.871507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:07.871507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:07.871507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:07.871507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:07.871507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:07.871507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:07.871507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:07.871507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:07.871507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:07.879084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:07.879084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:07.879084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:07.879084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:07.879084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:07.879084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:07.879084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:07.879084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:07.879084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 332/663] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:07.879084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9bf33-5dfc-4141-a4a6-aad9eebee8a6 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:07.883565 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645da092-e86a-4da4-8ecc-897a44064942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:07.884373 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645da092-e86a-4da4-8ecc-897a44064942 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:07.884650 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645da092-e86a-4da4-8ecc-897a44064942 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:07.884928 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645da092-e86a-4da4-8ecc-897a44064942 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:07.896415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645da092-e86a-4da4-8ecc-897a44064942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:07.897933 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645da092-e86a-4da4-8ecc-897a44064942 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:07.915827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-645da092-e86a-4da4-8ecc-897a44064942 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:07.915827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:07.915827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:07.915827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:07.915827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:07.915827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:07.915827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:07.915827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:07.915827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:07.915827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:07.915827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:07.915827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:07.915827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:07.915827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:07.915827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:07.916786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:07.916786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:07.916786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:07.916786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:07.916786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:07.916786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:07.916786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:07.916786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:07.916786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:07.916786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:07.916786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:07.916786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:07.916786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:07.916786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:07.916786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:07.916786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:07.916786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:07.917661 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:07.917661 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:07.917661 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:07.917661 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:07.922420 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 332/664] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:07.923149 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645da092-e86a-4da4-8ecc-897a44064942 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:07.995828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9bf33-5dfc-4141-a4a6-aad9eebee8a6 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:08.030835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1be7a0-39d7-4fc6-aa19-5ea76ce4ed72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:08.031690 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1be7a0-39d7-4fc6-aa19-5ea76ce4ed72 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:08.031977 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1be7a0-39d7-4fc6-aa19-5ea76ce4ed72 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:08.032251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1be7a0-39d7-4fc6-aa19-5ea76ce4ed72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:08.032587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645da092-e86a-4da4-8ecc-897a44064942 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:08.043400 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1be7a0-39d7-4fc6-aa19-5ea76ce4ed72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:08.051962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-3d1be7a0-39d7-4fc6-aa19-5ea76ce4ed72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:48:08.051962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:08.051962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:08.051962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:08.051962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:08.051962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:08.051962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:08.051962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:08.051962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:08.051962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:08.051962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:08.051962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:08.051962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:08.051962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:08.051962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:08.051962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:08.052906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:08.052906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:08.052906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:08.052906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:08.052906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:08.052906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:08.052906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:08.052906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:08.052906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:08.052906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:08.052906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:08.052906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:08.052906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:08.052906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:08.052906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:08.052906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:08.059120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:08.059120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:08.059120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:08.059120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:08.059120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:08.059120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:08.059120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:08.059120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:08.059120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:08.059120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:08.059120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:48:08.059120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:08.059120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 333/665] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:48:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:08.059120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1be7a0-39d7-4fc6-aa19-5ea76ce4ed72 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:08.066902 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601f174-3833-40aa-a266-c48303c32bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:08.067705 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601f174-3833-40aa-a266-c48303c32bc8 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:08.067996 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601f174-3833-40aa-a266-c48303c32bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:08.068262 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601f174-3833-40aa-a266-c48303c32bc8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:08.076040 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601f174-3833-40aa-a266-c48303c32bc8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:08.077700 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601f174-3833-40aa-a266-c48303c32bc8 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:08.092510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-d601f174-3833-40aa-a266-c48303c32bc8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 13:48:08.092510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:08.092510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:08.092510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:08.092510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:08.092510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:08.092510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:08.092510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:08.092510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:08.092510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:08.092510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:08.092510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:08.092510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:48:08.092510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:48:08.092510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:48:08.092510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:48:08.093715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:08.093715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:08.093715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:08.093715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:08.093715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:08.093715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:08.093715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:08.093715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:08.093715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:08.093715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:08.093715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:08.093715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:08.093715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:08.093715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:08.093715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:08.093715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:08.093715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:08.093715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:08.094718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:08.094718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:08.094718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:48:08.094718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:48:08.094718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:48:08.094718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:48:08.094718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:48:08.094718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:48:08.094718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 13:48:08.094718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:08.094718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 333/666] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:48:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:08.095341 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601f174-3833-40aa-a266-c48303c32bc8 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:08.172191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1be7a0-39d7-4fc6-aa19-5ea76ce4ed72 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:08.199588 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601f174-3833-40aa-a266-c48303c32bc8 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:08.213044 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5e8e0-3ab4-40a0-a2f8-961690694916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:08.213949 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5e8e0-3ab4-40a0-a2f8-961690694916 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:08.214656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5e8e0-3ab4-40a0-a2f8-961690694916 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:08.214935 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5e8e0-3ab4-40a0-a2f8-961690694916 None admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:08.215928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5e8e0-3ab4-40a0-a2f8-961690694916 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:08.216240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5e8e0-3ab4-40a0-a2f8-961690694916 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:08.217685 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5e8e0-3ab4-40a0-a2f8-961690694916 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:08.230107 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 334/667] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:48:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:08.230969 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5e8e0-3ab4-40a0-a2f8-961690694916 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:08.242403 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b7d6d-c78a-46dd-be1f-0883cc0d5052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:08.243750 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b7d6d-c78a-46dd-be1f-0883cc0d5052 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:08.244407 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b7d6d-c78a-46dd-be1f-0883cc0d5052 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:08.244685 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b7d6d-c78a-46dd-be1f-0883cc0d5052 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:08.245413 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b7d6d-c78a-46dd-be1f-0883cc0d5052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:08.245719 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b7d6d-c78a-46dd-be1f-0883cc0d5052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:08.247724 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b7d6d-c78a-46dd-be1f-0883cc0d5052 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:08.259598 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 334/668] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:08.260422 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b7d6d-c78a-46dd-be1f-0883cc0d5052 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:08.340585 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5e8e0-3ab4-40a0-a2f8-961690694916 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:08.362476 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b7d6d-c78a-46dd-be1f-0883cc0d5052 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:08.375118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e9557-0bd8-47af-b7f2-f380e156a262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:08.375796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e9557-0bd8-47af-b7f2-f380e156a262 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:08.376072 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e9557-0bd8-47af-b7f2-f380e156a262 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:08.376344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e9557-0bd8-47af-b7f2-f380e156a262 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:08.377088 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e9557-0bd8-47af-b7f2-f380e156a262 None admin] RBAC: Adding query filter params (name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:08.377389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e9557-0bd8-47af-b7f2-f380e156a262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:08.378804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e9557-0bd8-47af-b7f2-f380e156a262 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:08.393588 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 335/669] 10.222.0.32 () {56 vars in 1103 bytes} [Tue May 10 13:48:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:08.393588 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e9557-0bd8-47af-b7f2-f380e156a262 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:08.401434 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afce9fd-47d3-4d70-bb97-75d86fcc16c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:08.402165 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afce9fd-47d3-4d70-bb97-75d86fcc16c2 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:08.402492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afce9fd-47d3-4d70-bb97-75d86fcc16c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:08.402767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afce9fd-47d3-4d70-bb97-75d86fcc16c2 None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:08.404361 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afce9fd-47d3-4d70-bb97-75d86fcc16c2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:08.404673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afce9fd-47d3-4d70-bb97-75d86fcc16c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:08.406220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afce9fd-47d3-4d70-bb97-75d86fcc16c2 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:08.424908 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 335/670] 10.222.0.32 () {56 vars in 1139 bytes} [Tue May 10 13:48:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:08.425743 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afce9fd-47d3-4d70-bb97-75d86fcc16c2 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:08.496246 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e9557-0bd8-47af-b7f2-f380e156a262 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:08.527495 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afce9fd-47d3-4d70-bb97-75d86fcc16c2 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:08.537624 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57158d-68e4-4e15-86ce-6d0769a4294a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:08.538772 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57158d-68e4-4e15-86ce-6d0769a4294a None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:08.539286 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57158d-68e4-4e15-86ce-6d0769a4294a None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:08.539796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57158d-68e4-4e15-86ce-6d0769a4294a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:08.541399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57158d-68e4-4e15-86ce-6d0769a4294a None admin] RBAC: Adding query filter params (role.id=567077e602b043f8b81abc208831228a, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=ada4e799ead24839b109377db3c6393b) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:08.541808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57158d-68e4-4e15-86ce-6d0769a4294a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:08.545092 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57158d-68e4-4e15-86ce-6d0769a4294a None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:08.556078 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 336/671] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:48:08 2022] GET /identity/v3/role_assignments?user.id=ada4e799ead24839b109377db3c6393b&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=567077e602b043f8b81abc208831228a => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:08.557531 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57158d-68e4-4e15-86ce-6d0769a4294a None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:08.576701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd742dc-6299-42cb-963c-673deb007b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:08.578003 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd742dc-6299-42cb-963c-673deb007b0f None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:08.578561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd742dc-6299-42cb-963c-673deb007b0f None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:08.579048 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd742dc-6299-42cb-963c-673deb007b0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:08.587323 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd742dc-6299-42cb-963c-673deb007b0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:08.589217 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd742dc-6299-42cb-963c-673deb007b0f None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:08.605798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-8bd742dc-6299-42cb-963c-673deb007b0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:08.605798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:08.605798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:08.605798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:08.605798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:08.605798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:08.605798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:08.605798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:08.605798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:08.605798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:08.605798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:08.605798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:08.605798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:08.605798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:08.605798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:08.608510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:08.608510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:08.608510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:08.608510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:08.608510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:08.608510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:08.608510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:08.608510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:08.608510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:08.608510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:08.608510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:08.608510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:08.608510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:08.608510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:08.608510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:08.608510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:08.608510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:08.609393 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:08.609393 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:08.609393 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:08.609393 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:08.609393 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:08.609393 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:08.609393 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:08.609393 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:08.616913 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 336/672] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:08.618270 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd742dc-6299-42cb-963c-673deb007b0f None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:08.676320 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57158d-68e4-4e15-86ce-6d0769a4294a None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:08.715598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49ecc6-f074-4750-a3bf-549425106df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:08.716792 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49ecc6-f074-4750-a3bf-549425106df7 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:08.717002 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49ecc6-f074-4750-a3bf-549425106df7 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:08.717257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49ecc6-f074-4750-a3bf-549425106df7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:08.729785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49ecc6-f074-4750-a3bf-549425106df7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:08.732282 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49ecc6-f074-4750-a3bf-549425106df7 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:08.743732 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd742dc-6299-42cb-963c-673deb007b0f None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:08.754707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-be49ecc6-f074-4750-a3bf-549425106df7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:08.754707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:08.754707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:08.754707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:08.754707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:08.754707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:08.754707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:08.754707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:08.754707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:08.754707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:08.754707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:08.754707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:08.754707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:08.754707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:08.754707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:08.755704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:08.755704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:08.755704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:08.755704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:08.755704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:08.755704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:08.755704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:08.755704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:08.755704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:08.755704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:08.755704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:08.755704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:08.755704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:08.755704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:08.755704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:08.755704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:08.755704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:08.756591 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:08.756591 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:08.756591 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:08.756591 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:08.760794 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 337/673] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:08.761847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49ecc6-f074-4750-a3bf-549425106df7 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:08.792657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791bd03-b2f8-4aed-891a-e0d39ef77eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:08.793289 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791bd03-b2f8-4aed-891a-e0d39ef77eda None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:08.793538 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791bd03-b2f8-4aed-891a-e0d39ef77eda None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:08.793843 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791bd03-b2f8-4aed-891a-e0d39ef77eda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:08.881023 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791bd03-b2f8-4aed-891a-e0d39ef77eda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:08.882536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791bd03-b2f8-4aed-891a-e0d39ef77eda None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:08.884241 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49ecc6-f074-4750-a3bf-549425106df7 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:08.929923 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420cc50-c857-4bd2-a2d8-2019adac34ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:08.931050 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420cc50-c857-4bd2-a2d8-2019adac34ab None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:08.931623 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420cc50-c857-4bd2-a2d8-2019adac34ab None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:08.932108 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420cc50-c857-4bd2-a2d8-2019adac34ab None admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:08.933113 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420cc50-c857-4bd2-a2d8-2019adac34ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:08.933640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420cc50-c857-4bd2-a2d8-2019adac34ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:08.936614 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420cc50-c857-4bd2-a2d8-2019adac34ab None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:08.960775 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 338/674] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:48:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:08.962072 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420cc50-c857-4bd2-a2d8-2019adac34ab None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:09.002549 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 337/675] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:48:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:48:09.003436 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791bd03-b2f8-4aed-891a-e0d39ef77eda None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:09.076084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420cc50-c857-4bd2-a2d8-2019adac34ab None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:09.115676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80132be2-14d1-43c9-b4a8-37c809472cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:09.116466 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80132be2-14d1-43c9-b4a8-37c809472cd7 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:09.116898 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80132be2-14d1-43c9-b4a8-37c809472cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:09.117242 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80132be2-14d1-43c9-b4a8-37c809472cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:09.117992 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80132be2-14d1-43c9-b4a8-37c809472cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:09.118464 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80132be2-14d1-43c9-b4a8-37c809472cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:09.120013 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80132be2-14d1-43c9-b4a8-37c809472cd7 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:09.127436 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791bd03-b2f8-4aed-891a-e0d39ef77eda None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:09.138484 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 339/676] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:09.139831 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80132be2-14d1-43c9-b4a8-37c809472cd7 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:09.167600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8a221-42b9-4c57-ba8f-dd0f74f1b125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:09.169258 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8a221-42b9-4c57-ba8f-dd0f74f1b125 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:09.170381 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8a221-42b9-4c57-ba8f-dd0f74f1b125 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:09.170874 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8a221-42b9-4c57-ba8f-dd0f74f1b125 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:09.171952 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8a221-42b9-4c57-ba8f-dd0f74f1b125 None admin] RBAC: Adding query filter params (role.id=567077e602b043f8b81abc208831228a, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=42629678b7dd40fe8013b9644ac337d3) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:09.172469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8a221-42b9-4c57-ba8f-dd0f74f1b125 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:09.174117 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8a221-42b9-4c57-ba8f-dd0f74f1b125 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:09.186373 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 338/677] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:48:09 2022] GET /identity/v3/role_assignments?user.id=42629678b7dd40fe8013b9644ac337d3&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=567077e602b043f8b81abc208831228a => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:09.187719 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8a221-42b9-4c57-ba8f-dd0f74f1b125 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:09.254430 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80132be2-14d1-43c9-b4a8-37c809472cd7 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:09.290693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecaccb-0f17-43ba-a800-305d3bcb5bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:09.297572 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecaccb-0f17-43ba-a800-305d3bcb5bab None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:09.297572 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecaccb-0f17-43ba-a800-305d3bcb5bab None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:09.297572 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecaccb-0f17-43ba-a800-305d3bcb5bab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:09.306035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ecaccb-0f17-43ba-a800-305d3bcb5bab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:09.307845 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ecaccb-0f17-43ba-a800-305d3bcb5bab None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:09.337535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-64ecaccb-0f17-43ba-a800-305d3bcb5bab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:09.337535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:09.337535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:09.337535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:09.337535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:09.337535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:09.337535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:09.337535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:09.337535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:09.337535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:09.337535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:09.337535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:09.337535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:09.337535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:09.337535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:09.338528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:09.338528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:09.338528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:09.338528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:09.338528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:09.338528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:09.338528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:09.338528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:09.338528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:09.338528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:09.338528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:09.338528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:09.338528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:09.338528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:09.338528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:09.338528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:09.338528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:09.340180 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:09.340180 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:09.340180 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:09.340180 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:09.340180 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 340/678] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:09.351278 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecaccb-0f17-43ba-a800-305d3bcb5bab None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:09.377574 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8a221-42b9-4c57-ba8f-dd0f74f1b125 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:09.430973 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022efc69-726e-42da-908d-c6d0a8acd89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:09.431793 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022efc69-726e-42da-908d-c6d0a8acd89c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:09.432071 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022efc69-726e-42da-908d-c6d0a8acd89c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:09.432337 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022efc69-726e-42da-908d-c6d0a8acd89c None admin] PATH_INFO: `/v3/users/swift` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:09.445886 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022efc69-726e-42da-908d-c6d0a8acd89c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:09.455675 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022efc69-726e-42da-908d-c6d0a8acd89c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:09.479995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-022efc69-726e-42da-908d-c6d0a8acd89c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 13:48:09.479995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:09.479995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:09.479995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:09.479995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:09.479995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:09.479995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:09.479995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:09.479995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:09.479995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:09.479995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:09.479995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:09.479995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:48:09.479995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:48:09.479995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:48:09.479995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:48:09.483135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:09.483135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:09.483135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:09.483135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:09.483135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:09.483135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:09.483135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:09.483135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:09.483135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:09.483135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:09.483135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:09.483135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:09.483135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:09.483135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:09.483135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:09.483135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:09.483135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:09.483135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:09.485799 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:09.485799 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:09.485799 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:48:09.485799 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:48:09.485799 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:48:09.485799 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:48:09.485799 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:48:09.485799 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:48:09.485799 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 13:48:09.485799 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:09.485799 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 339/679] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:48:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:09.488274 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022efc69-726e-42da-908d-c6d0a8acd89c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:09.516165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecaccb-0f17-43ba-a800-305d3bcb5bab None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:09.569392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b7e8e-ee65-4eec-996a-6f7870dedc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:09.570082 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b7e8e-ee65-4eec-996a-6f7870dedc9a None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:09.570439 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b7e8e-ee65-4eec-996a-6f7870dedc9a None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:09.570713 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b7e8e-ee65-4eec-996a-6f7870dedc9a None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:09.571988 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b7e8e-ee65-4eec-996a-6f7870dedc9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:09.571988 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b7e8e-ee65-4eec-996a-6f7870dedc9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:09.573182 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b7e8e-ee65-4eec-996a-6f7870dedc9a None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:09.588341 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 341/680] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:09.593518 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b7e8e-ee65-4eec-996a-6f7870dedc9a None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:09.603341 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022efc69-726e-42da-908d-c6d0a8acd89c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:09.656455 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a4842-98ad-4773-adf0-c3c503ac8fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:09.657594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a4842-98ad-4773-adf0-c3c503ac8fc5 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:09.658082 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a4842-98ad-4773-adf0-c3c503ac8fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:09.658598 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a4842-98ad-4773-adf0-c3c503ac8fc5 None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:09.659655 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a4842-98ad-4773-adf0-c3c503ac8fc5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:09.660182 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a4842-98ad-4773-adf0-c3c503ac8fc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:09.661842 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a4842-98ad-4773-adf0-c3c503ac8fc5 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:09.698124 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 340/681] 10.222.0.32 () {56 vars in 1135 bytes} [Tue May 10 13:48:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:09.706646 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a4842-98ad-4773-adf0-c3c503ac8fc5 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:09.798150 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b7e8e-ee65-4eec-996a-6f7870dedc9a None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:09.846975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9db15c-6c22-4a3d-a7b0-d573d5610711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:09.848114 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9db15c-6c22-4a3d-a7b0-d573d5610711 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:09.848400 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9db15c-6c22-4a3d-a7b0-d573d5610711 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:09.848813 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9db15c-6c22-4a3d-a7b0-d573d5610711 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:09.851111 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a4842-98ad-4773-adf0-c3c503ac8fc5 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:09.861168 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9db15c-6c22-4a3d-a7b0-d573d5610711 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:09.862672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9db15c-6c22-4a3d-a7b0-d573d5610711 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:09.888745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-3f9db15c-6c22-4a3d-a7b0-d573d5610711 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:09.888745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:09.888745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:09.888745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:09.888745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:09.888745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:09.888745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:09.888745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:09.888745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:09.888745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:09.888745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:09.888745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:09.888745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:09.888745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:09.888745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:09.889726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:09.889726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:09.889726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:09.889726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:09.889726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:09.889726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:09.889726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:09.889726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:09.889726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:09.889726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:09.889726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:09.889726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:09.889726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:09.889726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:09.889726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:09.889726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:09.889726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:09.891278 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:09.891278 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:09.891278 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:09.891278 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:09.891278 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:09.891278 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:09.891278 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:09.891278 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:09.891278 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 342/682] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:09.891764 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077b5d9-34f6-43e8-a024-ca52065e331b None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:09.892006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077b5d9-34f6-43e8-a024-ca52065e331b None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:09.892159 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077b5d9-34f6-43e8-a024-ca52065e331b None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:09.898092 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 343/683] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:09.906096 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077b5d9-34f6-43e8-a024-ca52065e331b None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:09.911371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca4bd6-228e-43ef-ae80-e510bdf257a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:09.912266 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca4bd6-228e-43ef-ae80-e510bdf257a3 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:09.912556 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca4bd6-228e-43ef-ae80-e510bdf257a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:09.912832 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca4bd6-228e-43ef-ae80-e510bdf257a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:10.005324 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca4bd6-228e-43ef-ae80-e510bdf257a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:10.007457 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca4bd6-228e-43ef-ae80-e510bdf257a3 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:10.026401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077b5d9-34f6-43e8-a024-ca52065e331b None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:10.077001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad8083-eb89-434f-979b-255d76293e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:10.078401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad8083-eb89-434f-979b-255d76293e1e None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:10.078904 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad8083-eb89-434f-979b-255d76293e1e None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:10.079610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad8083-eb89-434f-979b-255d76293e1e None admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:10.081268 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad8083-eb89-434f-979b-255d76293e1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:10.081794 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad8083-eb89-434f-979b-255d76293e1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:10.084263 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad8083-eb89-434f-979b-255d76293e1e None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:10.101841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 344/684] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:48:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:10.103553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385285f4-0204-421a-bfc1-171b3235cdaa None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:10.104057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385285f4-0204-421a-bfc1-171b3235cdaa None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:10.104542 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385285f4-0204-421a-bfc1-171b3235cdaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:10.127153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-385285f4-0204-421a-bfc1-171b3235cdaa None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:10.128999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-385285f4-0204-421a-bfc1-171b3235cdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:10.142129 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 341/685] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:48:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:48:10.144297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca4bd6-228e-43ef-ae80-e510bdf257a3 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:10.210138 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 345/686] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:48:10.211762 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385285f4-0204-421a-bfc1-171b3235cdaa None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:10.282350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca4bd6-228e-43ef-ae80-e510bdf257a3 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:10.319003 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7e8c1-31ac-4a9f-93ad-9ef3101a6a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:10.319833 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7e8c1-31ac-4a9f-93ad-9ef3101a6a87 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:10.320416 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7e8c1-31ac-4a9f-93ad-9ef3101a6a87 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:10.320696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7e8c1-31ac-4a9f-93ad-9ef3101a6a87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:10.321545 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7e8c1-31ac-4a9f-93ad-9ef3101a6a87 None admin] RBAC: Adding query filter params (role.id=567077e602b043f8b81abc208831228a, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=12eb1c001b5e44d8b5b5bc658ed464f5) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:10.321858 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7e8c1-31ac-4a9f-93ad-9ef3101a6a87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:10.323850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7e8c1-31ac-4a9f-93ad-9ef3101a6a87 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:10.333412 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 342/687] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:48:10 2022] GET /identity/v3/role_assignments?user.id=12eb1c001b5e44d8b5b5bc658ed464f5&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=567077e602b043f8b81abc208831228a => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:10.334370 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7e8c1-31ac-4a9f-93ad-9ef3101a6a87 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:10.344265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385285f4-0204-421a-bfc1-171b3235cdaa None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:10.474858 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf4cfc-d898-4632-ba70-f8dfd9210e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:10.475607 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf4cfc-d898-4632-ba70-f8dfd9210e33 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:10.475893 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf4cfc-d898-4632-ba70-f8dfd9210e33 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:10.476168 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf4cfc-d898-4632-ba70-f8dfd9210e33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:10.476876 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7e8c1-31ac-4a9f-93ad-9ef3101a6a87 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:10.519290 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf4cfc-d898-4632-ba70-f8dfd9210e33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:10.520278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f84651-0a3c-4df4-9a67-a1793f420e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:10.520836 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf4cfc-d898-4632-ba70-f8dfd9210e33 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:10.521911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f84651-0a3c-4df4-9a67-a1793f420e7f None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:10.522439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f84651-0a3c-4df4-9a67-a1793f420e7f None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:10.522947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f84651-0a3c-4df4-9a67-a1793f420e7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:10.551449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-6bcf4cfc-d898-4632-ba70-f8dfd9210e33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:10.551449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:10.551449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:10.551449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:10.551449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:10.551449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:10.551449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:10.551449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:10.551449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:10.551449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:10.551449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:10.551449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:10.551449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:10.551449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:10.551449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:10.552407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:10.552407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:10.552407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:10.552407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:10.552407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:10.552407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:10.552407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:10.552407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:10.552407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:10.552407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:10.552407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:10.552407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:10.552407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:10.552407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:10.552407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:10.552407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:10.552407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:10.553286 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:10.553286 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:10.553286 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:10.553286 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:10.557371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f84651-0a3c-4df4-9a67-a1793f420e7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:10.565696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-85f84651-0a3c-4df4-9a67-a1793f420e7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:10.565696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:10.565696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:10.565696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:10.565696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:10.565696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:10.565696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:10.565696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:10.565696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:10.565696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:10.565696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:10.565696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:10.565696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:10.565696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:10.565696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:10.565696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:10.566909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:10.566909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:10.566909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:10.566909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:10.566909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:10.566909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:10.566909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:10.566909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:10.566909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:10.566909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:10.566909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:10.566909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:10.566909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:10.566909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:10.566909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:10.566909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:10.567900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:10.567900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:10.567900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:10.567900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:10.567900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:10.567900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:10.567900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:10.567900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:10.567900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:10.567900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:10.567900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:10.567900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:10.570332 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 346/688] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:10.572221 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 343/689] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:48:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:10.577236 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf4cfc-d898-4632-ba70-f8dfd9210e33 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:10.582314 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f84651-0a3c-4df4-9a67-a1793f420e7f None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:10.717795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf4cfc-d898-4632-ba70-f8dfd9210e33 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:10.724702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f84651-0a3c-4df4-9a67-a1793f420e7f None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:10.756318 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3a0ee-fbd0-41a5-93a5-43c2cd14ee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:10.758595 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3a0ee-fbd0-41a5-93a5-43c2cd14ee6f None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:10.758884 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3a0ee-fbd0-41a5-93a5-43c2cd14ee6f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:10.759158 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3a0ee-fbd0-41a5-93a5-43c2cd14ee6f None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:10.759901 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3a0ee-fbd0-41a5-93a5-43c2cd14ee6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:10.760209 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3a0ee-fbd0-41a5-93a5-43c2cd14ee6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:10.761588 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3a0ee-fbd0-41a5-93a5-43c2cd14ee6f None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:10.769647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d590a-e1c9-40b4-9c00-a62b9b76322e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:10.770360 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d590a-e1c9-40b4-9c00-a62b9b76322e None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:10.770643 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d590a-e1c9-40b4-9c00-a62b9b76322e None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:10.770914 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d590a-e1c9-40b4-9c00-a62b9b76322e None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:10.771669 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d590a-e1c9-40b4-9c00-a62b9b76322e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:10.771968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d590a-e1c9-40b4-9c00-a62b9b76322e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:10.773346 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d590a-e1c9-40b4-9c00-a62b9b76322e None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:10.781803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 347/690] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:10.786274 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 344/691] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:48:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:10.787546 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3a0ee-fbd0-41a5-93a5-43c2cd14ee6f None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:10.792510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d590a-e1c9-40b4-9c00-a62b9b76322e None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:10.923696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d590a-e1c9-40b4-9c00-a62b9b76322e None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:10.936869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3a0ee-fbd0-41a5-93a5-43c2cd14ee6f None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:10.990581 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af282f03-b8b5-44a6-aa38-57f39e408898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:10.991386 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af282f03-b8b5-44a6-aa38-57f39e408898 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:10.991667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af282f03-b8b5-44a6-aa38-57f39e408898 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:10.991939 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af282f03-b8b5-44a6-aa38-57f39e408898 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:10.999838 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736c6a8-4e3e-40e8-b87d-409e716b0683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:11.000652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736c6a8-4e3e-40e8-b87d-409e716b0683 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:11.000934 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736c6a8-4e3e-40e8-b87d-409e716b0683 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:11.001210 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736c6a8-4e3e-40e8-b87d-409e716b0683 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:11.015313 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af282f03-b8b5-44a6-aa38-57f39e408898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:11.016718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af282f03-b8b5-44a6-aa38-57f39e408898 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:11.018455 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736c6a8-4e3e-40e8-b87d-409e716b0683 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:11.019927 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736c6a8-4e3e-40e8-b87d-409e716b0683 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:11.041429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-af282f03-b8b5-44a6-aa38-57f39e408898 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:11.041429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:11.041429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:11.041429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:11.041429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:11.041429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:11.041429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:11.041429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:11.041429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:11.041429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:11.041429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:11.041429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:11.041429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:11.041429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:11.041429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:11.042415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:11.042415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:11.042415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:11.042415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:11.042415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:11.042415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:11.042415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:11.042415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:11.042415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:11.042415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:11.042415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:11.042415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:11.042415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:11.042415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:11.042415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:11.042415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:11.042415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:11.043557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:11.043557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:11.043557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:11.043557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:11.043557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 345/692] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:11.048826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af282f03-b8b5-44a6-aa38-57f39e408898 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:11.053654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-c736c6a8-4e3e-40e8-b87d-409e716b0683 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:11.053654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:11.053654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:11.053654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:11.053654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:11.053654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:11.053654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:11.053654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:11.053654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:11.053654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:11.053654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:11.053654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:11.053654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:11.053654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:11.053654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:11.054631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:11.054631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:11.054631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:11.054631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:11.054631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:11.054631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:11.054631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:11.054631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:11.054631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:11.054631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:11.054631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:11.054631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:11.054631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:11.054631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:11.054631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:11.054631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:11.054631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:11.055503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:11.055503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:11.055503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:11.055503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:11.055503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:11.055503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:11.055503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:11.055503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:11.066881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 348/693] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:11.071162 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736c6a8-4e3e-40e8-b87d-409e716b0683 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:11.237874 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af282f03-b8b5-44a6-aa38-57f39e408898 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:11.238421 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736c6a8-4e3e-40e8-b87d-409e716b0683 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:11.279454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28893ba0-0c12-4643-a42a-8ba626801668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:11.279865 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28893ba0-0c12-4643-a42a-8ba626801668 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:11.280148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28893ba0-0c12-4643-a42a-8ba626801668 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:11.280423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28893ba0-0c12-4643-a42a-8ba626801668 None admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:11.281225 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28893ba0-0c12-4643-a42a-8ba626801668 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:11.281559 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28893ba0-0c12-4643-a42a-8ba626801668 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:11.283787 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28893ba0-0c12-4643-a42a-8ba626801668 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:11.288198 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa747e4-69d0-42ec-98dd-80eaa41660e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:11.289174 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa747e4-69d0-42ec-98dd-80eaa41660e4 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:11.289695 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa747e4-69d0-42ec-98dd-80eaa41660e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:11.290180 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa747e4-69d0-42ec-98dd-80eaa41660e4 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:11.291730 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa747e4-69d0-42ec-98dd-80eaa41660e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:11.292255 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa747e4-69d0-42ec-98dd-80eaa41660e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:11.294888 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa747e4-69d0-42ec-98dd-80eaa41660e4 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:11.299686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 349/694] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:48:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:11.301150 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79056b7e-f145-4743-8cbc-0021955c5b62 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:11.301442 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79056b7e-f145-4743-8cbc-0021955c5b62 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:11.301724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79056b7e-f145-4743-8cbc-0021955c5b62 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:11.307063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 350/695] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:11.307063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79056b7e-f145-4743-8cbc-0021955c5b62 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:11.316622 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 346/696] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:11.318297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1624769-7174-445c-af69-b10b066f1765 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:11.318750 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1624769-7174-445c-af69-b10b066f1765 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:11.319213 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1624769-7174-445c-af69-b10b066f1765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:11.341359 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-e1624769-7174-445c-af69-b10b066f1765 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:11.343473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-e1624769-7174-445c-af69-b10b066f1765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:11.426223 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 347/697] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:48:11.426223 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1624769-7174-445c-af69-b10b066f1765 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:11.444233 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79056b7e-f145-4743-8cbc-0021955c5b62 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:11.497444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3ffd6-eaea-4eb0-86fe-d27fc4475a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:11.498239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3ffd6-eaea-4eb0-86fe-d27fc4475a2e None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:11.498975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3ffd6-eaea-4eb0-86fe-d27fc4475a2e None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:11.499381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3ffd6-eaea-4eb0-86fe-d27fc4475a2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:11.500642 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3ffd6-eaea-4eb0-86fe-d27fc4475a2e None admin] RBAC: Adding query filter params (role.id=567077e602b043f8b81abc208831228a, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=47bbad5318b6417087d7ce6906f8281f) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:11.501051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3ffd6-eaea-4eb0-86fe-d27fc4475a2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:11.502933 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3ffd6-eaea-4eb0-86fe-d27fc4475a2e None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:11.510886 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 351/698] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:48:11 2022] GET /identity/v3/role_assignments?user.id=47bbad5318b6417087d7ce6906f8281f&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=567077e602b043f8b81abc208831228a => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:11.512989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3ffd6-eaea-4eb0-86fe-d27fc4475a2e None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:11.532028 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1624769-7174-445c-af69-b10b066f1765 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:11.581244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfce83-9051-463b-a234-f6bb33c72453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:11.582164 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfce83-9051-463b-a234-f6bb33c72453 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:11.582551 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfce83-9051-463b-a234-f6bb33c72453 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:11.582893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfce83-9051-463b-a234-f6bb33c72453 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:11.593995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddfce83-9051-463b-a234-f6bb33c72453 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:11.595899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddfce83-9051-463b-a234-f6bb33c72453 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:11.614847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-dddfce83-9051-463b-a234-f6bb33c72453 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 13:48:11.614847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:11.614847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:11.614847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:11.614847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:11.614847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:11.614847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:11.614847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:11.614847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:11.614847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:11.614847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:11.614847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:11.614847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:48:11.614847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:48:11.614847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:48:11.614847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:48:11.615958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:11.615958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:11.615958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:11.615958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:11.615958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:11.615958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:11.615958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:11.615958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:11.615958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:11.615958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:11.615958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:11.615958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:11.615958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:11.615958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:11.615958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:11.615958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:11.615958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:11.615958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:11.616870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:11.616870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:11.616870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:48:11.616870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:48:11.616870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:48:11.616870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:48:11.616870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:48:11.616870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:48:11.616870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 13:48:11.616870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:11.619784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 348/699] 10.222.0.32 () {56 vars in 1093 bytes} [Tue May 10 13:48:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:11.626398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfce83-9051-463b-a234-f6bb33c72453 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:11.642778 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3ffd6-eaea-4eb0-86fe-d27fc4475a2e None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:11.683913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca953a8-2fb8-49e7-8fd8-9c739d2366c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:11.685653 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca953a8-2fb8-49e7-8fd8-9c739d2366c4 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:11.686144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca953a8-2fb8-49e7-8fd8-9c739d2366c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:11.686683 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca953a8-2fb8-49e7-8fd8-9c739d2366c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:11.700159 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca953a8-2fb8-49e7-8fd8-9c739d2366c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:11.702059 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca953a8-2fb8-49e7-8fd8-9c739d2366c4 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:11.721756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-2ca953a8-2fb8-49e7-8fd8-9c739d2366c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:11.721756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:11.721756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:11.721756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:11.721756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:11.721756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:11.721756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:11.721756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:11.721756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:11.721756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:11.721756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:11.721756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:11.721756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:11.721756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:11.721756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:11.722790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:11.722790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:11.722790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:11.722790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:11.722790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:11.722790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:11.722790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:11.722790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:11.722790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:11.722790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:11.722790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:11.722790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:11.722790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:11.722790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:11.722790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:11.722790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:11.722790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:11.723674 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:11.723674 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:11.723674 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:11.723674 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:11.730345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 352/700] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:11.733293 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca953a8-2fb8-49e7-8fd8-9c739d2366c4 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:11.742013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfce83-9051-463b-a234-f6bb33c72453 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:11.779487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45d9f5-df53-494d-a365-4ab2199b7d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:11.780443 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45d9f5-df53-494d-a365-4ab2199b7d8f None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:11.780833 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45d9f5-df53-494d-a365-4ab2199b7d8f None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:11.781214 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45d9f5-df53-494d-a365-4ab2199b7d8f None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:11.782694 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45d9f5-df53-494d-a365-4ab2199b7d8f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:11.782694 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45d9f5-df53-494d-a365-4ab2199b7d8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:11.784414 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45d9f5-df53-494d-a365-4ab2199b7d8f None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:11.804294 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 349/701] 10.222.0.32 () {56 vars in 1133 bytes} [Tue May 10 13:48:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:11.810848 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45d9f5-df53-494d-a365-4ab2199b7d8f None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:11.853185 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca953a8-2fb8-49e7-8fd8-9c739d2366c4 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:11.891665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3028e8-b40d-4204-8a3c-f7d7a0a0126c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:11.892499 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3028e8-b40d-4204-8a3c-f7d7a0a0126c None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:11.892896 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3028e8-b40d-4204-8a3c-f7d7a0a0126c None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:11.893284 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3028e8-b40d-4204-8a3c-f7d7a0a0126c None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:11.894130 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3028e8-b40d-4204-8a3c-f7d7a0a0126c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:11.894577 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3028e8-b40d-4204-8a3c-f7d7a0a0126c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:11.896060 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3028e8-b40d-4204-8a3c-f7d7a0a0126c None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:11.914346 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 353/702] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:11.916248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3028e8-b40d-4204-8a3c-f7d7a0a0126c None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:11.948570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45d9f5-df53-494d-a365-4ab2199b7d8f None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:11.994358 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e67193-54bf-4f90-a1c0-66135069a7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:11.995018 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e67193-54bf-4f90-a1c0-66135069a7f9 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:11.995294 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e67193-54bf-4f90-a1c0-66135069a7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:11.995561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e67193-54bf-4f90-a1c0-66135069a7f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:12.040372 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3028e8-b40d-4204-8a3c-f7d7a0a0126c None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:12.072080 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e67193-54bf-4f90-a1c0-66135069a7f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:12.073559 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e67193-54bf-4f90-a1c0-66135069a7f9 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:12.086101 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af29c6e-3da0-4f32-90d7-7f13c98c8bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:12.087077 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af29c6e-3da0-4f32-90d7-7f13c98c8bf3 None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:12.087358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af29c6e-3da0-4f32-90d7-7f13c98c8bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:12.087635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af29c6e-3da0-4f32-90d7-7f13c98c8bf3 None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:12.088508 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af29c6e-3da0-4f32-90d7-7f13c98c8bf3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:12.090666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af29c6e-3da0-4f32-90d7-7f13c98c8bf3 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:12.117501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 354/703] 10.222.0.32 () {60 vars in 1132 bytes} [Tue May 10 13:48:11 2022] POST /identity/v3/users => generated 254 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:48:12.119295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac4595-8133-415a-8b0e-532cce885744 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:12.119585 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac4595-8133-415a-8b0e-532cce885744 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:12.120319 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac4595-8133-415a-8b0e-532cce885744 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:12.123099 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 355/704] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:12.131812 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e166f-73a8-4967-a700-2ec2ade7aaa5 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:12.132139 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e166f-73a8-4967-a700-2ec2ade7aaa5 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:12.132356 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e166f-73a8-4967-a700-2ec2ade7aaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:12.189189 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-744e166f-73a8-4967-a700-2ec2ade7aaa5 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:12.191394 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-744e166f-73a8-4967-a700-2ec2ade7aaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:12.240720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 350/705] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:48:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 13:48:12.246615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e67193-54bf-4f90-a1c0-66135069a7f9 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:12.322587 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 356/706] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:48:12.359505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e166f-73a8-4967-a700-2ec2ade7aaa5 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:12.405395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e67193-54bf-4f90-a1c0-66135069a7f9 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:12.447891 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46285520-b31d-46e4-8390-ef94aa020d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:12.448696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46285520-b31d-46e4-8390-ef94aa020d0e None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:12.448972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46285520-b31d-46e4-8390-ef94aa020d0e None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:12.449241 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46285520-b31d-46e4-8390-ef94aa020d0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:12.463082 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46285520-b31d-46e4-8390-ef94aa020d0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:12.464954 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46285520-b31d-46e4-8390-ef94aa020d0e None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:12.479025 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e166f-73a8-4967-a700-2ec2ade7aaa5 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:12.488468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-46285520-b31d-46e4-8390-ef94aa020d0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:12.488468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:12.488468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:12.488468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:12.488468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:12.488468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:12.488468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:12.488468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:12.488468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:12.488468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:12.488468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:12.488468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:12.488468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:12.488468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:12.488468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:12.489402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:12.489402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:12.489402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:12.489402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:12.489402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:12.489402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:12.489402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:12.489402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:12.489402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:12.489402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:12.489402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:12.489402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:12.489402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:12.489402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:12.489402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:12.489402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:12.489402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:12.490533 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:12.490533 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:12.490533 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:12.490533 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:12.490533 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 351/707] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:12.496129 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46285520-b31d-46e4-8390-ef94aa020d0e None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:12.516661 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f48e8-13d1-41e4-b4fe-0a5a2953f772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:12.517475 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f48e8-13d1-41e4-b4fe-0a5a2953f772 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:12.517757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f48e8-13d1-41e4-b4fe-0a5a2953f772 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:12.518026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f48e8-13d1-41e4-b4fe-0a5a2953f772 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:12.518710 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f48e8-13d1-41e4-b4fe-0a5a2953f772 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:12.520071 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f48e8-13d1-41e4-b4fe-0a5a2953f772 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:12.534555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-298f48e8-13d1-41e4-b4fe-0a5a2953f772 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 13:48:12.534555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:12.534555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:48:12.534555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:48:12.534555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:48:12.534555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:48:12.534555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:48:12.534555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:12.534555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 13:48:12.534555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:12.534555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:12.534555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:12.534555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:12.534555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:12.534555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:12.534555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:12.535529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:12.535529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:12.535529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:12.535529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:12.535529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:12.535529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:12.535529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:12.535529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:48:12.535529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:48:12.535529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:48:12.535529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:48:12.535529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:12.535529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:12.535529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:12.535529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:12.535529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:12.536513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:12.536513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:12.536513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:12.536513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:12.536513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:12.536513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:12.536513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:12.536513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:12.536513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:12.536513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:12.536513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:12.536513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:48:12.536513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:12.536513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 13:48:12.536513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:12.536513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 357/708] 10.222.0.32 () {56 vars in 1129 bytes} [Tue May 10 13:48:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:12.541835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f48e8-13d1-41e4-b4fe-0a5a2953f772 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:12.613278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46285520-b31d-46e4-8390-ef94aa020d0e None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:12.650742 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f48e8-13d1-41e4-b4fe-0a5a2953f772 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:12.663423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7dc08c-35fb-4e49-b181-0da450a45a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:12.664594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dc08c-35fb-4e49-b181-0da450a45a79 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:12.665113 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dc08c-35fb-4e49-b181-0da450a45a79 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:12.665625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dc08c-35fb-4e49-b181-0da450a45a79 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:12.667075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7dc08c-35fb-4e49-b181-0da450a45a79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:12.667645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7dc08c-35fb-4e49-b181-0da450a45a79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:12.670944 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7dc08c-35fb-4e49-b181-0da450a45a79 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:12.686677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7efbb5-d730-47aa-90d7-108b14f13277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:12.687361 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7efbb5-d730-47aa-90d7-108b14f13277 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:12.687690 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7efbb5-d730-47aa-90d7-108b14f13277 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:12.687962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7efbb5-d730-47aa-90d7-108b14f13277 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:12.688670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7efbb5-d730-47aa-90d7-108b14f13277 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:12.688972 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7efbb5-d730-47aa-90d7-108b14f13277 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:12.690433 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7efbb5-d730-47aa-90d7-108b14f13277 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:12.695619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 358/709] 10.222.0.32 () {56 vars in 1124 bytes} [Tue May 10 13:48:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:12.699143 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 352/710] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:12.707277 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7efbb5-d730-47aa-90d7-108b14f13277 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:12.707959 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7dc08c-35fb-4e49-b181-0da450a45a79 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:12.925679 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7dc08c-35fb-4e49-b181-0da450a45a79 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:12.968617 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cba92-bf9e-4300-9e2d-c3fe2dcda9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:12.969323 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cba92-bf9e-4300-9e2d-c3fe2dcda9b1 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:12.969689 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cba92-bf9e-4300-9e2d-c3fe2dcda9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:12.969966 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cba92-bf9e-4300-9e2d-c3fe2dcda9b1 None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:12.970779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cba92-bf9e-4300-9e2d-c3fe2dcda9b1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:12.971102 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cba92-bf9e-4300-9e2d-c3fe2dcda9b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:12.972642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cba92-bf9e-4300-9e2d-c3fe2dcda9b1 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:12.988641 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 353/711] 10.222.0.32 () {56 vars in 1124 bytes} [Tue May 10 13:48:12 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:13.009051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7efbb5-d730-47aa-90d7-108b14f13277 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:13.060246 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad5993-6bc7-469b-83b9-53cd26cab53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:13.061097 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad5993-6bc7-469b-83b9-53cd26cab53a None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:13.061381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad5993-6bc7-469b-83b9-53cd26cab53a None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:13.061658 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad5993-6bc7-469b-83b9-53cd26cab53a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:13.072270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad5993-6bc7-469b-83b9-53cd26cab53a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:13.073735 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad5993-6bc7-469b-83b9-53cd26cab53a None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:13.096852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-10ad5993-6bc7-469b-83b9-53cd26cab53a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:13.096852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:13.096852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:13.096852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:13.096852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:13.096852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:13.096852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:13.096852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:13.096852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:13.096852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:13.096852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:13.096852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:13.096852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:13.096852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:13.096852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:13.099127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:13.099127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:13.099127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:13.099127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:13.099127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:13.099127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:13.099127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:13.099127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:13.099127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:13.099127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:13.099127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:13.099127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:13.099127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:13.099127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:13.099127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:13.099127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:13.099127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:13.101463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:13.101463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:13.101463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:13.101463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:13.101463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:13.101463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:13.101463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:13.101463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:13.103108 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 359/712] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:13.106223 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cba92-bf9e-4300-9e2d-c3fe2dcda9b1 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:13.227175 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cba92-bf9e-4300-9e2d-c3fe2dcda9b1 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:13.269695 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ecfbd-6919-44ad-93a1-80d861e69b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:13.270529 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ecfbd-6919-44ad-93a1-80d861e69b47 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:13.270697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ecfbd-6919-44ad-93a1-80d861e69b47 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:13.270950 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ecfbd-6919-44ad-93a1-80d861e69b47 None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:13.271799 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ecfbd-6919-44ad-93a1-80d861e69b47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:13.272110 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ecfbd-6919-44ad-93a1-80d861e69b47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:13.273632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ecfbd-6919-44ad-93a1-80d861e69b47 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:13.289306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 354/713] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:48:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:13.295513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad5993-6bc7-469b-83b9-53cd26cab53a None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:13.421955 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad5993-6bc7-469b-83b9-53cd26cab53a None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:13.465339 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c0331-9613-4b2a-a7ee-e75320a52250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:13.466239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c0331-9613-4b2a-a7ee-e75320a52250 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:13.466669 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c0331-9613-4b2a-a7ee-e75320a52250 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:13.466955 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c0331-9613-4b2a-a7ee-e75320a52250 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:13.467802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c0331-9613-4b2a-a7ee-e75320a52250 None admin] RBAC: Adding query filter params (role.id=17e40821fc444dd0b040dcfce3eb222b, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=e5d4fd26c21f4170a6790369344f8334) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:13.468117 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c0331-9613-4b2a-a7ee-e75320a52250 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:13.469571 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c0331-9613-4b2a-a7ee-e75320a52250 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:13.476102 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d3b06-28cb-4619-bb5a-b5233074b9c4 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:13.476102 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d3b06-28cb-4619-bb5a-b5233074b9c4 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:13.476102 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d3b06-28cb-4619-bb5a-b5233074b9c4 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:13.476102 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 355/714] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:13.479680 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 360/715] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:48:13 2022] GET /identity/v3/role_assignments?user.id=e5d4fd26c21f4170a6790369344f8334&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=17e40821fc444dd0b040dcfce3eb222b => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:13.483466 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2bff8-7aca-42e0-81b9-d66c04757a89 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:13.483768 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2bff8-7aca-42e0-81b9-d66c04757a89 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:13.484007 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2bff8-7aca-42e0-81b9-d66c04757a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:13.513264 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-6aa2bff8-7aca-42e0-81b9-d66c04757a89 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:13.514614 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-6aa2bff8-7aca-42e0-81b9-d66c04757a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:13.629638 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 356/716] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:48:13.652630 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c0331-9613-4b2a-a7ee-e75320a52250 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:13.806893 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c0331-9613-4b2a-a7ee-e75320a52250 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:13.866561 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b56c2b-859b-4ec9-b847-d5309549b0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:13.867375 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b56c2b-859b-4ec9-b847-d5309549b0d3 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:13.867656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b56c2b-859b-4ec9-b847-d5309549b0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:13.867930 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b56c2b-859b-4ec9-b847-d5309549b0d3 None admin] PATH_INFO: `/v3/services/network` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:13.868594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b56c2b-859b-4ec9-b847-d5309549b0d3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:13.869966 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b56c2b-859b-4ec9-b847-d5309549b0d3 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:13.885058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-f1b56c2b-859b-4ec9-b847-d5309549b0d3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 13:48:13.885058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:13.885058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:48:13.885058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:48:13.885058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:48:13.885058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:48:13.885058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:48:13.885058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:13.885058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 13:48:13.885058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:13.885058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:13.885058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:13.885058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:13.885058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:13.885058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:13.885058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:13.885058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:13.888033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:13.888033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:13.888033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:13.888033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:13.888033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:13.888033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:13.888033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:48:13.888033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:48:13.888033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:48:13.888033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:48:13.888033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:13.888033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:13.888033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:13.888033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:13.888033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:13.888033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:13.890292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:13.890292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:13.890292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:13.890292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:13.890292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:13.890292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:13.890292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:13.890292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:13.890292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:13.890292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:13.890292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:48:13.890292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:13.890292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 13:48:13.890292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:13.890292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 361/717] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:13 2022] GET /identity/v3/services/network => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:13.899385 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2bff8-7aca-42e0-81b9-d66c04757a89 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:14.057650 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2bff8-7aca-42e0-81b9-d66c04757a89 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:14.095729 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f301780-fb0f-4979-8eb6-2412025c1283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:14.096419 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f301780-fb0f-4979-8eb6-2412025c1283 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:14.096701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f301780-fb0f-4979-8eb6-2412025c1283 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:14.096976 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f301780-fb0f-4979-8eb6-2412025c1283 None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:14.097709 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f301780-fb0f-4979-8eb6-2412025c1283 None admin] RBAC: Adding query filter params (name=network) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:14.098011 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f301780-fb0f-4979-8eb6-2412025c1283 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:14.099463 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f301780-fb0f-4979-8eb6-2412025c1283 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:14.105194 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 357/718] 10.222.0.32 () {56 vars in 1112 bytes} [Tue May 10 13:48:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:14.115408 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b56c2b-859b-4ec9-b847-d5309549b0d3 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:14.273630 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b56c2b-859b-4ec9-b847-d5309549b0d3 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:14.322122 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdad10-c3bc-467f-941e-18d3807aef31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:14.323075 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdad10-c3bc-467f-941e-18d3807aef31 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:14.323511 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdad10-c3bc-467f-941e-18d3807aef31 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:14.323940 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdad10-c3bc-467f-941e-18d3807aef31 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:14.324851 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bdad10-c3bc-467f-941e-18d3807aef31 None admin] RBAC: Adding query filter params (type=network) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:14.325437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bdad10-c3bc-467f-941e-18d3807aef31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:14.327517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bdad10-c3bc-467f-941e-18d3807aef31 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:14.342357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 362/719] 10.222.0.32 () {56 vars in 1112 bytes} [Tue May 10 13:48:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:14.486355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439129a-942b-428c-b8b6-d9078aad2d78 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:14.486988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439129a-942b-428c-b8b6-d9078aad2d78 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:14.487225 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439129a-942b-428c-b8b6-d9078aad2d78 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:14.488997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 358/720] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:14.497500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e1804-1dbf-4274-b8ed-98d98a78dbc7 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:14.498189 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e1804-1dbf-4274-b8ed-98d98a78dbc7 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:14.498726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e1804-1dbf-4274-b8ed-98d98a78dbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:14.535515 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-ba5e1804-1dbf-4274-b8ed-98d98a78dbc7 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:14.537286 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-ba5e1804-1dbf-4274-b8ed-98d98a78dbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:14.616949 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 363/721] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:48:14.641122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439129a-942b-428c-b8b6-d9078aad2d78 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:14.771961 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439129a-942b-428c-b8b6-d9078aad2d78 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:14.822050 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949bcf7-c086-486c-83b0-3c5987d6b57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:14.823040 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949bcf7-c086-486c-83b0-3c5987d6b57d None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:14.823327 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949bcf7-c086-486c-83b0-3c5987d6b57d None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:14.823687 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949bcf7-c086-486c-83b0-3c5987d6b57d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:14.836438 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949bcf7-c086-486c-83b0-3c5987d6b57d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:14.852552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-0949bcf7-c086-486c-83b0-3c5987d6b57d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:14.852552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:14.852552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:14.852552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:14.852552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:14.852552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:14.852552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:14.852552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:14.852552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:14.852552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:14.852552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:14.852552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:14.852552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:14.852552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:14.852552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:14.852552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:14.853615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:14.853615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:14.853615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:14.853615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:14.853615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:14.853615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:14.853615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:14.853615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:14.853615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:14.853615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:14.853615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:14.853615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:14.853615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:14.853615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:14.853615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:14.853615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:14.855713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:14.855713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:14.855713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:14.855713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:14.855713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:14.855713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:14.855713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:14.855713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:14.855713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:14.855713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:14.855713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:14.855713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:14.855713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 359/722] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:48:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:14.862228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e1804-1dbf-4274-b8ed-98d98a78dbc7 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:15.054612 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e1804-1dbf-4274-b8ed-98d98a78dbc7 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:15.107374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b497ef8-f617-4ded-b92c-6c519fbf093b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:15.108129 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b497ef8-f617-4ded-b92c-6c519fbf093b None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:15.108385 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b497ef8-f617-4ded-b92c-6c519fbf093b None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:15.108660 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b497ef8-f617-4ded-b92c-6c519fbf093b None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:15.109429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b497ef8-f617-4ded-b92c-6c519fbf093b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:15.109733 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b497ef8-f617-4ded-b92c-6c519fbf093b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:15.111152 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b497ef8-f617-4ded-b92c-6c519fbf093b None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:15.126731 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 364/723] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:48:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:15.135325 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949bcf7-c086-486c-83b0-3c5987d6b57d None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:15.258351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949bcf7-c086-486c-83b0-3c5987d6b57d None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:15.283190 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e7a16-9b93-47aa-8637-0a337fe70085 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:15.283840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e7a16-9b93-47aa-8637-0a337fe70085 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:15.284352 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e7a16-9b93-47aa-8637-0a337fe70085 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:15.289464 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 365/724] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:15.298747 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc1ddb-51d6-45ce-a2d2-8160195e2557 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:15.299328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc1ddb-51d6-45ce-a2d2-8160195e2557 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:15.300068 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc1ddb-51d6-45ce-a2d2-8160195e2557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:15.300748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065ee4c-a6ad-458e-a528-c9d387be40b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:15.301560 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065ee4c-a6ad-458e-a528-c9d387be40b0 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:15.301842 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065ee4c-a6ad-458e-a528-c9d387be40b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:15.302187 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065ee4c-a6ad-458e-a528-c9d387be40b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:15.314391 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065ee4c-a6ad-458e-a528-c9d387be40b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:15.315802 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065ee4c-a6ad-458e-a528-c9d387be40b0 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:15.335983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-a065ee4c-a6ad-458e-a528-c9d387be40b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:15.335983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:15.335983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:15.335983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:15.335983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:15.335983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:15.335983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:15.335983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:15.335983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:15.335983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:15.335983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:15.335983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:15.335983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:15.335983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:15.335983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:15.337600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:15.337600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:15.337600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:15.337600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:15.337600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:15.337600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:15.337600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:15.337600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:15.337600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:15.337600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:15.337600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:15.337600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:15.337600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:15.337600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:15.337600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:15.337600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:15.337600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:15.338524 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:15.338524 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:15.338524 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:15.338524 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:15.338524 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 360/725] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:15.342066 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065ee4c-a6ad-458e-a528-c9d387be40b0 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:15.342480 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-cedc1ddb-51d6-45ce-a2d2-8160195e2557 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:15.343988 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-cedc1ddb-51d6-45ce-a2d2-8160195e2557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:15.464012 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065ee4c-a6ad-458e-a528-c9d387be40b0 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:15.499501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 366/726] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:48:15.509892 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e65551-ea42-4f60-9334-4c55a444ea7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:15.510616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e65551-ea42-4f60-9334-4c55a444ea7c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:15.510903 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e65551-ea42-4f60-9334-4c55a444ea7c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:15.511176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e65551-ea42-4f60-9334-4c55a444ea7c None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:15.511921 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e65551-ea42-4f60-9334-4c55a444ea7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:15.512746 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e65551-ea42-4f60-9334-4c55a444ea7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:15.514147 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e65551-ea42-4f60-9334-4c55a444ea7c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:15.521020 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc1ddb-51d6-45ce-a2d2-8160195e2557 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:15.541149 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 361/727] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:15.547279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e65551-ea42-4f60-9334-4c55a444ea7c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:15.732271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e65551-ea42-4f60-9334-4c55a444ea7c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:15.760493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc1ddb-51d6-45ce-a2d2-8160195e2557 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:15.785371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f22392-a88d-48cd-9162-af12cd90d749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:15.786680 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f22392-a88d-48cd-9162-af12cd90d749 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:15.787236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f22392-a88d-48cd-9162-af12cd90d749 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:15.787775 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f22392-a88d-48cd-9162-af12cd90d749 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:15.804294 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f22392-a88d-48cd-9162-af12cd90d749 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:15.805779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f22392-a88d-48cd-9162-af12cd90d749 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:15.811037 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea906e7-7f82-4302-b670-3c73c74062e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:15.811863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea906e7-7f82-4302-b670-3c73c74062e4 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:15.812143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea906e7-7f82-4302-b670-3c73c74062e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:15.812414 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea906e7-7f82-4302-b670-3c73c74062e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:15.832232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-c7f22392-a88d-48cd-9162-af12cd90d749 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 13:48:15.832232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:15.832232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:15.832232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:15.832232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:15.832232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:15.832232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:15.832232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:15.832232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:15.832232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:15.832232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:15.832232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:15.832232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:48:15.832232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:48:15.832232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:48:15.832232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:48:15.833271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:15.833271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:15.833271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:15.833271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:15.833271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:15.833271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:15.833271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:15.833271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:15.833271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:15.833271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:15.833271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:15.833271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:15.833271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:15.833271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:15.833271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:15.833271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:15.833271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:15.833271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:15.834794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:15.834794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:15.834794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:48:15.834794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:48:15.834794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:48:15.834794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:48:15.834794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:48:15.834794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:48:15.834794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 13:48:15.834794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:15.834794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 362/728] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:48:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:15.839319 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f22392-a88d-48cd-9162-af12cd90d749 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:15.855450 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea906e7-7f82-4302-b670-3c73c74062e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:15.871051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-2ea906e7-7f82-4302-b670-3c73c74062e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:48:15.871051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:15.871051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:15.871051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:15.871051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:15.871051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:15.871051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:15.871051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:15.871051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:15.871051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:15.871051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:15.871051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:15.871051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:15.871051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:15.871051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:15.871051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:15.875188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:15.875188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:15.875188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:15.875188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:15.875188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:15.875188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:15.875188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:15.875188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:15.875188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:15.875188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:15.875188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:15.875188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:15.875188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:15.875188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:15.875188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:15.875188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:15.877424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:15.877424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:15.877424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:15.877424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:15.877424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:15.877424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:15.877424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:15.877424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:15.877424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:15.877424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:15.877424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:48:15.877424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:15.877424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 367/729] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:48:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:15.884184 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea906e7-7f82-4302-b670-3c73c74062e4 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:15.982976 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f22392-a88d-48cd-9162-af12cd90d749 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:16.023248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18eb16-2b04-43cd-b840-96080381fea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:16.023935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18eb16-2b04-43cd-b840-96080381fea8 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:16.024218 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18eb16-2b04-43cd-b840-96080381fea8 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:16.024491 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18eb16-2b04-43cd-b840-96080381fea8 None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:16.025353 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18eb16-2b04-43cd-b840-96080381fea8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:16.025659 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18eb16-2b04-43cd-b840-96080381fea8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:16.027290 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18eb16-2b04-43cd-b840-96080381fea8 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:16.054398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 363/730] 10.222.0.32 () {56 vars in 1135 bytes} [Tue May 10 13:48:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:16.055884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2404234-87d7-42ad-943b-80d35ef16cd5 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:16.056175 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2404234-87d7-42ad-943b-80d35ef16cd5 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:16.056499 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2404234-87d7-42ad-943b-80d35ef16cd5 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:16.058684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 364/731] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:16.064234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2404234-87d7-42ad-943b-80d35ef16cd5 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:16.076311 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea906e7-7f82-4302-b670-3c73c74062e4 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:16.113875 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749f4db-7636-4746-90d4-b48a8505ed0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:16.114603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749f4db-7636-4746-90d4-b48a8505ed0e None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:16.114886 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749f4db-7636-4746-90d4-b48a8505ed0e None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:16.115158 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749f4db-7636-4746-90d4-b48a8505ed0e None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:16.115997 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749f4db-7636-4746-90d4-b48a8505ed0e None admin] RBAC: Adding query filter params (name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:16.116245 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749f4db-7636-4746-90d4-b48a8505ed0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:16.117627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749f4db-7636-4746-90d4-b48a8505ed0e None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:16.127356 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 368/732] 10.222.0.32 () {56 vars in 1103 bytes} [Tue May 10 13:48:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:16.128781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034e142-4237-43a1-b61c-d89a0701d1f3 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:16.129074 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034e142-4237-43a1-b61c-d89a0701d1f3 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:16.129353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034e142-4237-43a1-b61c-d89a0701d1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:16.147417 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-e034e142-4237-43a1-b61c-d89a0701d1f3 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:16.148706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-e034e142-4237-43a1-b61c-d89a0701d1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:16.204552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2404234-87d7-42ad-943b-80d35ef16cd5 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:16.227149 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 369/733] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:48:16.228177 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034e142-4237-43a1-b61c-d89a0701d1f3 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:16.268467 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9403214-eb12-4803-b23b-efba4e14f57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:16.269363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9403214-eb12-4803-b23b-efba4e14f57b None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:16.269681 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9403214-eb12-4803-b23b-efba4e14f57b None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:16.270339 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9403214-eb12-4803-b23b-efba4e14f57b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:16.364120 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9403214-eb12-4803-b23b-efba4e14f57b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:16.366228 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9403214-eb12-4803-b23b-efba4e14f57b None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:16.367492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034e142-4237-43a1-b61c-d89a0701d1f3 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:16.412697 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d82c23-c743-46ef-b2b7-48f9b0699b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:16.413641 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d82c23-c743-46ef-b2b7-48f9b0699b2f None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:16.413992 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d82c23-c743-46ef-b2b7-48f9b0699b2f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:16.414377 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d82c23-c743-46ef-b2b7-48f9b0699b2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:16.427290 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d82c23-c743-46ef-b2b7-48f9b0699b2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:16.429011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d82c23-c743-46ef-b2b7-48f9b0699b2f None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:16.454115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-a1d82c23-c743-46ef-b2b7-48f9b0699b2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:16.454115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:16.454115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:16.454115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:16.454115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:16.454115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:16.454115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:16.454115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:16.454115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:16.454115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:16.454115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:16.454115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:16.454115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:16.454115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:16.454115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:16.456009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:16.456009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:16.456009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:16.456009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:16.456009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:16.456009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:16.456009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:16.456009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:16.456009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:16.456009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:16.456009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:16.456009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:16.456009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:16.456009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:16.456009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:16.456009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:16.456009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:16.458257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:16.458257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:16.458257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:16.458257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:16.458257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 370/734] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:16.458257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d82c23-c743-46ef-b2b7-48f9b0699b2f None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:16.493963 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 365/735] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:48:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:48:16.494973 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9403214-eb12-4803-b23b-efba4e14f57b None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:16.579557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d82c23-c743-46ef-b2b7-48f9b0699b2f None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:16.600516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9403214-eb12-4803-b23b-efba4e14f57b None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:16.616053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8138e9-0137-4359-9576-690a8082d57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:16.616740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8138e9-0137-4359-9576-690a8082d57b None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:16.617024 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8138e9-0137-4359-9576-690a8082d57b None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:16.617302 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8138e9-0137-4359-9576-690a8082d57b None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:16.618038 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8138e9-0137-4359-9576-690a8082d57b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:16.619477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8138e9-0137-4359-9576-690a8082d57b None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:16.638014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 371/736] 10.222.0.32 () {60 vars in 1141 bytes} [Tue May 10 13:48:16 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:48:16.639220 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8138e9-0137-4359-9576-690a8082d57b None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:16.648859 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bd59e-27e5-4332-bb9b-71f6c01fb302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:16.651456 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bd59e-27e5-4332-bb9b-71f6c01fb302 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:16.651957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bd59e-27e5-4332-bb9b-71f6c01fb302 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:16.652744 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bd59e-27e5-4332-bb9b-71f6c01fb302 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:16.654932 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bd59e-27e5-4332-bb9b-71f6c01fb302 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:16.655141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bd59e-27e5-4332-bb9b-71f6c01fb302 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:16.657775 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bd59e-27e5-4332-bb9b-71f6c01fb302 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:16.673316 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 366/737] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:16.675012 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d61e5a-53e1-4fbe-bd3d-0d67a8bb0baf None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:16.675215 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d61e5a-53e1-4fbe-bd3d-0d67a8bb0baf None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:16.675464 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d61e5a-53e1-4fbe-bd3d-0d67a8bb0baf None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:16.677299 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 367/738] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:16.678098 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d61e5a-53e1-4fbe-bd3d-0d67a8bb0baf None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:16.794782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8138e9-0137-4359-9576-690a8082d57b None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:16.810947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d61e5a-53e1-4fbe-bd3d-0d67a8bb0baf None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:16.845562 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315ae69-7daa-4ee5-932a-4d7debfa5867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:16.847233 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315ae69-7daa-4ee5-932a-4d7debfa5867 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:16.847601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315ae69-7daa-4ee5-932a-4d7debfa5867 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:16.847955 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315ae69-7daa-4ee5-932a-4d7debfa5867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:16.863361 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315ae69-7daa-4ee5-932a-4d7debfa5867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:16.865604 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315ae69-7daa-4ee5-932a-4d7debfa5867 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:16.872081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b850204-e616-4a76-8a1b-f2fd80ba7fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:16.873140 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b850204-e616-4a76-8a1b-f2fd80ba7fa0 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:16.873579 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b850204-e616-4a76-8a1b-f2fd80ba7fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:16.873954 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b850204-e616-4a76-8a1b-f2fd80ba7fa0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:16.884016 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b850204-e616-4a76-8a1b-f2fd80ba7fa0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:16.885507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b850204-e616-4a76-8a1b-f2fd80ba7fa0 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:16.888048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-f315ae69-7daa-4ee5-932a-4d7debfa5867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:16.888048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:16.888048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:16.888048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:16.888048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:16.888048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:16.888048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:16.888048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:16.888048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:16.888048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:16.888048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:16.888048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:16.888048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:16.888048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:16.888048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:16.890806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:16.890806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:16.890806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:16.890806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:16.890806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:16.890806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:16.890806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:16.890806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:16.890806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:16.890806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:16.890806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:16.890806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:16.890806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:16.890806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:16.890806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:16.890806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:16.890806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:16.893022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:16.893022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:16.893022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:16.893022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:16.893022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 372/739] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:16.893022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5bda0-0963-4dcc-8487-fd96b62d3f50 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:16.893022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5bda0-0963-4dcc-8487-fd96b62d3f50 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:16.893022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5bda0-0963-4dcc-8487-fd96b62d3f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:16.907710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-7b850204-e616-4a76-8a1b-f2fd80ba7fa0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:48:16.907710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:16.907710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:16.907710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:16.907710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:16.907710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:16.907710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:16.907710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:16.907710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:16.907710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:16.907710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:16.907710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:16.907710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:48:16.907710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:48:16.907710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:48:16.907710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:48:16.908900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:16.908900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:16.908900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:16.908900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:16.908900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:16.908900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:16.908900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:16.908900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:16.908900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:16.908900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:16.908900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:16.908900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:16.908900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:16.908900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:16.908900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:16.908900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:16.908900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:16.908900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:16.910512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:16.910512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:16.910512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:48:16.910512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:48:16.910512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:48:16.910512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:48:16.910512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:48:16.910512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:48:16.910512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:48:16.910512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:16.910512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 368/740] 10.222.0.32 () {56 vars in 1117 bytes} [Tue May 10 13:48:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:16.910512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b850204-e616-4a76-8a1b-f2fd80ba7fa0 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:16.918470 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-20a5bda0-0963-4dcc-8487-fd96b62d3f50 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:16.920839 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-20a5bda0-0963-4dcc-8487-fd96b62d3f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:17.022424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 373/741] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:48:17.023833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5bda0-0963-4dcc-8487-fd96b62d3f50 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:17.033281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b850204-e616-4a76-8a1b-f2fd80ba7fa0 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:17.079836 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072da9b-8cfe-4e74-ba31-8fc368708213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:17.081125 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072da9b-8cfe-4e74-ba31-8fc368708213 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:17.081617 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072da9b-8cfe-4e74-ba31-8fc368708213 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:17.082107 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072da9b-8cfe-4e74-ba31-8fc368708213 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:17.083093 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072da9b-8cfe-4e74-ba31-8fc368708213 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:17.083620 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072da9b-8cfe-4e74-ba31-8fc368708213 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:17.085219 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072da9b-8cfe-4e74-ba31-8fc368708213 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:17.100339 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 369/742] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:17.101627 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072da9b-8cfe-4e74-ba31-8fc368708213 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:17.160470 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5bda0-0963-4dcc-8487-fd96b62d3f50 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:17.196148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77b402-2624-42f1-aa60-36d41bd23013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:17.196827 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77b402-2624-42f1-aa60-36d41bd23013 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:17.197105 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77b402-2624-42f1-aa60-36d41bd23013 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:17.197372 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77b402-2624-42f1-aa60-36d41bd23013 None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:17.198222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77b402-2624-42f1-aa60-36d41bd23013 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:17.198538 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77b402-2624-42f1-aa60-36d41bd23013 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:17.200512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77b402-2624-42f1-aa60-36d41bd23013 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:17.218751 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072da9b-8cfe-4e74-ba31-8fc368708213 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:17.219838 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 374/743] 10.222.0.32 () {56 vars in 1149 bytes} [Tue May 10 13:48:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:17.220591 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77b402-2624-42f1-aa60-36d41bd23013 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:17.260219 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caae05-97d8-4cc1-9dd0-1ed488a96731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:17.261022 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caae05-97d8-4cc1-9dd0-1ed488a96731 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:17.261302 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caae05-97d8-4cc1-9dd0-1ed488a96731 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:17.261572 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caae05-97d8-4cc1-9dd0-1ed488a96731 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:17.273363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caae05-97d8-4cc1-9dd0-1ed488a96731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:17.281628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-94caae05-97d8-4cc1-9dd0-1ed488a96731 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:17.281628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:17.281628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:17.281628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:17.281628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:17.281628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:17.281628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:17.281628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:17.281628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:17.281628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:17.281628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:17.281628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:17.281628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:17.281628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:17.281628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:17.281628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:17.282779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:17.282779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:17.282779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:17.282779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:17.282779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:17.282779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:17.282779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:17.282779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:17.282779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:17.282779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:17.282779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:17.282779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:17.282779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:17.282779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:17.282779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:17.282779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:17.284095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:17.284095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:17.284095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:17.284095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:17.284095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:17.284095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:17.284095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:17.284095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:17.284095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:17.284095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:17.284095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:17.284095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:17.284095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 370/744] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:48:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:17.284797 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fe664-0018-4b47-b9a0-4c28f9297d41 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:17.284797 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fe664-0018-4b47-b9a0-4c28f9297d41 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:17.290629 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fe664-0018-4b47-b9a0-4c28f9297d41 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:17.290798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 371/745] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:17.291621 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fe664-0018-4b47-b9a0-4c28f9297d41 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:17.340134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77b402-2624-42f1-aa60-36d41bd23013 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:17.378957 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b1c4f-016c-4a04-8fa6-bd4bea5089f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:17.379679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b1c4f-016c-4a04-8fa6-bd4bea5089f0 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:17.379964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b1c4f-016c-4a04-8fa6-bd4bea5089f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:17.380225 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b1c4f-016c-4a04-8fa6-bd4bea5089f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:17.388282 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b1c4f-016c-4a04-8fa6-bd4bea5089f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:17.389977 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b1c4f-016c-4a04-8fa6-bd4bea5089f0 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:17.402737 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fe664-0018-4b47-b9a0-4c28f9297d41 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:17.405477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-f84b1c4f-016c-4a04-8fa6-bd4bea5089f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:17.405477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:17.405477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:17.405477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:17.405477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:17.405477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:17.405477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:17.405477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:17.405477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:17.405477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:17.405477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:17.405477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:17.405477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:17.405477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:17.405477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:17.406429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:17.406429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:17.406429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:17.406429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:17.406429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:17.406429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:17.406429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:17.406429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:17.406429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:17.406429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:17.406429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:17.406429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:17.406429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:17.406429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:17.406429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:17.406429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:17.406429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:17.407405 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:17.407405 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:17.407405 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:17.407405 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:17.407405 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:17.407405 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:17.407405 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:17.407405 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:17.407405 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 375/746] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:17.407909 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b1c4f-016c-4a04-8fa6-bd4bea5089f0 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:17.447394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb07550-3e33-4e29-9ce7-13eff42a6afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:17.448050 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb07550-3e33-4e29-9ce7-13eff42a6afb None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:17.448330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb07550-3e33-4e29-9ce7-13eff42a6afb None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:17.448618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb07550-3e33-4e29-9ce7-13eff42a6afb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:17.520500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b1c4f-016c-4a04-8fa6-bd4bea5089f0 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:17.522077 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb07550-3e33-4e29-9ce7-13eff42a6afb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:17.523625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb07550-3e33-4e29-9ce7-13eff42a6afb None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:17.557682 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59714c-e468-4220-85c1-164c9db6e751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:17.558395 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59714c-e468-4220-85c1-164c9db6e751 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:17.558786 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59714c-e468-4220-85c1-164c9db6e751 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:17.558977 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59714c-e468-4220-85c1-164c9db6e751 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:17.560241 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59714c-e468-4220-85c1-164c9db6e751 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:17.560594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59714c-e468-4220-85c1-164c9db6e751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:17.562228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59714c-e468-4220-85c1-164c9db6e751 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:17.576778 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 376/747] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:48:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:17.576778 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ac167-5957-4cb7-b440-2a1ed02320ff None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:17.576778 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ac167-5957-4cb7-b440-2a1ed02320ff None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:17.576778 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ac167-5957-4cb7-b440-2a1ed02320ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:17.592612 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-749ac167-5957-4cb7-b440-2a1ed02320ff None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:17.593998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-749ac167-5957-4cb7-b440-2a1ed02320ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:17.642944 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 372/748] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:48:17 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:48:17.642944 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb07550-3e33-4e29-9ce7-13eff42a6afb None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:17.689043 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 377/749] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:48:17.690147 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ac167-5957-4cb7-b440-2a1ed02320ff None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:17.761074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb07550-3e33-4e29-9ce7-13eff42a6afb None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:17.800116 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c2689-d3d4-490a-8022-0454c9ad8d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:17.800899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c2689-d3d4-490a-8022-0454c9ad8d37 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:17.801222 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c2689-d3d4-490a-8022-0454c9ad8d37 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:17.801524 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c2689-d3d4-490a-8022-0454c9ad8d37 None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:17.802405 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c2689-d3d4-490a-8022-0454c9ad8d37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:17.802777 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c2689-d3d4-490a-8022-0454c9ad8d37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:17.804294 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c2689-d3d4-490a-8022-0454c9ad8d37 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:17.805698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ac167-5957-4cb7-b440-2a1ed02320ff None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:17.817014 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 373/750] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:48:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:17.817850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c2689-d3d4-490a-8022-0454c9ad8d37 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:17.858379 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c941cd-cf46-4250-a0bb-f83de0984710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:17.859171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c941cd-cf46-4250-a0bb-f83de0984710 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:17.859456 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c941cd-cf46-4250-a0bb-f83de0984710 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:17.859735 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c941cd-cf46-4250-a0bb-f83de0984710 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:17.870785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c941cd-cf46-4250-a0bb-f83de0984710 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:17.873205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c941cd-cf46-4250-a0bb-f83de0984710 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:17.892894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-10c941cd-cf46-4250-a0bb-f83de0984710 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:17.892894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:17.892894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:17.892894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:17.892894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:17.892894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:17.892894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:17.892894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:17.892894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:17.892894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:17.892894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:17.892894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:17.892894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:17.892894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:17.892894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:17.894329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:17.894329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:17.894329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:17.894329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:17.894329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:17.894329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:17.894329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:17.894329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:17.894329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:17.894329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:17.894329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:17.894329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:17.894329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:17.894329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:17.894329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:17.894329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:17.894329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:17.895732 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:17.895732 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:17.895732 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:17.895732 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:17.895732 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 378/751] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:17.895732 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c941cd-cf46-4250-a0bb-f83de0984710 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:17.948567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c2689-d3d4-490a-8022-0454c9ad8d37 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:17.987278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d2b4a-93e0-4309-aecf-f3df9c3f111f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:17.988076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d2b4a-93e0-4309-aecf-f3df9c3f111f None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:17.988355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d2b4a-93e0-4309-aecf-f3df9c3f111f None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:17.988626 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d2b4a-93e0-4309-aecf-f3df9c3f111f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:18.000795 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d2b4a-93e0-4309-aecf-f3df9c3f111f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:18.002284 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d2b4a-93e0-4309-aecf-f3df9c3f111f None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:18.005400 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c941cd-cf46-4250-a0bb-f83de0984710 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:18.020380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-b58d2b4a-93e0-4309-aecf-f3df9c3f111f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:18.020380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:18.020380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:18.020380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:18.020380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:18.020380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:18.020380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:18.020380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:18.020380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:18.020380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:18.020380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:18.020380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:18.020380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:18.020380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:18.020380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:18.022567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:18.022567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:18.022567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:18.022567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:18.022567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:18.022567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:18.022567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:18.022567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:18.022567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:18.022567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:18.022567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:18.022567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:18.022567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:18.022567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:18.022567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:18.022567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:18.022567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:18.024131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:18.024131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:18.024131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:18.024131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:18.024131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 374/752] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:18.024131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d2b4a-93e0-4309-aecf-f3df9c3f111f None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:18.060856 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c1c08-8fc6-4b8f-abc5-2f9fe63fa014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:18.062023 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c1c08-8fc6-4b8f-abc5-2f9fe63fa014 None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:18.062580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c1c08-8fc6-4b8f-abc5-2f9fe63fa014 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:18.063084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c1c08-8fc6-4b8f-abc5-2f9fe63fa014 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:18.064353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c1c08-8fc6-4b8f-abc5-2f9fe63fa014 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:18.066863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c1c08-8fc6-4b8f-abc5-2f9fe63fa014 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:18.086536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 379/753] 10.222.0.32 () {60 vars in 1141 bytes} [Tue May 10 13:48:17 2022] POST /identity/v3/services => generated 240 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:48:18.087941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c1c08-8fc6-4b8f-abc5-2f9fe63fa014 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:18.142222 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d2b4a-93e0-4309-aecf-f3df9c3f111f None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:18.200006 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3ed04-20b4-403c-ac1d-006f90332ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:18.201232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3ed04-20b4-403c-ac1d-006f90332ea1 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:18.201670 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3ed04-20b4-403c-ac1d-006f90332ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:18.202119 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3ed04-20b4-403c-ac1d-006f90332ea1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:18.203948 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3ed04-20b4-403c-ac1d-006f90332ea1 None admin] RBAC: Adding query filter params (role.id=17e40821fc444dd0b040dcfce3eb222b, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=47bbad5318b6417087d7ce6906f8281f) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:18.204452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3ed04-20b4-403c-ac1d-006f90332ea1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:18.206781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3ed04-20b4-403c-ac1d-006f90332ea1 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:18.215274 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 375/754] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:48:18 2022] GET /identity/v3/role_assignments?user.id=47bbad5318b6417087d7ce6906f8281f&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=17e40821fc444dd0b040dcfce3eb222b => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:18.216906 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3ed04-20b4-403c-ac1d-006f90332ea1 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:18.225657 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c1c08-8fc6-4b8f-abc5-2f9fe63fa014 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:18.270441 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86032d-1a45-4020-a7bc-bb8b679b8bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:18.271131 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86032d-1a45-4020-a7bc-bb8b679b8bac None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:18.271410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86032d-1a45-4020-a7bc-bb8b679b8bac None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:18.271683 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86032d-1a45-4020-a7bc-bb8b679b8bac None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:18.272426 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86032d-1a45-4020-a7bc-bb8b679b8bac None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:18.272734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86032d-1a45-4020-a7bc-bb8b679b8bac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:18.275217 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86032d-1a45-4020-a7bc-bb8b679b8bac None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:18.371194 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3ed04-20b4-403c-ac1d-006f90332ea1 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:18.414038 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e490b-dbb3-442b-bcee-bafddd72936d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:18.415160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e490b-dbb3-442b-bcee-bafddd72936d None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:18.415677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e490b-dbb3-442b-bcee-bafddd72936d None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:18.416150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e490b-dbb3-442b-bcee-bafddd72936d None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:18.417877 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e490b-dbb3-442b-bcee-bafddd72936d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:18.419262 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e490b-dbb3-442b-bcee-bafddd72936d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:18.420891 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e490b-dbb3-442b-bcee-bafddd72936d None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:18.425903 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 380/755] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:18.427314 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86032d-1a45-4020-a7bc-bb8b679b8bac None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:18.438678 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 376/756] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:18.444539 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e490b-dbb3-442b-bcee-bafddd72936d None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:18.543773 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86032d-1a45-4020-a7bc-bb8b679b8bac None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:18.558344 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e490b-dbb3-442b-bcee-bafddd72936d None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:18.581892 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333e997-445b-4aa8-a6fa-21c63e6cbc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:18.582489 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333e997-445b-4aa8-a6fa-21c63e6cbc8d None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:18.582842 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333e997-445b-4aa8-a6fa-21c63e6cbc8d None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:18.583206 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333e997-445b-4aa8-a6fa-21c63e6cbc8d None admin] PATH_INFO: `/v3/users/nova` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:18.592089 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333e997-445b-4aa8-a6fa-21c63e6cbc8d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:18.593878 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333e997-445b-4aa8-a6fa-21c63e6cbc8d None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:18.598933 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76692b69-26e8-4286-ad84-bdd63453041c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:18.600059 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76692b69-26e8-4286-ad84-bdd63453041c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:18.600537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76692b69-26e8-4286-ad84-bdd63453041c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:18.600991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76692b69-26e8-4286-ad84-bdd63453041c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:18.610109 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76692b69-26e8-4286-ad84-bdd63453041c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:18.610344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-7333e997-445b-4aa8-a6fa-21c63e6cbc8d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 13:48:18.610344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:18.610344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:18.610344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:18.610344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:18.610344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:18.610344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:18.610344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:18.610344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:18.610344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:18.610344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:18.610344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:18.610344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:48:18.610344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:48:18.610344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:48:18.610344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:48:18.611221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:18.611221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:18.611221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:18.611221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:18.611221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:18.611221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:18.611221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:18.611221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:18.611221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:18.611221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:18.611221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:18.611221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:18.611221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:18.611221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:18.611221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:18.611221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:18.611221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:18.611221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:18.612155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:18.612155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:18.612155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:48:18.612155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:48:18.612155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:48:18.612155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:48:18.612155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:48:18.612155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:48:18.612155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 13:48:18.612155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:18.614845 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76692b69-26e8-4286-ad84-bdd63453041c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:18.616134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 381/757] 10.222.0.32 () {56 vars in 1093 bytes} [Tue May 10 13:48:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:18.617513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333e997-445b-4aa8-a6fa-21c63e6cbc8d None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:18.631947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-76692b69-26e8-4286-ad84-bdd63453041c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:18.631947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:18.631947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:18.631947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:18.631947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:18.631947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:18.631947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:18.631947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:18.631947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:18.631947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:18.631947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:18.631947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:18.631947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:18.631947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:18.631947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:18.633002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:18.633002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:18.633002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:18.633002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:18.633002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:18.633002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:18.633002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:18.633002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:18.633002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:18.633002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:18.633002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:18.633002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:18.633002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:18.633002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:18.633002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:18.633002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:18.633002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:18.634007 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:18.634007 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:18.634007 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:18.634007 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:18.634007 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:18.634007 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:18.634007 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:18.634007 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:18.636578 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 377/758] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:18.642597 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76692b69-26e8-4286-ad84-bdd63453041c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:18.727056 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333e997-445b-4aa8-a6fa-21c63e6cbc8d None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:18.754266 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76692b69-26e8-4286-ad84-bdd63453041c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:18.764654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8fd42-6248-41fe-bd9e-0a7bf631a208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:18.765457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8fd42-6248-41fe-bd9e-0a7bf631a208 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:18.765764 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8fd42-6248-41fe-bd9e-0a7bf631a208 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:18.766096 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8fd42-6248-41fe-bd9e-0a7bf631a208 None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:18.767127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8fd42-6248-41fe-bd9e-0a7bf631a208 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:18.767487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8fd42-6248-41fe-bd9e-0a7bf631a208 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:18.769196 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8fd42-6248-41fe-bd9e-0a7bf631a208 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:18.794113 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83b4d8-1aa9-4224-9d24-37890f37a5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:18.795187 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83b4d8-1aa9-4224-9d24-37890f37a5df None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:18.795685 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83b4d8-1aa9-4224-9d24-37890f37a5df None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:18.796156 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83b4d8-1aa9-4224-9d24-37890f37a5df None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:18.797173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83b4d8-1aa9-4224-9d24-37890f37a5df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:18.797701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83b4d8-1aa9-4224-9d24-37890f37a5df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:18.799403 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83b4d8-1aa9-4224-9d24-37890f37a5df None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:18.800955 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 382/759] 10.222.0.32 () {56 vars in 1133 bytes} [Tue May 10 13:48:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:18.803696 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8fd42-6248-41fe-bd9e-0a7bf631a208 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:18.815081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 378/760] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:48:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:18.821095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83b4d8-1aa9-4224-9d24-37890f37a5df None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:18.929337 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83b4d8-1aa9-4224-9d24-37890f37a5df None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:18.967421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45a301-13be-4781-b3d1-61260c7c315d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:18.968507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45a301-13be-4781-b3d1-61260c7c315d None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:18.968989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45a301-13be-4781-b3d1-61260c7c315d None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:18.969457 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45a301-13be-4781-b3d1-61260c7c315d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:18.970533 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45a301-13be-4781-b3d1-61260c7c315d None admin] RBAC: Adding query filter params (role.id=567077e602b043f8b81abc208831228a, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=686c869be43c40a9b63b3647bf689c7a) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:18.971044 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45a301-13be-4781-b3d1-61260c7c315d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:18.972699 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45a301-13be-4781-b3d1-61260c7c315d None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:18.979277 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 379/761] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:48:18 2022] GET /identity/v3/role_assignments?user.id=686c869be43c40a9b63b3647bf689c7a&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=567077e602b043f8b81abc208831228a => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:19.097061 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8fd42-6248-41fe-bd9e-0a7bf631a208 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:19.152576 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c1e32-298a-4f22-b33a-503a969180fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:19.153919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c1e32-298a-4f22-b33a-503a969180fb None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:19.154223 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c1e32-298a-4f22-b33a-503a969180fb None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:19.154515 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c1e32-298a-4f22-b33a-503a969180fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:19.173035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c1e32-298a-4f22-b33a-503a969180fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:19.175256 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c1e32-298a-4f22-b33a-503a969180fb None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:19.197014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-ff3c1e32-298a-4f22-b33a-503a969180fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:19.197014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:19.197014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:19.197014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:19.197014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:19.197014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:19.197014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:19.197014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:19.197014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:19.197014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:19.197014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:19.197014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:19.197014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:19.197014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:19.197014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:19.197974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:19.197974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:19.197974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:19.197974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:19.197974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:19.197974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:19.197974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:19.197974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:19.197974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:19.197974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:19.197974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:19.197974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:19.197974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:19.197974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:19.197974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:19.197974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:19.197974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:19.198896 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:19.198896 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:19.198896 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:19.198896 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:19.201421 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 383/762] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:19.209683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45a301-13be-4781-b3d1-61260c7c315d None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:19.225452 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a27fa-d552-4973-8493-2e43da489191 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:19.225792 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a27fa-d552-4973-8493-2e43da489191 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:19.226006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a27fa-d552-4973-8493-2e43da489191 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:19.227796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 384/763] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:48:19.238616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207b600-cbb0-44ad-bcfd-cee85647d245 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:19.239039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207b600-cbb0-44ad-bcfd-cee85647d245 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:19.239496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207b600-cbb0-44ad-bcfd-cee85647d245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:19.260300 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-d207b600-cbb0-44ad-bcfd-cee85647d245 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:19.261500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-d207b600-cbb0-44ad-bcfd-cee85647d245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:19.342284 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 385/764] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:19.376729 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207b600-cbb0-44ad-bcfd-cee85647d245 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:19.413892 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45a301-13be-4781-b3d1-61260c7c315d None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:19.487617 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1960b0-cbe2-4660-ab28-fe610f2e6ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:19.488341 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1960b0-cbe2-4660-ab28-fe610f2e6ae5 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:19.488623 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1960b0-cbe2-4660-ab28-fe610f2e6ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:19.488888 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1960b0-cbe2-4660-ab28-fe610f2e6ae5 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:19.489614 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1960b0-cbe2-4660-ab28-fe610f2e6ae5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:19.489913 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1960b0-cbe2-4660-ab28-fe610f2e6ae5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:19.491325 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1960b0-cbe2-4660-ab28-fe610f2e6ae5 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:19.512962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 380/765] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:19.514854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1960b0-cbe2-4660-ab28-fe610f2e6ae5 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:19.620150 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207b600-cbb0-44ad-bcfd-cee85647d245 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:19.625487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1960b0-cbe2-4660-ab28-fe610f2e6ae5 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:19.673656 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3343671-580f-43d9-9419-761f02d6c9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:19.674314 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343671-580f-43d9-9419-761f02d6c9d9 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:19.674595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343671-580f-43d9-9419-761f02d6c9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:19.674868 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343671-580f-43d9-9419-761f02d6c9d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:19.685343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3343671-580f-43d9-9419-761f02d6c9d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:19.687030 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3343671-580f-43d9-9419-761f02d6c9d9 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:19.692331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85a42f-454c-42ee-8ed0-f8b5596f6085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:19.693456 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85a42f-454c-42ee-8ed0-f8b5596f6085 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:19.693960 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85a42f-454c-42ee-8ed0-f8b5596f6085 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:19.694476 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85a42f-454c-42ee-8ed0-f8b5596f6085 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:19.695350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85a42f-454c-42ee-8ed0-f8b5596f6085 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:19.696969 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85a42f-454c-42ee-8ed0-f8b5596f6085 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:19.703230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-e3343671-580f-43d9-9419-761f02d6c9d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:19.703230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:19.703230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:19.703230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:19.703230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:19.703230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:19.703230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:19.703230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:19.703230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:19.703230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:19.703230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:19.703230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:19.703230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:19.703230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:19.703230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:19.704166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:19.704166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:19.704166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:19.704166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:19.704166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:19.704166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:19.704166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:19.704166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:19.704166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:19.704166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:19.704166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:19.704166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:19.704166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:19.704166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:19.704166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:19.704166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:19.704166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:19.705034 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:19.705034 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:19.705034 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:19.705034 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:19.705034 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:19.705034 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:19.705034 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:19.705034 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:19.709282 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 381/766] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:19.710711 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3343671-580f-43d9-9419-761f02d6c9d9 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:19.718863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-3e85a42f-454c-42ee-8ed0-f8b5596f6085 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 13:48:19.718863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:19.718863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:48:19.718863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:48:19.718863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:48:19.718863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:48:19.718863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:48:19.718863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:19.718863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 13:48:19.718863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:19.718863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:19.718863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:19.718863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:19.718863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:19.718863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:19.718863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:19.719862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:19.719862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:19.719862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:19.719862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:19.719862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:19.719862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:19.719862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:19.719862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:48:19.719862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:48:19.719862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:48:19.719862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:48:19.719862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:19.719862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:19.719862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:19.719862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:19.719862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:19.720698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:19.720698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:19.720698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:19.720698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:19.720698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:19.720698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:19.720698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:19.720698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:19.720698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:19.720698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:19.720698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:19.720698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:48:19.720698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:19.720698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 13:48:19.720698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:19.723655 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 386/767] 10.222.0.32 () {56 vars in 1129 bytes} [Tue May 10 13:48:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:19.729812 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85a42f-454c-42ee-8ed0-f8b5596f6085 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:19.823758 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3343671-580f-43d9-9419-761f02d6c9d9 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:19.848275 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85a42f-454c-42ee-8ed0-f8b5596f6085 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:19.875598 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2ffc1-4c24-4194-a04a-743989891f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:19.876305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2ffc1-4c24-4194-a04a-743989891f7c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:19.876617 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2ffc1-4c24-4194-a04a-743989891f7c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:19.876935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2ffc1-4c24-4194-a04a-743989891f7c None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:19.877789 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2ffc1-4c24-4194-a04a-743989891f7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:19.878129 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2ffc1-4c24-4194-a04a-743989891f7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:19.879638 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2ffc1-4c24-4194-a04a-743989891f7c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:19.897483 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 382/768] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:48:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:19.904419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a292a0-8113-421d-98fe-700cea19bead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:19.905128 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a292a0-8113-421d-98fe-700cea19bead None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:19.905453 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a292a0-8113-421d-98fe-700cea19bead None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:19.905729 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a292a0-8113-421d-98fe-700cea19bead None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:19.906430 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2ffc1-4c24-4194-a04a-743989891f7c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:19.906539 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a292a0-8113-421d-98fe-700cea19bead None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:19.906774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a292a0-8113-421d-98fe-700cea19bead None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:19.908272 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a292a0-8113-421d-98fe-700cea19bead None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:19.928474 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 387/769] 10.222.0.32 () {56 vars in 1124 bytes} [Tue May 10 13:48:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:19.929579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a292a0-8113-421d-98fe-700cea19bead None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:20.032710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2ffc1-4c24-4194-a04a-743989891f7c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:20.081539 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3a7bc-3dad-473d-a01d-9f3570c76d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:20.082891 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3a7bc-3dad-473d-a01d-9f3570c76d66 None admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:20.083377 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3a7bc-3dad-473d-a01d-9f3570c76d66 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:20.083851 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3a7bc-3dad-473d-a01d-9f3570c76d66 None admin] PATH_INFO: `/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/e5d4fd26c21f4170a6790369344f8334/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:20.088058 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3a7bc-3dad-473d-a01d-9f3570c76d66 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1cda14bca5c497dba2d18685dfe6cc2, user_id=e5d4fd26c21f4170a6790369344f8334, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:20.090992 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3a7bc-3dad-473d-a01d-9f3570c76d66 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:20.118371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 383/770] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:48:19 2022] PUT /identity/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/e5d4fd26c21f4170a6790369344f8334/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:48:20.145858 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a292a0-8113-421d-98fe-700cea19bead None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:20.193800 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3049bf-bddd-4953-8c6c-c60daaa76321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:20.194953 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3049bf-bddd-4953-8c6c-c60daaa76321 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:20.195552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3049bf-bddd-4953-8c6c-c60daaa76321 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:20.196065 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3049bf-bddd-4953-8c6c-c60daaa76321 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:20.196998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3049bf-bddd-4953-8c6c-c60daaa76321 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:20.197511 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3049bf-bddd-4953-8c6c-c60daaa76321 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:20.199151 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3049bf-bddd-4953-8c6c-c60daaa76321 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:20.211374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3a7bc-3dad-473d-a01d-9f3570c76d66 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:20.212852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 388/771] 10.222.0.32 () {56 vars in 1124 bytes} [Tue May 10 13:48:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:20.389414 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3a7bc-3dad-473d-a01d-9f3570c76d66 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:20.432091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d58bc-a845-4112-8aa4-a12315aa0cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:20.432872 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d58bc-a845-4112-8aa4-a12315aa0cff None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:20.433190 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d58bc-a845-4112-8aa4-a12315aa0cff None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:20.433467 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d58bc-a845-4112-8aa4-a12315aa0cff None admin] PATH_INFO: `/v3/endpoints` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:20.434581 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d58bc-a845-4112-8aa4-a12315aa0cff None admin] RBAC: Adding query filter params (interface=public, service_id=c069c172af5c4046a1102cdb00946f41, region_id=RegionOne) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:20.434898 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d58bc-a845-4112-8aa4-a12315aa0cff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:20.436326 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d58bc-a845-4112-8aa4-a12315aa0cff None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:20.446785 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 384/772] 10.222.0.32 () {56 vars in 1251 bytes} [Tue May 10 13:48:20 2022] GET /identity/v3/endpoints?service_id=c069c172af5c4046a1102cdb00946f41&interface=public®ion_id=RegionOne => generated 194 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:20.452983 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3049bf-bddd-4953-8c6c-c60daaa76321 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:20.592701 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3049bf-bddd-4953-8c6c-c60daaa76321 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:20.638728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2449a-5611-42ae-b3f5-ae9dcd004ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:20.639621 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2449a-5611-42ae-b3f5-ae9dcd004ca4 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:20.639965 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2449a-5611-42ae-b3f5-ae9dcd004ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:20.640289 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2449a-5611-42ae-b3f5-ae9dcd004ca4 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:20.641156 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2449a-5611-42ae-b3f5-ae9dcd004ca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:20.643659 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2449a-5611-42ae-b3f5-ae9dcd004ca4 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:20.653051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 389/773] 10.222.0.32 () {56 vars in 1087 bytes} [Tue May 10 13:48:20 2022] GET /identity/v3/services => generated 772 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:21.198452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd04fd-2547-4db9-ad63-002957b5a983 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:21.199195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd04fd-2547-4db9-ad63-002957b5a983 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:21.199195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd04fd-2547-4db9-ad63-002957b5a983 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:21.201424 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 385/774] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:21.206739 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faf6a2-8bf4-436f-a682-0510b34a5d14 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:21.207517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faf6a2-8bf4-436f-a682-0510b34a5d14 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:21.207517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faf6a2-8bf4-436f-a682-0510b34a5d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:21.235579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-b6faf6a2-8bf4-436f-a682-0510b34a5d14 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:21.236886 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-b6faf6a2-8bf4-436f-a682-0510b34a5d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:21.343660 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 390/775] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:21.378487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd04fd-2547-4db9-ad63-002957b5a983 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:21.495239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e7471-3510-418f-add5-babc3848d166 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:21.495892 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e7471-3510-418f-add5-babc3848d166 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:21.496381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e7471-3510-418f-add5-babc3848d166 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:21.498549 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 391/776] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:21.504949 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847300a9-368f-4e48-ad00-b7e69fa2ea9a None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:21.505620 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847300a9-368f-4e48-ad00-b7e69fa2ea9a None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:21.506098 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847300a9-368f-4e48-ad00-b7e69fa2ea9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:21.525195 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-847300a9-368f-4e48-ad00-b7e69fa2ea9a None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:21.526857 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-847300a9-368f-4e48-ad00-b7e69fa2ea9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:21.540719 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd04fd-2547-4db9-ad63-002957b5a983 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:21.614633 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e0c4d-e6f1-4cf4-b727-2a5eb770462f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:21.615826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e0c4d-e6f1-4cf4-b727-2a5eb770462f None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:21.617200 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e0c4d-e6f1-4cf4-b727-2a5eb770462f None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:21.618544 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e0c4d-e6f1-4cf4-b727-2a5eb770462f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:21.643280 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e0c4d-e6f1-4cf4-b727-2a5eb770462f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:21.654985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-693e0c4d-e6f1-4cf4-b727-2a5eb770462f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:21.654985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:21.654985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:21.654985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:21.654985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:21.654985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:21.654985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:21.654985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:21.654985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:21.654985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:21.654985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:21.654985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:21.654985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:21.654985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:21.654985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:21.654985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:21.656054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:21.656054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:21.656054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:21.656054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:21.656054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:21.656054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:21.656054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:21.656054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:21.656054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:21.656054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:21.656054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:21.656054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:21.656054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:21.656054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:21.656054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:21.656054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:21.656905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:21.656905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:21.656905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:21.656905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:21.656905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:21.656905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:21.656905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:21.656905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:21.656905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:21.656905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:21.656905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:21.656905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:21.667241 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 392/777] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:48:21.667812 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 386/778] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:48:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:21.672518 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847300a9-368f-4e48-ad00-b7e69fa2ea9a None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:21.704356 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e0c4d-e6f1-4cf4-b727-2a5eb770462f None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:21.865527 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847300a9-368f-4e48-ad00-b7e69fa2ea9a None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:21.921273 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c106cd3-2db3-4a5c-b8a9-c27ac4c9592e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:21.922329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c106cd3-2db3-4a5c-b8a9-c27ac4c9592e None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:21.922921 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c106cd3-2db3-4a5c-b8a9-c27ac4c9592e None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:21.923560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c106cd3-2db3-4a5c-b8a9-c27ac4c9592e None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:21.925160 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c106cd3-2db3-4a5c-b8a9-c27ac4c9592e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:21.925904 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c106cd3-2db3-4a5c-b8a9-c27ac4c9592e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:21.928622 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c106cd3-2db3-4a5c-b8a9-c27ac4c9592e None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:21.932791 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e0c4d-e6f1-4cf4-b727-2a5eb770462f None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:21.942141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 393/779] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:48:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:21.944115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087ad75-1b11-48b8-ad94-27a0a7cee0b0 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:21.944560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087ad75-1b11-48b8-ad94-27a0a7cee0b0 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:21.945136 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087ad75-1b11-48b8-ad94-27a0a7cee0b0 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:21.953884 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 394/780] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:21.955130 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087ad75-1b11-48b8-ad94-27a0a7cee0b0 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:21.978859 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafacd0-43c0-412a-91e9-692ed6470562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:21.983319 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafacd0-43c0-412a-91e9-692ed6470562 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:21.983319 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafacd0-43c0-412a-91e9-692ed6470562 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:21.983319 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafacd0-43c0-412a-91e9-692ed6470562 None admin] PATH_INFO: `/v3/services/network` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:21.983319 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafacd0-43c0-412a-91e9-692ed6470562 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:21.983947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafacd0-43c0-412a-91e9-692ed6470562 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:22.023158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-9fafacd0-43c0-412a-91e9-692ed6470562 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 13:48:22.023158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:22.023158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:48:22.023158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:48:22.023158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:48:22.023158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:48:22.023158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:48:22.023158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:22.023158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 13:48:22.023158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:22.023158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:22.023158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:22.023158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:22.023158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:22.023158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:22.023158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:22.023158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:22.025181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:22.025181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:22.025181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:22.025181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:22.025181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:22.025181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:22.025181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:48:22.025181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:48:22.025181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:48:22.025181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:48:22.025181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:22.025181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:22.025181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:22.025181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:22.025181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:22.025181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:22.026997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:22.026997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:22.026997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:22.026997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:22.026997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:22.026997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:22.026997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:22.026997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:22.026997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:22.026997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:22.026997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:48:22.026997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:22.026997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 13:48:22.026997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:22.028546 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 387/781] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:21 2022] GET /identity/v3/services/network => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:22.031185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85496c99-fb7c-4e9a-9456-e06249ef972c None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:22.031185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85496c99-fb7c-4e9a-9456-e06249ef972c None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:22.031700 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85496c99-fb7c-4e9a-9456-e06249ef972c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:22.050077 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-85496c99-fb7c-4e9a-9456-e06249ef972c None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:22.051350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-85496c99-fb7c-4e9a-9456-e06249ef972c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:22.108609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087ad75-1b11-48b8-ad94-27a0a7cee0b0 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:22.137604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 388/782] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:22.139279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85496c99-fb7c-4e9a-9456-e06249ef972c None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:22.146737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd02bc-5c7b-4f1c-8ae2-3a0cf3f20521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:22.147808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd02bc-5c7b-4f1c-8ae2-3a0cf3f20521 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:22.148295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd02bc-5c7b-4f1c-8ae2-3a0cf3f20521 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:22.148710 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd02bc-5c7b-4f1c-8ae2-3a0cf3f20521 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:22.161422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd02bc-5c7b-4f1c-8ae2-3a0cf3f20521 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:22.163097 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd02bc-5c7b-4f1c-8ae2-3a0cf3f20521 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:22.184106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-b7bd02bc-5c7b-4f1c-8ae2-3a0cf3f20521 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:22.184106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:22.184106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:22.184106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:22.184106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:22.184106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:22.184106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:22.184106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:22.184106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:22.184106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:22.184106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:22.184106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:22.184106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:22.184106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:22.184106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:22.185803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:22.185803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:22.185803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:22.185803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:22.185803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:22.185803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:22.185803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:22.185803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:22.185803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:22.185803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:22.185803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:22.185803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:22.185803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:22.185803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:22.185803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:22.185803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:22.185803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:22.186915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:22.186915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:22.186915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:22.186915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:22.188654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 395/783] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:22.189972 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd02bc-5c7b-4f1c-8ae2-3a0cf3f20521 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:22.272096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85496c99-fb7c-4e9a-9456-e06249ef972c None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:22.310837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7298f-8661-4f2d-afab-44ead7bae7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:22.311934 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7298f-8661-4f2d-afab-44ead7bae7ee None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:22.312451 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7298f-8661-4f2d-afab-44ead7bae7ee None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:22.313006 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7298f-8661-4f2d-afab-44ead7bae7ee None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:22.314583 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7298f-8661-4f2d-afab-44ead7bae7ee None admin] RBAC: Adding query filter params (name=network) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:22.315353 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7298f-8661-4f2d-afab-44ead7bae7ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:22.317832 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7298f-8661-4f2d-afab-44ead7bae7ee None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:22.324051 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 389/784] 10.222.0.32 () {56 vars in 1112 bytes} [Tue May 10 13:48:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:22.325593 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7298f-8661-4f2d-afab-44ead7bae7ee None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:22.330519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd02bc-5c7b-4f1c-8ae2-3a0cf3f20521 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:22.368206 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e4835-e41e-4a6a-a306-26e75e8f4f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:22.369434 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e4835-e41e-4a6a-a306-26e75e8f4f44 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:22.370032 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e4835-e41e-4a6a-a306-26e75e8f4f44 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:22.370563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e4835-e41e-4a6a-a306-26e75e8f4f44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:22.382260 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e4835-e41e-4a6a-a306-26e75e8f4f44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:22.392897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-f57e4835-e41e-4a6a-a306-26e75e8f4f44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:48:22.392897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:22.392897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:22.392897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:22.392897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:22.392897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:22.392897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:22.392897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:22.392897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:22.392897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:22.392897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:22.392897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:22.392897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:22.392897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:22.392897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:22.392897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:22.393924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:22.393924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:22.393924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:22.393924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:22.393924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:22.393924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:22.393924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:22.393924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:22.393924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:22.393924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:22.393924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:22.393924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:22.393924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:22.393924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:22.393924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:22.393924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:22.395163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:22.395163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:22.395163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:22.395163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:22.395163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:22.395163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:22.395163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:22.395163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:22.395163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:22.395163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:22.395163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:48:22.395163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:22.397812 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 396/785] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:48:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:22.399009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e4835-e41e-4a6a-a306-26e75e8f4f44 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:22.435382 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7298f-8661-4f2d-afab-44ead7bae7ee None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:22.470657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42fac8-4a1a-4a03-9f1d-c339238b6be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:22.471331 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42fac8-4a1a-4a03-9f1d-c339238b6be1 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:22.471599 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42fac8-4a1a-4a03-9f1d-c339238b6be1 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:22.471868 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42fac8-4a1a-4a03-9f1d-c339238b6be1 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:22.472592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42fac8-4a1a-4a03-9f1d-c339238b6be1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:22.472908 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42fac8-4a1a-4a03-9f1d-c339238b6be1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:22.474306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42fac8-4a1a-4a03-9f1d-c339238b6be1 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:22.487706 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 390/786] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:22.488712 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42fac8-4a1a-4a03-9f1d-c339238b6be1 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:22.513599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e4835-e41e-4a6a-a306-26e75e8f4f44 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:22.552986 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17c934-4e86-4f47-9ef0-623566e467d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:22.554035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17c934-4e86-4f47-9ef0-623566e467d1 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:22.554570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17c934-4e86-4f47-9ef0-623566e467d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:22.555052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17c934-4e86-4f47-9ef0-623566e467d1 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:22.556050 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17c934-4e86-4f47-9ef0-623566e467d1 None admin] RBAC: Adding query filter params (type=network) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:22.556561 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17c934-4e86-4f47-9ef0-623566e467d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:22.558167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17c934-4e86-4f47-9ef0-623566e467d1 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:22.564678 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 397/787] 10.222.0.32 () {56 vars in 1112 bytes} [Tue May 10 13:48:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:22.565840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17c934-4e86-4f47-9ef0-623566e467d1 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:22.596328 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42fac8-4a1a-4a03-9f1d-c339238b6be1 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:22.631249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bd879-9395-4736-9809-6b6dfa46e60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:22.631954 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bd879-9395-4736-9809-6b6dfa46e60e None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:22.632338 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bd879-9395-4736-9809-6b6dfa46e60e None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:22.632519 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bd879-9395-4736-9809-6b6dfa46e60e None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:22.633238 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bd879-9395-4736-9809-6b6dfa46e60e None admin] RBAC: Adding query filter params (name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:22.633820 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bd879-9395-4736-9809-6b6dfa46e60e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:22.635052 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bd879-9395-4736-9809-6b6dfa46e60e None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:22.644774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 391/788] 10.222.0.32 () {56 vars in 1103 bytes} [Tue May 10 13:48:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:22.645638 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bd879-9395-4736-9809-6b6dfa46e60e None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:22.680505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17c934-4e86-4f47-9ef0-623566e467d1 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:22.716405 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aab50-dd41-4d54-a745-516a073e1cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:22.717623 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aab50-dd41-4d54-a745-516a073e1cd4 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:22.718134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aab50-dd41-4d54-a745-516a073e1cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:22.718656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aab50-dd41-4d54-a745-516a073e1cd4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:22.727874 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75aab50-dd41-4d54-a745-516a073e1cd4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:22.729611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75aab50-dd41-4d54-a745-516a073e1cd4 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:22.745536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-f75aab50-dd41-4d54-a745-516a073e1cd4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 13:48:22.745536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:22.745536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:22.745536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:22.745536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:22.745536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:22.745536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:22.745536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:22.745536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:22.745536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:22.745536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:22.745536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:22.745536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:48:22.745536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:48:22.745536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:48:22.745536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:48:22.747457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:22.747457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:22.747457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:22.747457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:22.747457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:22.747457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:22.747457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:22.747457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:22.747457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:22.747457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:22.747457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:22.747457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:22.747457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:22.747457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:22.747457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:22.747457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:22.747457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:22.747457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:22.748401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:22.748401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:22.748401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:48:22.748401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:48:22.748401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:48:22.748401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:48:22.748401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:48:22.748401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:48:22.748401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 13:48:22.748401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:22.748934 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bd879-9395-4736-9809-6b6dfa46e60e None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:22.751271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 398/789] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:48:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:22.752460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aab50-dd41-4d54-a745-516a073e1cd4 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:22.784071 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f2817-97a2-4174-8e8a-145d1bc7f3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:22.784845 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f2817-97a2-4174-8e8a-145d1bc7f3ec None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:22.785128 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f2817-97a2-4174-8e8a-145d1bc7f3ec None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:22.785399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f2817-97a2-4174-8e8a-145d1bc7f3ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:22.786189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f2817-97a2-4174-8e8a-145d1bc7f3ec None admin] RBAC: Adding query filter params (interface=public, service_id=d9d7a80e85e1411697c68e0ba27e88e0, region_id=RegionOne) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:22.786515 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f2817-97a2-4174-8e8a-145d1bc7f3ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:22.787893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f2817-97a2-4174-8e8a-145d1bc7f3ec None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:22.794226 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 392/790] 10.222.0.32 () {56 vars in 1251 bytes} [Tue May 10 13:48:22 2022] GET /identity/v3/endpoints?service_id=d9d7a80e85e1411697c68e0ba27e88e0&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:22.795175 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f2817-97a2-4174-8e8a-145d1bc7f3ec None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:22.876460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aab50-dd41-4d54-a745-516a073e1cd4 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:22.900801 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f2817-97a2-4174-8e8a-145d1bc7f3ec None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:22.917172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a3cd2-f991-4db0-abd5-0aef7587524e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:22.918940 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a3cd2-f991-4db0-abd5-0aef7587524e None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:22.919443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a3cd2-f991-4db0-abd5-0aef7587524e None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:22.919955 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a3cd2-f991-4db0-abd5-0aef7587524e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:22.932462 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a3cd2-f991-4db0-abd5-0aef7587524e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:22.934874 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a3cd2-f991-4db0-abd5-0aef7587524e None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:22.940941 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785fe57-67bb-4a04-83ab-f165e617a651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:22.941618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785fe57-67bb-4a04-83ab-f165e617a651 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:22.941897 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785fe57-67bb-4a04-83ab-f165e617a651 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:22.942165 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785fe57-67bb-4a04-83ab-f165e617a651 None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:22.943371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785fe57-67bb-4a04-83ab-f165e617a651 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:22.943371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785fe57-67bb-4a04-83ab-f165e617a651 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:22.944721 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785fe57-67bb-4a04-83ab-f165e617a651 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:22.955039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-ad8a3cd2-f991-4db0-abd5-0aef7587524e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:22.955039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:22.955039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:22.955039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:22.955039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:22.955039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:22.955039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:22.955039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:22.955039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:22.955039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:22.955039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:22.955039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:22.955039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:22.955039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:22.955039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:22.955952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:22.955952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:22.955952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:22.955952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:22.955952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:22.955952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:22.955952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:22.955952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:22.955952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:22.955952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:22.955952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:22.955952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:22.955952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:22.955952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:22.955952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:22.955952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:22.955952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:22.956821 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:22.956821 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:22.956821 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:22.956821 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:22.959203 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 399/791] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:22.960215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a3cd2-f991-4db0-abd5-0aef7587524e None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:22.963717 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 393/792] 10.222.0.32 () {56 vars in 1135 bytes} [Tue May 10 13:48:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:22.965084 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785fe57-67bb-4a04-83ab-f165e617a651 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:23.066300 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785fe57-67bb-4a04-83ab-f165e617a651 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:23.069315 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a3cd2-f991-4db0-abd5-0aef7587524e None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:23.101081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e101d-dec2-42a2-9225-077c60390ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:23.101749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e101d-dec2-42a2-9225-077c60390ea8 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:23.102028 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e101d-dec2-42a2-9225-077c60390ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:23.102341 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e101d-dec2-42a2-9225-077c60390ea8 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:23.103053 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e101d-dec2-42a2-9225-077c60390ea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:23.103356 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e101d-dec2-42a2-9225-077c60390ea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:23.104705 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e101d-dec2-42a2-9225-077c60390ea8 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:23.107725 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac081c-773f-4ae5-aaef-216ba4fde237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:23.108514 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac081c-773f-4ae5-aaef-216ba4fde237 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:23.108801 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac081c-773f-4ae5-aaef-216ba4fde237 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:23.109075 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac081c-773f-4ae5-aaef-216ba4fde237 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:23.109765 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac081c-773f-4ae5-aaef-216ba4fde237 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:23.111152 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac081c-773f-4ae5-aaef-216ba4fde237 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:23.121858 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 394/793] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:23.122056 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 400/794] 10.222.0.32 () {56 vars in 1087 bytes} [Tue May 10 13:48:22 2022] GET /identity/v3/services => generated 772 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:23.122135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e101d-dec2-42a2-9225-077c60390ea8 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:23.122254 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b711b50-5033-4c6e-87c9-6ba0387a077d None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:23.122254 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b711b50-5033-4c6e-87c9-6ba0387a077d None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:23.122254 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b711b50-5033-4c6e-87c9-6ba0387a077d None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:23.122254 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 401/795] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:23.123393 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b711b50-5033-4c6e-87c9-6ba0387a077d None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:23.238568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b711b50-5033-4c6e-87c9-6ba0387a077d None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:23.262817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e101d-dec2-42a2-9225-077c60390ea8 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:23.279921 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bf42e-9ed4-4542-b814-1c241f3c5230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:23.280801 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bf42e-9ed4-4542-b814-1c241f3c5230 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:23.281158 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bf42e-9ed4-4542-b814-1c241f3c5230 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:23.281508 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bf42e-9ed4-4542-b814-1c241f3c5230 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:23.290608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bf42e-9ed4-4542-b814-1c241f3c5230 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:23.292254 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bf42e-9ed4-4542-b814-1c241f3c5230 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:23.307499 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a2818-ca5f-4560-8c85-35e90fcca305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:23.308881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-d72bf42e-9ed4-4542-b814-1c241f3c5230 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:48:23.308881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:23.308881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:23.308881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:23.308881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:23.308881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:23.308881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:23.308881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:23.308881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:23.308881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:23.308881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:23.308881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:23.308881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:48:23.308881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:48:23.308881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:48:23.308881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:48:23.310550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:23.310550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:23.310550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:23.310550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:23.310550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:23.310550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:23.310550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:23.310550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:23.310550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:23.310550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:23.310550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:23.310550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:23.310550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:23.310550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:23.310550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:23.310550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:23.310550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:23.310550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:23.311463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:23.311463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:23.311463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:48:23.311463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:48:23.311463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:48:23.311463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:48:23.311463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:48:23.311463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:48:23.311463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:48:23.311463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:23.311463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 402/796] 10.222.0.32 () {56 vars in 1117 bytes} [Tue May 10 13:48:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:23.312445 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a2818-ca5f-4560-8c85-35e90fcca305 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:23.312912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a2818-ca5f-4560-8c85-35e90fcca305 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:23.313352 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a2818-ca5f-4560-8c85-35e90fcca305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:23.317207 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e434c28-b2e8-4c73-970a-0d9882778e28 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:23.317571 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e434c28-b2e8-4c73-970a-0d9882778e28 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:23.317924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e434c28-b2e8-4c73-970a-0d9882778e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:23.331151 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a2818-ca5f-4560-8c85-35e90fcca305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:23.333148 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a2818-ca5f-4560-8c85-35e90fcca305 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:23.339033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-9e434c28-b2e8-4c73-970a-0d9882778e28 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:23.340251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-9e434c28-b2e8-4c73-970a-0d9882778e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:23.354000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-348a2818-ca5f-4560-8c85-35e90fcca305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:23.354000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:23.354000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:23.354000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:23.354000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:23.354000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:23.354000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:23.354000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:23.354000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:23.354000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:23.354000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:23.354000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:23.354000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:23.354000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:23.354000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:23.355208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:23.355208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:23.355208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:23.355208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:23.355208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:23.355208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:23.355208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:23.355208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:23.355208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:23.355208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:23.355208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:23.355208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:23.355208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:23.355208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:23.355208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:23.355208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:23.355208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:23.356577 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:23.356577 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:23.356577 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:23.356577 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:23.359613 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 395/797] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:23.361234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a2818-ca5f-4560-8c85-35e90fcca305 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:23.415986 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 403/798] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:23.417083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e434c28-b2e8-4c73-970a-0d9882778e28 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:23.503451 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a2818-ca5f-4560-8c85-35e90fcca305 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:23.518317 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e434c28-b2e8-4c73-970a-0d9882778e28 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:23.545355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0e7d7-7dfa-4fc2-b0dd-76f09b3f80c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:23.546034 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0e7d7-7dfa-4fc2-b0dd-76f09b3f80c7 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:23.546349 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0e7d7-7dfa-4fc2-b0dd-76f09b3f80c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:23.546622 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0e7d7-7dfa-4fc2-b0dd-76f09b3f80c7 None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:23.547475 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0e7d7-7dfa-4fc2-b0dd-76f09b3f80c7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:23.547779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0e7d7-7dfa-4fc2-b0dd-76f09b3f80c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:23.549226 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0e7d7-7dfa-4fc2-b0dd-76f09b3f80c7 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:23.554941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c6b98-efe7-4d26-9b05-f10ec7b26230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:23.555613 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c6b98-efe7-4d26-9b05-f10ec7b26230 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:23.555896 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c6b98-efe7-4d26-9b05-f10ec7b26230 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:23.556163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c6b98-efe7-4d26-9b05-f10ec7b26230 None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:23.556889 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c6b98-efe7-4d26-9b05-f10ec7b26230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:23.557191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c6b98-efe7-4d26-9b05-f10ec7b26230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:23.558589 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c6b98-efe7-4d26-9b05-f10ec7b26230 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:23.570002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 396/799] 10.222.0.32 () {56 vars in 1149 bytes} [Tue May 10 13:48:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:23.570962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0e7d7-7dfa-4fc2-b0dd-76f09b3f80c7 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:23.572592 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 404/800] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:23.576524 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c6b98-efe7-4d26-9b05-f10ec7b26230 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:23.683699 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0e7d7-7dfa-4fc2-b0dd-76f09b3f80c7 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:23.705955 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c6b98-efe7-4d26-9b05-f10ec7b26230 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:23.725107 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957548f-e5a3-4936-a717-414fe1591794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:23.725916 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957548f-e5a3-4936-a717-414fe1591794 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:23.726231 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957548f-e5a3-4936-a717-414fe1591794 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:23.726499 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957548f-e5a3-4936-a717-414fe1591794 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:23.738949 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957548f-e5a3-4936-a717-414fe1591794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:23.747349 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c03ee-ec22-47b6-8a9d-d1eb5eb77d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:23.747636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-e957548f-e5a3-4936-a717-414fe1591794 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:23.747636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:23.747636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:23.747636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:23.747636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:23.747636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:23.747636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:23.747636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:23.747636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:23.747636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:23.747636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:23.747636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:23.747636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:23.747636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:23.747636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:23.747636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:23.748817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:23.748817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:23.748817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:23.748817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:23.748817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:23.748817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:23.748817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:23.748817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:23.748817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:23.748817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:23.748817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:23.748817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:23.748817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:23.748817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:23.748817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:23.748817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:23.749697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:23.749697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:23.749697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:23.749697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:23.749697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:23.749697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:23.749697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:23.749697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:23.749697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:23.749697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:23.749697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:23.749697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:23.750373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c03ee-ec22-47b6-8a9d-d1eb5eb77d40 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:23.750373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c03ee-ec22-47b6-8a9d-d1eb5eb77d40 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:23.750373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c03ee-ec22-47b6-8a9d-d1eb5eb77d40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:23.753946 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 397/801] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:48:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:23.754967 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957548f-e5a3-4936-a717-414fe1591794 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:23.764850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c03ee-ec22-47b6-8a9d-d1eb5eb77d40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:23.766389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c03ee-ec22-47b6-8a9d-d1eb5eb77d40 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:23.785009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-148c03ee-ec22-47b6-8a9d-d1eb5eb77d40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:23.785009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:23.785009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:23.785009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:23.785009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:23.785009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:23.785009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:23.785009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:23.785009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:23.785009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:23.785009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:23.785009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:23.785009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:23.785009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:23.785009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:23.786142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:23.786142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:23.786142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:23.786142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:23.786142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:23.786142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:23.786142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:23.786142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:23.786142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:23.786142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:23.786142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:23.786142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:23.786142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:23.786142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:23.786142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:23.786142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:23.786142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:23.787312 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:23.787312 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:23.787312 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:23.787312 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:23.787312 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 405/802] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:23.787593 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b6918-b9f4-4355-ad1f-c58cd54854cf None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:23.787813 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b6918-b9f4-4355-ad1f-c58cd54854cf None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:23.788058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b6918-b9f4-4355-ad1f-c58cd54854cf None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:23.789443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 406/803] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:23.790006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b6918-b9f4-4355-ad1f-c58cd54854cf None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:23.872409 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957548f-e5a3-4936-a717-414fe1591794 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:23.907772 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b6918-b9f4-4355-ad1f-c58cd54854cf None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:23.908864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752dea7-4cee-4601-bf2b-97d164c70a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:23.909702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752dea7-4cee-4601-bf2b-97d164c70a61 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:23.910823 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752dea7-4cee-4601-bf2b-97d164c70a61 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:23.910823 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752dea7-4cee-4601-bf2b-97d164c70a61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:23.917445 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752dea7-4cee-4601-bf2b-97d164c70a61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:23.919691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752dea7-4cee-4601-bf2b-97d164c70a61 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:23.934570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-4752dea7-4cee-4601-bf2b-97d164c70a61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:23.934570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:23.934570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:23.934570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:23.934570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:23.934570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:23.934570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:23.934570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:23.934570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:23.934570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:23.934570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:23.934570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:23.934570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:23.934570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:23.934570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:23.935912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:23.935912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:23.935912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:23.935912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:23.935912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:23.935912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:23.935912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:23.935912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:23.935912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:23.935912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:23.935912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:23.935912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:23.935912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:23.935912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:23.935912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:23.935912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:23.935912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:23.936787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:23.936787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:23.936787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:23.936787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:23.936787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:23.936787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:23.936787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:23.936787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:23.936787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 398/804] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:23.936787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752dea7-4cee-4601-bf2b-97d164c70a61 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:23.947349 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09789697-f2d4-4257-8c5c-72fbe0050815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:23.948290 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09789697-f2d4-4257-8c5c-72fbe0050815 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:23.948721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09789697-f2d4-4257-8c5c-72fbe0050815 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:23.949158 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09789697-f2d4-4257-8c5c-72fbe0050815 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:23.950350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09789697-f2d4-4257-8c5c-72fbe0050815 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:23.950902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09789697-f2d4-4257-8c5c-72fbe0050815 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:23.952358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09789697-f2d4-4257-8c5c-72fbe0050815 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:23.967118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 407/805] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:48:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:23.967118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c273d9-5345-4b36-997e-597a833cd45c None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:23.967118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c273d9-5345-4b36-997e-597a833cd45c None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:23.967118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c273d9-5345-4b36-997e-597a833cd45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:23.980603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-99c273d9-5345-4b36-997e-597a833cd45c None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:23.983099 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-99c273d9-5345-4b36-997e-597a833cd45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:24.056997 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 408/806] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:24.057833 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752dea7-4cee-4601-bf2b-97d164c70a61 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:24.058447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c273d9-5345-4b36-997e-597a833cd45c None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:24.096287 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67939c9-074f-4bf2-bcc3-b2b781b9ec23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:24.096957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67939c9-074f-4bf2-bcc3-b2b781b9ec23 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:24.097232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67939c9-074f-4bf2-bcc3-b2b781b9ec23 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:24.097513 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67939c9-074f-4bf2-bcc3-b2b781b9ec23 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:24.098268 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67939c9-074f-4bf2-bcc3-b2b781b9ec23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:24.098577 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67939c9-074f-4bf2-bcc3-b2b781b9ec23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:24.099975 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67939c9-074f-4bf2-bcc3-b2b781b9ec23 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:24.113499 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 399/807] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:24.114612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67939c9-074f-4bf2-bcc3-b2b781b9ec23 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:24.190838 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c273d9-5345-4b36-997e-597a833cd45c None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:24.222696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67939c9-074f-4bf2-bcc3-b2b781b9ec23 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:24.233330 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6db7d-821d-4941-a239-69b5d0ba82b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:24.233933 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6db7d-821d-4941-a239-69b5d0ba82b0 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:24.234279 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6db7d-821d-4941-a239-69b5d0ba82b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:24.234526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6db7d-821d-4941-a239-69b5d0ba82b0 None admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:24.235369 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6db7d-821d-4941-a239-69b5d0ba82b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:24.235634 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6db7d-821d-4941-a239-69b5d0ba82b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:24.237096 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6db7d-821d-4941-a239-69b5d0ba82b0 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:24.255305 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 409/808] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:48:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:24.255305 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6db7d-821d-4941-a239-69b5d0ba82b0 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:24.260792 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365ebf0-4480-4ef4-ab01-76588b0aac6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:24.261598 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365ebf0-4480-4ef4-ab01-76588b0aac6f None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:24.261878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365ebf0-4480-4ef4-ab01-76588b0aac6f None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:24.262738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365ebf0-4480-4ef4-ab01-76588b0aac6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:24.274271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365ebf0-4480-4ef4-ab01-76588b0aac6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:24.275733 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365ebf0-4480-4ef4-ab01-76588b0aac6f None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:24.296881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-6365ebf0-4480-4ef4-ab01-76588b0aac6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:24.296881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:24.296881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:24.296881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:24.296881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:24.296881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:24.296881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:24.296881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:24.296881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:24.296881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:24.296881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:24.296881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:24.296881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:24.296881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:24.296881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:24.298075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:24.298075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:24.298075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:24.298075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:24.298075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:24.298075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:24.298075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:24.298075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:24.298075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:24.298075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:24.298075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:24.298075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:24.298075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:24.298075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:24.298075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:24.298075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:24.298075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:24.299662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:24.299662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:24.299662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:24.299662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:24.299662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 400/809] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:24.299662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365ebf0-4480-4ef4-ab01-76588b0aac6f None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:24.371099 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6db7d-821d-4941-a239-69b5d0ba82b0 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:24.410476 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329cddd-1548-4ded-8ea2-ea31bd747da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:24.410726 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365ebf0-4480-4ef4-ab01-76588b0aac6f None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:24.411312 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329cddd-1548-4ded-8ea2-ea31bd747da4 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:24.411603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329cddd-1548-4ded-8ea2-ea31bd747da4 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:24.412076 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329cddd-1548-4ded-8ea2-ea31bd747da4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:24.412949 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329cddd-1548-4ded-8ea2-ea31bd747da4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:24.414368 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329cddd-1548-4ded-8ea2-ea31bd747da4 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:24.427251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-f329cddd-1548-4ded-8ea2-ea31bd747da4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 13:48:24.427251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:24.427251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:48:24.427251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:48:24.427251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:48:24.427251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:48:24.427251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:48:24.427251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:24.427251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 13:48:24.427251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:24.427251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:24.427251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:24.427251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:24.427251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:24.427251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:24.427251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:24.428399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:24.428399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:24.428399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:24.428399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:24.428399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:24.428399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:24.428399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:24.428399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:48:24.428399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:48:24.428399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:48:24.428399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:48:24.428399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:24.428399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:24.428399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:24.428399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:24.428399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:24.429270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:24.429270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:24.429270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:24.429270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:24.429270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:24.429270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:24.429270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:24.429270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:24.429270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:24.429270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:24.429270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:24.429270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:48:24.429270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:24.429270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 13:48:24.429270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:24.434543 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 410/810] 10.222.0.32 () {56 vars in 1129 bytes} [Tue May 10 13:48:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:24.436016 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329cddd-1548-4ded-8ea2-ea31bd747da4 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:24.457506 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab09373-9f76-4c7e-a74c-aae9c5344031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:24.458355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab09373-9f76-4c7e-a74c-aae9c5344031 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:24.458634 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab09373-9f76-4c7e-a74c-aae9c5344031 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:24.458900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab09373-9f76-4c7e-a74c-aae9c5344031 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:24.467191 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab09373-9f76-4c7e-a74c-aae9c5344031 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:24.468643 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab09373-9f76-4c7e-a74c-aae9c5344031 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:24.483893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-aab09373-9f76-4c7e-a74c-aae9c5344031 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:24.483893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:24.483893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:24.483893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:24.483893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:24.483893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:24.483893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:24.483893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:24.483893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:24.483893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:24.483893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:24.483893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:24.483893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:24.483893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:24.483893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:24.485821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:24.485821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:24.485821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:24.485821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:24.485821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:24.485821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:24.485821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:24.485821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:24.485821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:24.485821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:24.485821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:24.485821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:24.485821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:24.485821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:24.485821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:24.485821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:24.485821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:24.487781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:24.487781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:24.487781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:24.487781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:24.487781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:24.487781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:24.487781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:24.487781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:24.487781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 401/811] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:24.487781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab09373-9f76-4c7e-a74c-aae9c5344031 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:24.547301 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329cddd-1548-4ded-8ea2-ea31bd747da4 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:24.589464 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417485a-d425-4f7d-9e9b-162e71f1f064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:24.590427 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417485a-d425-4f7d-9e9b-162e71f1f064 None admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:24.590757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417485a-d425-4f7d-9e9b-162e71f1f064 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:24.590990 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417485a-d425-4f7d-9e9b-162e71f1f064 None admin] PATH_INFO: `/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/47bbad5318b6417087d7ce6906f8281f/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:24.593020 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417485a-d425-4f7d-9e9b-162e71f1f064 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1cda14bca5c497dba2d18685dfe6cc2, user_id=47bbad5318b6417087d7ce6906f8281f, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:24.594503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417485a-d425-4f7d-9e9b-162e71f1f064 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:24.618233 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 411/812] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:48:24 2022] PUT /identity/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/47bbad5318b6417087d7ce6906f8281f/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:48:24.618233 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417485a-d425-4f7d-9e9b-162e71f1f064 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:24.636805 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab09373-9f76-4c7e-a74c-aae9c5344031 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:24.675340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c00988-e228-439c-9511-25350eda5443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:24.676169 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c00988-e228-439c-9511-25350eda5443 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:24.676553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c00988-e228-439c-9511-25350eda5443 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:24.676927 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c00988-e228-439c-9511-25350eda5443 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:24.677764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c00988-e228-439c-9511-25350eda5443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:24.678173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c00988-e228-439c-9511-25350eda5443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:24.679703 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c00988-e228-439c-9511-25350eda5443 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:24.697488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 402/813] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:24.697488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c00988-e228-439c-9511-25350eda5443 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:24.748402 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417485a-d425-4f7d-9e9b-162e71f1f064 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:24.797551 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26674600-2c08-411f-8968-5c41c7959923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:24.798447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26674600-2c08-411f-8968-5c41c7959923 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:24.798841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26674600-2c08-411f-8968-5c41c7959923 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:24.799207 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26674600-2c08-411f-8968-5c41c7959923 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:24.800051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26674600-2c08-411f-8968-5c41c7959923 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:24.800462 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26674600-2c08-411f-8968-5c41c7959923 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:24.802273 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26674600-2c08-411f-8968-5c41c7959923 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:24.808878 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 412/814] 10.222.0.32 () {56 vars in 1124 bytes} [Tue May 10 13:48:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:24.810753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26674600-2c08-411f-8968-5c41c7959923 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:24.812954 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c00988-e228-439c-9511-25350eda5443 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:24.862238 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e915e4e-beef-4864-b964-5d6ea12f78d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:24.863149 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e915e4e-beef-4864-b964-5d6ea12f78d8 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:24.863615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e915e4e-beef-4864-b964-5d6ea12f78d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:24.864075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e915e4e-beef-4864-b964-5d6ea12f78d8 None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:24.865066 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e915e4e-beef-4864-b964-5d6ea12f78d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:24.865369 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e915e4e-beef-4864-b964-5d6ea12f78d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:24.866883 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e915e4e-beef-4864-b964-5d6ea12f78d8 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:24.886665 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 403/815] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:48:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:24.888313 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e915e4e-beef-4864-b964-5d6ea12f78d8 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:24.978388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26674600-2c08-411f-8968-5c41c7959923 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:25.001478 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e915e4e-beef-4864-b964-5d6ea12f78d8 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:25.022181 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303ac69-7763-44cd-9696-c8df580269a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:25.023017 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303ac69-7763-44cd-9696-c8df580269a5 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:25.023304 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303ac69-7763-44cd-9696-c8df580269a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:25.023582 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303ac69-7763-44cd-9696-c8df580269a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:25.034446 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303ac69-7763-44cd-9696-c8df580269a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:25.036594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303ac69-7763-44cd-9696-c8df580269a5 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:25.040132 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60843f74-1b92-4fd5-9954-f2e0300c67e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:25.040894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60843f74-1b92-4fd5-9954-f2e0300c67e9 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:25.041247 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60843f74-1b92-4fd5-9954-f2e0300c67e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:25.041595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60843f74-1b92-4fd5-9954-f2e0300c67e9 None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:25.042446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60843f74-1b92-4fd5-9954-f2e0300c67e9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:25.042823 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60843f74-1b92-4fd5-9954-f2e0300c67e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:25.045097 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60843f74-1b92-4fd5-9954-f2e0300c67e9 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:25.050819 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 404/816] 10.222.0.32 () {56 vars in 1124 bytes} [Tue May 10 13:48:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:25.051706 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60843f74-1b92-4fd5-9954-f2e0300c67e9 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:25.053802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-d303ac69-7763-44cd-9696-c8df580269a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 13:48:25.053802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:25.053802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:25.053802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:25.053802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:25.053802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:25.053802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:25.053802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:25.053802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:25.053802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:25.053802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:25.053802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:25.053802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:48:25.053802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:48:25.053802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:48:25.053802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:48:25.054850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:25.054850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:25.054850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:25.054850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:25.054850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:25.054850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:25.054850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:25.054850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:25.054850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:25.054850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:25.054850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:25.054850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:25.054850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:25.054850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:25.054850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:25.054850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:25.054850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:25.054850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:25.056040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:25.056040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:25.056040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:48:25.056040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:48:25.056040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:48:25.056040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:48:25.056040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:48:25.056040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:48:25.056040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 13:48:25.056040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:25.061984 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 413/817] 10.222.0.32 () {56 vars in 1093 bytes} [Tue May 10 13:48:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:25.063135 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303ac69-7763-44cd-9696-c8df580269a5 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:25.186942 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60843f74-1b92-4fd5-9954-f2e0300c67e9 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:25.195310 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303ac69-7763-44cd-9696-c8df580269a5 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:25.231675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548e415-e2bc-49d0-aa3b-ec7ed0b77bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:25.232927 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548e415-e2bc-49d0-aa3b-ec7ed0b77bb3 None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:25.232927 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548e415-e2bc-49d0-aa3b-ec7ed0b77bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:25.233231 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548e415-e2bc-49d0-aa3b-ec7ed0b77bb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:25.233390 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024791f-dc44-4b26-a73c-281f9bd9df32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:25.236543 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548e415-e2bc-49d0-aa3b-ec7ed0b77bb3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:25.236827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024791f-dc44-4b26-a73c-281f9bd9df32 None admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:25.236827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024791f-dc44-4b26-a73c-281f9bd9df32 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:25.237132 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548e415-e2bc-49d0-aa3b-ec7ed0b77bb3 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:25.237384 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024791f-dc44-4b26-a73c-281f9bd9df32 None admin] PATH_INFO: `/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/686c869be43c40a9b63b3647bf689c7a/roles/567077e602b043f8b81abc208831228a` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:25.257659 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024791f-dc44-4b26-a73c-281f9bd9df32 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1cda14bca5c497dba2d18685dfe6cc2, user_id=686c869be43c40a9b63b3647bf689c7a, role_id=567077e602b043f8b81abc208831228a)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:25.259170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024791f-dc44-4b26-a73c-281f9bd9df32 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:25.260198 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 414/818] 10.222.0.32 () {60 vars in 1144 bytes} [Tue May 10 13:48:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:48:25.261133 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548e415-e2bc-49d0-aa3b-ec7ed0b77bb3 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:25.287913 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 405/819] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:48:25 2022] PUT /identity/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/686c869be43c40a9b63b3647bf689c7a/roles/567077e602b043f8b81abc208831228a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:48:25.423229 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548e415-e2bc-49d0-aa3b-ec7ed0b77bb3 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:25.462735 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cb327-f131-4df6-8677-2ac127e06171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:25.463358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cb327-f131-4df6-8677-2ac127e06171 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:25.463646 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cb327-f131-4df6-8677-2ac127e06171 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:25.463985 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cb327-f131-4df6-8677-2ac127e06171 None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:25.464868 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cb327-f131-4df6-8677-2ac127e06171 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:25.465762 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cb327-f131-4df6-8677-2ac127e06171 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:25.467303 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cb327-f131-4df6-8677-2ac127e06171 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:25.495717 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 415/820] 10.222.0.32 () {56 vars in 1133 bytes} [Tue May 10 13:48:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:25.501215 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024791f-dc44-4b26-a73c-281f9bd9df32 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:25.517965 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16bf6f-d7ca-4bf8-8a91-8fbabab56287 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:25.518354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16bf6f-d7ca-4bf8-8a91-8fbabab56287 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:25.520149 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16bf6f-d7ca-4bf8-8a91-8fbabab56287 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:25.521544 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 416/821] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:25.539952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e5e85-ef3c-419e-b853-5eb7daa17a62 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:25.540285 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e5e85-ef3c-419e-b853-5eb7daa17a62 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:25.540502 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e5e85-ef3c-419e-b853-5eb7daa17a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:25.575973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-b39e5e85-ef3c-419e-b853-5eb7daa17a62 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:25.577270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-b39e5e85-ef3c-419e-b853-5eb7daa17a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:25.689543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024791f-dc44-4b26-a73c-281f9bd9df32 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:25.690755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 417/822] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:25.721369 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e5e85-ef3c-419e-b853-5eb7daa17a62 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:25.757607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2cdc0-be6b-4951-baa0-28a6bf9295fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:25.759170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2cdc0-be6b-4951-baa0-28a6bf9295fc None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:25.759944 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2cdc0-be6b-4951-baa0-28a6bf9295fc None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:25.760901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2cdc0-be6b-4951-baa0-28a6bf9295fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:25.911167 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2cdc0-be6b-4951-baa0-28a6bf9295fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:25.912747 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2cdc0-be6b-4951-baa0-28a6bf9295fc None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:26.002366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e5e85-ef3c-419e-b853-5eb7daa17a62 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:26.088126 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 406/823] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:48:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:48:26.090910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebbdb7-dbff-40ca-afc8-b7060daa6a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:26.092063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebbdb7-dbff-40ca-afc8-b7060daa6a1f None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:26.092676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebbdb7-dbff-40ca-afc8-b7060daa6a1f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:26.092676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebbdb7-dbff-40ca-afc8-b7060daa6a1f None admin] PATH_INFO: `/v3/services/network` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:26.093366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebbdb7-dbff-40ca-afc8-b7060daa6a1f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:26.093633 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2cdc0-be6b-4951-baa0-28a6bf9295fc None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:26.096205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebbdb7-dbff-40ca-afc8-b7060daa6a1f None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:26.119617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-18ebbdb7-dbff-40ca-afc8-b7060daa6a1f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 13:48:26.119617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:26.119617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:48:26.119617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:48:26.119617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:48:26.119617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:48:26.119617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:48:26.119617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:26.119617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 13:48:26.119617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:26.119617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:26.119617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:26.119617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:26.119617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:26.119617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:26.119617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:26.119617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:26.127392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:26.127392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:26.127392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:26.127392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:26.127392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:26.127392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:26.127392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:48:26.127392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:48:26.127392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:48:26.127392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:48:26.127392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:26.127392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:26.127392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:26.127392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:26.127392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:26.127392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:26.129721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:26.129721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:26.129721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:26.129721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:26.129721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:26.129721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:26.129721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:26.129721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:26.129721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:26.129721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:26.129721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:48:26.129721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:26.129721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 13:48:26.129721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:26.129721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 418/824] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:25 2022] GET /identity/v3/services/network => generated 88 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:26.138934 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebbdb7-dbff-40ca-afc8-b7060daa6a1f None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:26.220777 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2cdc0-be6b-4951-baa0-28a6bf9295fc None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:26.261681 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a942b-8fa9-4988-9009-a1d43202a5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:26.263146 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a942b-8fa9-4988-9009-a1d43202a5af None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:26.265279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a942b-8fa9-4988-9009-a1d43202a5af None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:26.265553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a942b-8fa9-4988-9009-a1d43202a5af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:26.287820 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a942b-8fa9-4988-9009-a1d43202a5af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:26.290146 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a942b-8fa9-4988-9009-a1d43202a5af None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:26.320150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-282a942b-8fa9-4988-9009-a1d43202a5af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:26.320150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:26.320150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:26.320150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:26.320150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:26.320150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:26.320150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:26.320150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:26.320150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:26.320150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:26.320150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:26.320150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:26.320150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:26.320150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:26.320150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:26.322267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:26.322267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:26.322267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:26.322267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:26.322267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:26.322267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:26.322267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:26.322267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:26.322267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:26.322267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:26.322267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:26.322267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:26.322267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:26.322267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:26.322267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:26.322267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:26.322267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:26.324536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:26.324536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:26.324536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:26.324536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:26.330093 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 407/825] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:26.333683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a942b-8fa9-4988-9009-a1d43202a5af None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:26.370434 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebbdb7-dbff-40ca-afc8-b7060daa6a1f None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:26.433836 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15c7ab-bbda-4e93-854e-10afae419bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:26.436454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15c7ab-bbda-4e93-854e-10afae419bd5 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:26.436965 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15c7ab-bbda-4e93-854e-10afae419bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:26.437253 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15c7ab-bbda-4e93-854e-10afae419bd5 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:26.438032 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15c7ab-bbda-4e93-854e-10afae419bd5 None admin] RBAC: Adding query filter params (name=network) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:26.438388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15c7ab-bbda-4e93-854e-10afae419bd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:26.439851 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15c7ab-bbda-4e93-854e-10afae419bd5 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:26.458127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 419/826] 10.222.0.32 () {56 vars in 1112 bytes} [Tue May 10 13:48:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:26.459239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15c7ab-bbda-4e93-854e-10afae419bd5 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:26.531444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a942b-8fa9-4988-9009-a1d43202a5af None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:26.604178 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15c7ab-bbda-4e93-854e-10afae419bd5 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:26.618929 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ff9fe-6094-44e6-b969-57d5c4c3cb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:26.619610 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ff9fe-6094-44e6-b969-57d5c4c3cb1d None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:26.619892 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ff9fe-6094-44e6-b969-57d5c4c3cb1d None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:26.620168 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ff9fe-6094-44e6-b969-57d5c4c3cb1d None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:26.620903 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ff9fe-6094-44e6-b969-57d5c4c3cb1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:26.621203 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ff9fe-6094-44e6-b969-57d5c4c3cb1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:26.623260 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ff9fe-6094-44e6-b969-57d5c4c3cb1d None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:26.647742 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea84ef9-85fd-4b77-b0d6-24e053851fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:26.648418 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea84ef9-85fd-4b77-b0d6-24e053851fa8 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:26.648696 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea84ef9-85fd-4b77-b0d6-24e053851fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:26.648966 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea84ef9-85fd-4b77-b0d6-24e053851fa8 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:26.649683 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea84ef9-85fd-4b77-b0d6-24e053851fa8 None admin] RBAC: Adding query filter params (type=network) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:26.649983 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea84ef9-85fd-4b77-b0d6-24e053851fa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:26.651391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea84ef9-85fd-4b77-b0d6-24e053851fa8 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:26.652287 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 408/827] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:26.653525 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ff9fe-6094-44e6-b969-57d5c4c3cb1d None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:26.666501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 420/828] 10.222.0.32 () {56 vars in 1112 bytes} [Tue May 10 13:48:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:26.673102 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea84ef9-85fd-4b77-b0d6-24e053851fa8 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:26.814828 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ff9fe-6094-44e6-b969-57d5c4c3cb1d None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:26.873099 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7374d-476e-4beb-ad00-886f02ef5169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:26.873911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7374d-476e-4beb-ad00-886f02ef5169 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:26.874189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7374d-476e-4beb-ad00-886f02ef5169 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:26.874463 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7374d-476e-4beb-ad00-886f02ef5169 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:26.885139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7374d-476e-4beb-ad00-886f02ef5169 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:26.885139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7374d-476e-4beb-ad00-886f02ef5169 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:26.912981 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea84ef9-85fd-4b77-b0d6-24e053851fa8 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:26.916707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-4cc7374d-476e-4beb-ad00-886f02ef5169 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:26.916707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:26.916707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:26.916707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:26.916707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:26.916707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:26.916707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:26.916707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:26.916707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:26.916707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:26.916707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:26.916707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:26.916707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:26.916707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:26.916707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:26.917611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:26.917611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:26.917611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:26.917611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:26.917611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:26.917611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:26.917611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:26.917611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:26.917611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:26.917611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:26.917611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:26.917611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:26.917611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:26.917611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:26.917611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:26.917611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:26.917611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:26.918587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:26.918587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:26.918587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:26.918587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:26.918587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:26.918587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:26.918587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:26.918587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:26.928561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 409/829] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:26.938314 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7374d-476e-4beb-ad00-886f02ef5169 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:26.999044 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980f8e7-eb6d-424f-8ff0-c84fee7cbf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:27.000067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980f8e7-eb6d-424f-8ff0-c84fee7cbf39 None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:27.000532 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980f8e7-eb6d-424f-8ff0-c84fee7cbf39 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:27.000980 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980f8e7-eb6d-424f-8ff0-c84fee7cbf39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:27.001935 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980f8e7-eb6d-424f-8ff0-c84fee7cbf39 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:27.003533 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980f8e7-eb6d-424f-8ff0-c84fee7cbf39 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:27.056145 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 421/830] 10.222.0.32 () {60 vars in 1144 bytes} [Tue May 10 13:48:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:48:27.057159 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7374d-476e-4beb-ad00-886f02ef5169 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:27.125124 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997add01-a3bf-4f19-9c06-1d7ed91bd9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:27.125811 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997add01-a3bf-4f19-9c06-1d7ed91bd9f7 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:27.126335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997add01-a3bf-4f19-9c06-1d7ed91bd9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:27.127606 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997add01-a3bf-4f19-9c06-1d7ed91bd9f7 None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:27.128599 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997add01-a3bf-4f19-9c06-1d7ed91bd9f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:27.128916 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997add01-a3bf-4f19-9c06-1d7ed91bd9f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:27.130587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997add01-a3bf-4f19-9c06-1d7ed91bd9f7 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:27.150725 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 410/831] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:48:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:27.157259 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980f8e7-eb6d-424f-8ff0-c84fee7cbf39 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:27.302074 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980f8e7-eb6d-424f-8ff0-c84fee7cbf39 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:27.343777 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45061ac1-fa4e-4886-a320-2d6890e0a8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:27.344844 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45061ac1-fa4e-4886-a320-2d6890e0a8c3 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:27.345335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45061ac1-fa4e-4886-a320-2d6890e0a8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:27.345811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45061ac1-fa4e-4886-a320-2d6890e0a8c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:27.346919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45061ac1-fa4e-4886-a320-2d6890e0a8c3 None admin] RBAC: Adding query filter params (role.id=17e40821fc444dd0b040dcfce3eb222b, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=e5d4fd26c21f4170a6790369344f8334) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:27.347506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45061ac1-fa4e-4886-a320-2d6890e0a8c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:27.349205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45061ac1-fa4e-4886-a320-2d6890e0a8c3 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:27.357752 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 422/832] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:48:27 2022] GET /identity/v3/role_assignments?user.id=e5d4fd26c21f4170a6790369344f8334&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=17e40821fc444dd0b040dcfce3eb222b => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:27.568963 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d58d57-563d-45a6-86f0-448a484f384b None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:27.569462 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d58d57-563d-45a6-86f0-448a484f384b None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:27.569462 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d58d57-563d-45a6-86f0-448a484f384b None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:27.571248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 411/833] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:27.577989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e4284-3472-4d66-89d9-75be59016e3f None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:27.578948 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e4284-3472-4d66-89d9-75be59016e3f None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:27.579428 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e4284-3472-4d66-89d9-75be59016e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:27.600706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-037e4284-3472-4d66-89d9-75be59016e3f None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:27.602169 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-037e4284-3472-4d66-89d9-75be59016e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:27.689726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 423/834] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:27.713724 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d58d57-563d-45a6-86f0-448a484f384b None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:27.823562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d58d57-563d-45a6-86f0-448a484f384b None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:27.872693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3064b-0bc3-43c5-a30a-76ed25f1e46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:27.873509 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3064b-0bc3-43c5-a30a-76ed25f1e46b None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:27.873785 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3064b-0bc3-43c5-a30a-76ed25f1e46b None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:27.874052 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3064b-0bc3-43c5-a30a-76ed25f1e46b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:27.887338 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3064b-0bc3-43c5-a30a-76ed25f1e46b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:27.895309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-6da3064b-0bc3-43c5-a30a-76ed25f1e46b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:27.895309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:27.895309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:27.895309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:27.895309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:27.895309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:27.895309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:27.895309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:27.895309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:27.895309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:27.895309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:27.895309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:27.895309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:27.895309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:27.895309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:27.895309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:27.896310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:27.896310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:27.896310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:27.896310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:27.896310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:27.896310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:27.896310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:27.896310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:27.896310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:27.896310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:27.896310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:27.896310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:27.896310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:27.896310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:27.896310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:27.896310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:27.897160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:27.897160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:27.897160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:27.897160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:27.897160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:27.897160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:27.897160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:27.897160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:27.897160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:27.897160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:27.897160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:27.897160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:27.897160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 412/835] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:48:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:27.905619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e4284-3472-4d66-89d9-75be59016e3f None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:28.021915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e4284-3472-4d66-89d9-75be59016e3f None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:28.061312 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b74a4e-2f10-4ad0-88ab-1b643680689f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:28.062100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b74a4e-2f10-4ad0-88ab-1b643680689f None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:28.062596 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b74a4e-2f10-4ad0-88ab-1b643680689f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:28.063085 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b74a4e-2f10-4ad0-88ab-1b643680689f None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:28.064069 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b74a4e-2f10-4ad0-88ab-1b643680689f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:28.064579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b74a4e-2f10-4ad0-88ab-1b643680689f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:28.066344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b74a4e-2f10-4ad0-88ab-1b643680689f None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:28.078648 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 424/836] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:48:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:28.084367 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3064b-0bc3-43c5-a30a-76ed25f1e46b None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:28.088087 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2a38d-fde9-4fc7-b20b-0c707f30fbc1 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:28.088609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2a38d-fde9-4fc7-b20b-0c707f30fbc1 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:28.089061 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2a38d-fde9-4fc7-b20b-0c707f30fbc1 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:28.091340 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 425/837] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:28.097302 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4823f-9f88-4cbe-a641-dcfa8ab504f3 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:28.097899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4823f-9f88-4cbe-a641-dcfa8ab504f3 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:28.098416 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4823f-9f88-4cbe-a641-dcfa8ab504f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:28.119100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-24b4823f-9f88-4cbe-a641-dcfa8ab504f3 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:28.120319 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-24b4823f-9f88-4cbe-a641-dcfa8ab504f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:28.198040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 426/838] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:48:28.199508 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845ab81-a71d-487c-bb0d-0821a1845f0a None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:28.199830 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845ab81-a71d-487c-bb0d-0821a1845f0a None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:28.200321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845ab81-a71d-487c-bb0d-0821a1845f0a None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:28.201856 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 427/839] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:28.206462 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3064b-0bc3-43c5-a30a-76ed25f1e46b None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:28.207369 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2009a00-b6d7-4e33-ac70-207ff999e42c None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:28.207659 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2009a00-b6d7-4e33-ac70-207ff999e42c None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:28.207940 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2009a00-b6d7-4e33-ac70-207ff999e42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:28.229154 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-b2009a00-b6d7-4e33-ac70-207ff999e42c None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:28.230632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-b2009a00-b6d7-4e33-ac70-207ff999e42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:28.249594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea955e1-8ec3-416e-858a-61921dd83a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:28.250496 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea955e1-8ec3-416e-858a-61921dd83a0b None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:28.250496 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea955e1-8ec3-416e-858a-61921dd83a0b None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:28.250496 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea955e1-8ec3-416e-858a-61921dd83a0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:28.261751 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea955e1-8ec3-416e-858a-61921dd83a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:28.263648 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea955e1-8ec3-416e-858a-61921dd83a0b None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:28.284707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-1ea955e1-8ec3-416e-858a-61921dd83a0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:28.284707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:28.284707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:28.284707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:28.284707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:28.284707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:28.284707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:28.284707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:28.284707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:28.284707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:28.284707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:28.284707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:28.284707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:28.284707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:28.284707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:28.285813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:28.285813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:28.285813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:28.285813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:28.285813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:28.285813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:28.285813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:28.285813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:28.285813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:28.285813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:28.285813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:28.285813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:28.285813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:28.285813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:28.285813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:28.285813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:28.285813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:28.287873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:28.287873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:28.287873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:28.287873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:28.287873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 413/840] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:28.287873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea955e1-8ec3-416e-858a-61921dd83a0b None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:28.326730 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 428/841] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:48:28.328398 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2009a00-b6d7-4e33-ac70-207ff999e42c None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:28.429154 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea955e1-8ec3-416e-858a-61921dd83a0b None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:28.473067 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4952e4-eb7c-4688-ae94-5fda7c52bb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:28.473878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4952e4-eb7c-4688-ae94-5fda7c52bb7c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:28.474164 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4952e4-eb7c-4688-ae94-5fda7c52bb7c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:28.474476 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4952e4-eb7c-4688-ae94-5fda7c52bb7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:28.482559 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2009a00-b6d7-4e33-ac70-207ff999e42c None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:28.487407 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4952e4-eb7c-4688-ae94-5fda7c52bb7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:28.495305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-5d4952e4-eb7c-4688-ae94-5fda7c52bb7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:48:28.495305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:28.495305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:28.495305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:28.495305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:28.495305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:28.495305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:28.495305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:28.495305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:28.495305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:28.495305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:28.495305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:28.495305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:28.495305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:28.495305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:28.495305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:28.496421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:28.496421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:28.496421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:28.496421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:28.496421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:28.496421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:28.496421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:28.496421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:28.496421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:28.496421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:28.496421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:28.496421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:28.496421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:28.496421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:28.496421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:28.496421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:28.497248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:28.497248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:28.497248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:28.497248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:28.497248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:28.497248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:28.497248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:28.497248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:28.497248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:28.497248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:28.497248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:48:28.497248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:28.497248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 414/842] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:48:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:28.498624 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4952e4-eb7c-4688-ae94-5fda7c52bb7c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:28.525513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6329c76-3b24-48c4-94a5-35a3937238ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:28.526283 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6329c76-3b24-48c4-94a5-35a3937238ee None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:28.526540 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6329c76-3b24-48c4-94a5-35a3937238ee None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:28.526785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6329c76-3b24-48c4-94a5-35a3937238ee None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:28.527526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6329c76-3b24-48c4-94a5-35a3937238ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:28.528362 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6329c76-3b24-48c4-94a5-35a3937238ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:28.529952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6329c76-3b24-48c4-94a5-35a3937238ee None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:28.549562 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 429/843] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:28.550589 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6329c76-3b24-48c4-94a5-35a3937238ee None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:28.621018 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4952e4-eb7c-4688-ae94-5fda7c52bb7c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:28.660993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65f015-3f3e-474c-bdf9-5820e2b10096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:28.661818 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65f015-3f3e-474c-bdf9-5820e2b10096 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:28.662096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65f015-3f3e-474c-bdf9-5820e2b10096 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:28.662900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65f015-3f3e-474c-bdf9-5820e2b10096 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:28.663711 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65f015-3f3e-474c-bdf9-5820e2b10096 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:28.665225 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65f015-3f3e-474c-bdf9-5820e2b10096 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:28.675785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6329c76-3b24-48c4-94a5-35a3937238ee None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:28.679741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-0f65f015-3f3e-474c-bdf9-5820e2b10096 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 13:48:28.679741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:28.679741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:48:28.679741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:48:28.679741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:48:28.679741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:48:28.679741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:48:28.679741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:28.679741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 13:48:28.679741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:28.679741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:28.679741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:28.679741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:28.679741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:28.679741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:28.679741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:28.679741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:28.680881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:28.680881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:28.680881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:28.680881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:28.680881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:28.680881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:28.680881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:48:28.680881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:48:28.680881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:48:28.680881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:48:28.680881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:28.680881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:28.680881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:28.680881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:28.680881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:28.680881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:28.681703 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:28.681703 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:28.681703 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:28.681703 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:28.681703 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:28.681703 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:28.681703 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:28.681703 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:28.681703 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:28.681703 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:28.681703 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:48:28.681703 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:28.681703 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 13:48:28.681703 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:28.685625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 415/844] 10.222.0.32 () {56 vars in 1114 bytes} [Tue May 10 13:48:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:28.687041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65f015-3f3e-474c-bdf9-5820e2b10096 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:28.738119 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31e645-f96d-45d0-879b-a3b617438077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:28.739201 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31e645-f96d-45d0-879b-a3b617438077 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:28.739654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31e645-f96d-45d0-879b-a3b617438077 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:28.740098 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31e645-f96d-45d0-879b-a3b617438077 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:28.741463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31e645-f96d-45d0-879b-a3b617438077 None admin] RBAC: Adding query filter params (name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:28.741983 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31e645-f96d-45d0-879b-a3b617438077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:28.744399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31e645-f96d-45d0-879b-a3b617438077 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:28.756455 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 430/845] 10.222.0.32 () {56 vars in 1103 bytes} [Tue May 10 13:48:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:28.757707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31e645-f96d-45d0-879b-a3b617438077 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:28.833138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65f015-3f3e-474c-bdf9-5820e2b10096 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:28.885025 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac722029-3e26-4ead-81c2-9422300be9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:28.885835 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac722029-3e26-4ead-81c2-9422300be9e9 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:28.887472 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac722029-3e26-4ead-81c2-9422300be9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:28.887921 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac722029-3e26-4ead-81c2-9422300be9e9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:28.896472 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac722029-3e26-4ead-81c2-9422300be9e9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:28.897942 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac722029-3e26-4ead-81c2-9422300be9e9 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:28.914615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-ac722029-3e26-4ead-81c2-9422300be9e9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 13:48:28.914615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:28.914615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:28.914615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:28.914615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:28.914615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:28.914615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:28.914615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:28.914615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:28.914615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:28.914615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:28.914615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:28.914615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:48:28.914615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:48:28.914615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:48:28.914615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:48:28.915794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:28.915794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:28.915794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:28.915794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:28.915794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:28.915794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:28.915794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:28.915794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:28.915794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:28.915794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:28.915794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:28.915794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:28.915794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:28.915794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:28.915794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:28.915794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:28.915794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:28.915794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:28.916736 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:28.916736 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:28.916736 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:48:28.916736 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:48:28.916736 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:48:28.916736 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:48:28.916736 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:48:28.916736 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:48:28.916736 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 13:48:28.916736 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:28.916736 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 416/846] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:48:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:28.917307 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac722029-3e26-4ead-81c2-9422300be9e9 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:28.920866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31e645-f96d-45d0-879b-a3b617438077 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:28.969353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bea6b-e7ab-4f48-aea0-face826b488f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:28.970120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bea6b-e7ab-4f48-aea0-face826b488f None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:28.970673 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bea6b-e7ab-4f48-aea0-face826b488f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:28.971040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bea6b-e7ab-4f48-aea0-face826b488f None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:28.971967 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952bea6b-e7ab-4f48-aea0-face826b488f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:28.972380 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952bea6b-e7ab-4f48-aea0-face826b488f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:28.974294 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952bea6b-e7ab-4f48-aea0-face826b488f None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:28.980317 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 431/847] 10.222.0.32 () {56 vars in 1114 bytes} [Tue May 10 13:48:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:28.981502 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bea6b-e7ab-4f48-aea0-face826b488f None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:29.052483 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac722029-3e26-4ead-81c2-9422300be9e9 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:29.089173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8ec77-fa33-42f5-8159-999b017ddba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:29.089986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8ec77-fa33-42f5-8159-999b017ddba9 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:29.090552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8ec77-fa33-42f5-8159-999b017ddba9 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:29.090938 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8ec77-fa33-42f5-8159-999b017ddba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:29.095430 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bea6b-e7ab-4f48-aea0-face826b488f None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:29.102688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8ec77-fa33-42f5-8159-999b017ddba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:29.104186 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8ec77-fa33-42f5-8159-999b017ddba9 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:29.125861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-acb8ec77-fa33-42f5-8159-999b017ddba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:29.125861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:29.125861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:29.125861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:29.125861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:29.125861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:29.125861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:29.125861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:29.125861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:29.125861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:29.125861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:29.125861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:29.125861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:29.125861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:29.125861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:29.127192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:29.127192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:29.127192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:29.127192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:29.127192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:29.127192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:29.127192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:29.127192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:29.127192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:29.127192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:29.127192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:29.127192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:29.127192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:29.127192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:29.127192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:29.127192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:29.127192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:29.128312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:29.128312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:29.128312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:29.128312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:29.130646 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 417/848] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:29.132278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8ec77-fa33-42f5-8159-999b017ddba9 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:29.146718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f161170-c003-4221-a477-3e765eda7e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:29.147445 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f161170-c003-4221-a477-3e765eda7e41 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:29.147734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f161170-c003-4221-a477-3e765eda7e41 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:29.148000 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f161170-c003-4221-a477-3e765eda7e41 None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:29.148950 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f161170-c003-4221-a477-3e765eda7e41 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:29.149257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f161170-c003-4221-a477-3e765eda7e41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:29.150746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f161170-c003-4221-a477-3e765eda7e41 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:29.173007 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 432/849] 10.222.0.32 () {56 vars in 1135 bytes} [Tue May 10 13:48:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:29.174415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f161170-c003-4221-a477-3e765eda7e41 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:29.270570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8ec77-fa33-42f5-8159-999b017ddba9 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:29.316189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587f702-f8af-4e09-b975-8b56a86250aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:29.316978 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587f702-f8af-4e09-b975-8b56a86250aa None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:29.317225 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f161170-c003-4221-a477-3e765eda7e41 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:29.317383 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587f702-f8af-4e09-b975-8b56a86250aa None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:29.317653 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587f702-f8af-4e09-b975-8b56a86250aa None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:29.318284 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587f702-f8af-4e09-b975-8b56a86250aa None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:29.318595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587f702-f8af-4e09-b975-8b56a86250aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:29.319999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587f702-f8af-4e09-b975-8b56a86250aa None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:29.334563 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 418/850] 10.222.0.32 () {56 vars in 1114 bytes} [Tue May 10 13:48:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:29.334563 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587f702-f8af-4e09-b975-8b56a86250aa None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:29.360010 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca8422-fe37-4dc1-ad5c-1b6946968d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:29.360704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca8422-fe37-4dc1-ad5c-1b6946968d2b None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:29.361195 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca8422-fe37-4dc1-ad5c-1b6946968d2b None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:29.361470 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca8422-fe37-4dc1-ad5c-1b6946968d2b None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:29.362783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca8422-fe37-4dc1-ad5c-1b6946968d2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:29.363236 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca8422-fe37-4dc1-ad5c-1b6946968d2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:29.365039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca8422-fe37-4dc1-ad5c-1b6946968d2b None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:29.380749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 433/851] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:29.386264 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca8422-fe37-4dc1-ad5c-1b6946968d2b None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:29.496405 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587f702-f8af-4e09-b975-8b56a86250aa None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:29.527260 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca8422-fe37-4dc1-ad5c-1b6946968d2b None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:29.537594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3090e56-f4e0-4798-b638-4a3ee7d9d330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:29.538465 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3090e56-f4e0-4798-b638-4a3ee7d9d330 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:29.538852 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3090e56-f4e0-4798-b638-4a3ee7d9d330 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:29.539313 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3090e56-f4e0-4798-b638-4a3ee7d9d330 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:29.595784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27df31-53f3-41a7-b724-6ff3ebe9c857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:29.597239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27df31-53f3-41a7-b724-6ff3ebe9c857 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:29.597750 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27df31-53f3-41a7-b724-6ff3ebe9c857 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:29.598282 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27df31-53f3-41a7-b724-6ff3ebe9c857 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:29.614978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27df31-53f3-41a7-b724-6ff3ebe9c857 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:29.617833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27df31-53f3-41a7-b724-6ff3ebe9c857 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:29.621561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3090e56-f4e0-4798-b638-4a3ee7d9d330 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:29.623216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3090e56-f4e0-4798-b638-4a3ee7d9d330 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:29.649148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-5f27df31-53f3-41a7-b724-6ff3ebe9c857 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:48:29.649148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:29.649148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:29.649148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:29.649148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:29.649148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:29.649148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:29.649148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:29.649148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:29.649148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:29.649148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:29.649148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:29.649148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:48:29.649148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:48:29.649148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:48:29.649148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:48:29.653036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:29.653036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:29.653036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:29.653036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:29.653036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:29.653036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:29.653036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:29.653036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:29.653036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:29.653036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:29.653036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:29.653036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:29.653036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:29.653036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:29.653036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:29.653036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:29.653036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:29.653036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:29.661501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:29.661501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:29.661501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:48:29.661501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:48:29.661501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:48:29.661501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:48:29.661501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:48:29.661501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:48:29.661501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:48:29.661501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:29.661501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 434/852] 10.222.0.32 () {56 vars in 1117 bytes} [Tue May 10 13:48:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:29.663624 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27df31-53f3-41a7-b724-6ff3ebe9c857 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:29.742174 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 419/853] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:48:29 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:48:29.750258 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3090e56-f4e0-4798-b638-4a3ee7d9d330 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:29.834696 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27df31-53f3-41a7-b724-6ff3ebe9c857 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:29.880894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831828a8-e691-448a-a24b-96b74f5c57d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:29.882028 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831828a8-e691-448a-a24b-96b74f5c57d5 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:29.882570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831828a8-e691-448a-a24b-96b74f5c57d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:29.883074 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831828a8-e691-448a-a24b-96b74f5c57d5 None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:29.884740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831828a8-e691-448a-a24b-96b74f5c57d5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:29.885394 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831828a8-e691-448a-a24b-96b74f5c57d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:29.888772 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831828a8-e691-448a-a24b-96b74f5c57d5 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:29.904140 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3090e56-f4e0-4798-b638-4a3ee7d9d330 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:29.915769 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 435/854] 10.222.0.32 () {56 vars in 1149 bytes} [Tue May 10 13:48:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:29.917171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b41a2-fc57-4bd6-a02e-fc8c501547a2 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:29.917434 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b41a2-fc57-4bd6-a02e-fc8c501547a2 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:29.917699 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b41a2-fc57-4bd6-a02e-fc8c501547a2 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:29.919251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 436/855] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:29.925359 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44672d39-eab9-41b6-b200-48f33bfe9e66 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:29.925690 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44672d39-eab9-41b6-b200-48f33bfe9e66 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:29.925909 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44672d39-eab9-41b6-b200-48f33bfe9e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:29.948948 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec248c-e932-4647-acd2-4b996515c406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:29.949909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec248c-e932-4647-acd2-4b996515c406 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:29.950286 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec248c-e932-4647-acd2-4b996515c406 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:29.950521 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec248c-e932-4647-acd2-4b996515c406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:29.952942 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-44672d39-eab9-41b6-b200-48f33bfe9e66 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:29.954844 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-44672d39-eab9-41b6-b200-48f33bfe9e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:29.961606 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec248c-e932-4647-acd2-4b996515c406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:29.963107 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec248c-e932-4647-acd2-4b996515c406 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:29.982701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-73ec248c-e932-4647-acd2-4b996515c406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:29.982701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:29.982701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:29.982701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:29.982701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:29.982701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:29.982701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:29.982701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:29.982701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:29.982701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:29.982701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:29.982701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:29.982701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:29.982701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:29.982701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:29.983667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:29.983667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:29.983667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:29.983667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:29.983667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:29.983667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:29.983667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:29.983667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:29.983667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:29.983667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:29.983667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:29.983667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:29.983667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:29.983667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:29.983667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:29.983667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:29.983667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:29.984640 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:29.984640 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:29.984640 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:29.984640 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:29.988652 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 420/856] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:29.989384 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec248c-e932-4647-acd2-4b996515c406 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:30.063756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 437/857] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:48:30.064616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44672d39-eab9-41b6-b200-48f33bfe9e66 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:30.113081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec248c-e932-4647-acd2-4b996515c406 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:30.161947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c139beb-c57c-421d-b805-e7db1f76799d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:30.162362 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c139beb-c57c-421d-b805-e7db1f76799d None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:30.162618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c139beb-c57c-421d-b805-e7db1f76799d None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:30.162921 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c139beb-c57c-421d-b805-e7db1f76799d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:30.179937 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44672d39-eab9-41b6-b200-48f33bfe9e66 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:30.222798 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba0c80-1e2a-4452-89ef-b98745a0d579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:30.223472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba0c80-1e2a-4452-89ef-b98745a0d579 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:30.223754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba0c80-1e2a-4452-89ef-b98745a0d579 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:30.224027 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba0c80-1e2a-4452-89ef-b98745a0d579 None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:30.224754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba0c80-1e2a-4452-89ef-b98745a0d579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:30.225058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba0c80-1e2a-4452-89ef-b98745a0d579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:30.226565 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba0c80-1e2a-4452-89ef-b98745a0d579 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:30.243706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 438/858] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:30.243706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba0c80-1e2a-4452-89ef-b98745a0d579 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:30.248792 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c139beb-c57c-421d-b805-e7db1f76799d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:30.250308 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c139beb-c57c-421d-b805-e7db1f76799d None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:30.351782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba0c80-1e2a-4452-89ef-b98745a0d579 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:30.377649 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 421/859] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:48:29 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:48:30.378455 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c139beb-c57c-421d-b805-e7db1f76799d None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:30.408750 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e2bd5-5da5-411c-93df-127a25f4eb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:30.409743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e2bd5-5da5-411c-93df-127a25f4eb2c None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:30.410083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e2bd5-5da5-411c-93df-127a25f4eb2c None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:30.410431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e2bd5-5da5-411c-93df-127a25f4eb2c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:30.411281 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e2bd5-5da5-411c-93df-127a25f4eb2c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:30.413106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e2bd5-5da5-411c-93df-127a25f4eb2c None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:30.426998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-d81e2bd5-5da5-411c-93df-127a25f4eb2c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 13:48:30.426998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:30.426998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:48:30.426998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:48:30.426998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:48:30.426998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:48:30.426998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:48:30.426998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:30.426998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 13:48:30.426998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:30.426998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:30.426998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:30.426998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:30.426998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:30.426998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:30.426998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:30.428186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:30.428186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:30.428186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:30.428186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:30.428186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:30.428186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:30.428186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:30.428186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:48:30.428186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:48:30.428186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:48:30.428186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:48:30.428186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:30.428186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:30.428186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:30.428186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:30.428186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:30.434887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:30.434887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:30.434887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:30.434887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:30.434887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:30.434887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:30.434887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:30.434887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:30.434887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:30.434887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:30.434887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:30.434887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:48:30.434887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:30.434887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 13:48:30.434887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:30.434887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 439/860] 10.222.0.32 () {56 vars in 1132 bytes} [Tue May 10 13:48:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:30.435752 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e2bd5-5da5-411c-93df-127a25f4eb2c None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:30.518696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c139beb-c57c-421d-b805-e7db1f76799d None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:30.537044 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e2bd5-5da5-411c-93df-127a25f4eb2c None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:30.562890 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700a07b-fb5c-4095-8b95-0ae76634a0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:30.563809 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700a07b-fb5c-4095-8b95-0ae76634a0ec None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:30.564085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700a07b-fb5c-4095-8b95-0ae76634a0ec None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:30.564353 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700a07b-fb5c-4095-8b95-0ae76634a0ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:30.571807 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700a07b-fb5c-4095-8b95-0ae76634a0ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:30.573498 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700a07b-fb5c-4095-8b95-0ae76634a0ec None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:30.574501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ecb97-bb83-44ea-b363-84aa8df35192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:30.575455 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ecb97-bb83-44ea-b363-84aa8df35192 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:30.575729 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ecb97-bb83-44ea-b363-84aa8df35192 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:30.576032 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ecb97-bb83-44ea-b363-84aa8df35192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:30.588837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-4700a07b-fb5c-4095-8b95-0ae76634a0ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:30.588837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:30.588837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:30.588837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:30.588837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:30.588837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:30.588837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:30.588837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:30.588837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:30.588837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:30.588837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:30.588837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:30.588837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:30.588837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:30.588837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:30.589803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:30.589803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:30.589803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:30.589803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:30.589803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:30.589803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:30.589803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:30.589803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:30.589803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:30.589803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:30.589803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:30.589803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:30.589803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:30.589803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:30.589803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:30.589803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:30.589803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:30.591252 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:30.591252 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:30.591252 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:30.591252 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:30.591252 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:30.591252 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:30.591252 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:30.591252 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:30.591859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ecb97-bb83-44ea-b363-84aa8df35192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:30.592114 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ecb97-bb83-44ea-b363-84aa8df35192 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:30.593559 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 422/861] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:30.594567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700a07b-fb5c-4095-8b95-0ae76634a0ec None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:30.611631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-bf8ecb97-bb83-44ea-b363-84aa8df35192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:30.611631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:30.611631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:30.611631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:30.611631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:30.611631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:30.611631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:30.611631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:30.611631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:30.611631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:30.611631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:30.611631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:30.611631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:30.611631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:30.611631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:30.619141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:30.619141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:30.619141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:30.619141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:30.619141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:30.619141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:30.619141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:30.619141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:30.619141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:30.619141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:30.619141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:30.619141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:30.619141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:30.619141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:30.619141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:30.619141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:30.619141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:30.620084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:30.620084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:30.620084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:30.620084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:30.620084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 440/862] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:30.620084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ecb97-bb83-44ea-b363-84aa8df35192 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:30.743239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ecb97-bb83-44ea-b363-84aa8df35192 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:30.791148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a143e08-9cb3-4681-9c3e-567330e11f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:30.792187 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a143e08-9cb3-4681-9c3e-567330e11f02 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:30.792650 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a143e08-9cb3-4681-9c3e-567330e11f02 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:30.793123 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a143e08-9cb3-4681-9c3e-567330e11f02 None admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:30.795019 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a143e08-9cb3-4681-9c3e-567330e11f02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:30.795713 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a143e08-9cb3-4681-9c3e-567330e11f02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:30.797686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a143e08-9cb3-4681-9c3e-567330e11f02 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:30.813855 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 441/863] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:48:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:30.815084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a143e08-9cb3-4681-9c3e-567330e11f02 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:30.848060 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700a07b-fb5c-4095-8b95-0ae76634a0ec None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:30.886258 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcddde-66cd-40f1-b302-13bd75c344f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:30.887156 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcddde-66cd-40f1-b302-13bd75c344f2 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:30.887421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcddde-66cd-40f1-b302-13bd75c344f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:30.887858 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcddde-66cd-40f1-b302-13bd75c344f2 None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:30.888399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcddde-66cd-40f1-b302-13bd75c344f2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:30.888769 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcddde-66cd-40f1-b302-13bd75c344f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:30.890073 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcddde-66cd-40f1-b302-13bd75c344f2 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:30.899410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 423/864] 10.222.0.32 () {56 vars in 1126 bytes} [Tue May 10 13:48:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:30.899410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcddde-66cd-40f1-b302-13bd75c344f2 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:30.935327 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a143e08-9cb3-4681-9c3e-567330e11f02 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:30.976881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2397794-daea-4787-8808-e45ef9a224b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:30.977558 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2397794-daea-4787-8808-e45ef9a224b6 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:30.977840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2397794-daea-4787-8808-e45ef9a224b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:30.978111 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2397794-daea-4787-8808-e45ef9a224b6 None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:30.978866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2397794-daea-4787-8808-e45ef9a224b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:30.979173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2397794-daea-4787-8808-e45ef9a224b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:30.980553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2397794-daea-4787-8808-e45ef9a224b6 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:30.998275 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 442/865] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:30.998960 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2397794-daea-4787-8808-e45ef9a224b6 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:31.007802 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcddde-66cd-40f1-b302-13bd75c344f2 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:31.059601 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3265a-70bd-4fd8-a80d-986cd3af55e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:31.060370 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3265a-70bd-4fd8-a80d-986cd3af55e4 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:31.060661 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3265a-70bd-4fd8-a80d-986cd3af55e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:31.060941 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3265a-70bd-4fd8-a80d-986cd3af55e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:31.061795 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3265a-70bd-4fd8-a80d-986cd3af55e4 None admin] RBAC: Adding query filter params (role.id=17e40821fc444dd0b040dcfce3eb222b, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=47bbad5318b6417087d7ce6906f8281f) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:31.062106 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3265a-70bd-4fd8-a80d-986cd3af55e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:31.063603 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3265a-70bd-4fd8-a80d-986cd3af55e4 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:31.069917 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 424/866] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:48:30 2022] GET /identity/v3/role_assignments?user.id=47bbad5318b6417087d7ce6906f8281f&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=17e40821fc444dd0b040dcfce3eb222b => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:31.070794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3265a-70bd-4fd8-a80d-986cd3af55e4 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:31.162660 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2397794-daea-4787-8808-e45ef9a224b6 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:31.210363 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ee491-80fb-46f3-94a7-d517cccca0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:31.210769 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ee491-80fb-46f3-94a7-d517cccca0c2 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:31.211053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ee491-80fb-46f3-94a7-d517cccca0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:31.211325 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ee491-80fb-46f3-94a7-d517cccca0c2 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:31.212059 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ee491-80fb-46f3-94a7-d517cccca0c2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:31.212366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ee491-80fb-46f3-94a7-d517cccca0c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:31.213789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ee491-80fb-46f3-94a7-d517cccca0c2 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:31.220654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 443/867] 10.222.0.32 () {56 vars in 1126 bytes} [Tue May 10 13:48:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:31.264445 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3265a-70bd-4fd8-a80d-986cd3af55e4 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:31.325354 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c949a-e7cd-4182-b11f-cef16c609f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:31.326678 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c949a-e7cd-4182-b11f-cef16c609f5f None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:31.327213 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c949a-e7cd-4182-b11f-cef16c609f5f None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:31.327686 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c949a-e7cd-4182-b11f-cef16c609f5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:31.336030 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c949a-e7cd-4182-b11f-cef16c609f5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:31.337952 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c949a-e7cd-4182-b11f-cef16c609f5f None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:31.354561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-7a8c949a-e7cd-4182-b11f-cef16c609f5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:31.354561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:31.354561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:31.354561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:31.354561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:31.354561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:31.354561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:31.354561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:31.354561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:31.354561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:31.354561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:31.354561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:31.354561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:31.354561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:31.354561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:31.355516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:31.355516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:31.355516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:31.355516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:31.355516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:31.355516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:31.355516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:31.355516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:31.355516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:31.355516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:31.355516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:31.355516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:31.355516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:31.355516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:31.355516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:31.355516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:31.355516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:31.356370 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:31.356370 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:31.356370 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:31.356370 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:31.356370 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:31.356370 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:31.356370 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:31.356370 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:31.359355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 425/868] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:31.365470 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ee491-80fb-46f3-94a7-d517cccca0c2 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:31.481942 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ee491-80fb-46f3-94a7-d517cccca0c2 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:31.519843 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb53fdd-87ab-4395-9c90-9d13938c1ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:31.520778 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb53fdd-87ab-4395-9c90-9d13938c1ed5 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:31.521303 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb53fdd-87ab-4395-9c90-9d13938c1ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:31.521746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb53fdd-87ab-4395-9c90-9d13938c1ed5 None admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:31.522791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb53fdd-87ab-4395-9c90-9d13938c1ed5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:31.523408 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb53fdd-87ab-4395-9c90-9d13938c1ed5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:31.525014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb53fdd-87ab-4395-9c90-9d13938c1ed5 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:31.540957 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 444/869] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:48:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:31.547502 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c949a-e7cd-4182-b11f-cef16c609f5f None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:31.661155 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c949a-e7cd-4182-b11f-cef16c609f5f None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:31.701495 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f1fdc-fc76-497c-acfa-8b769eb451a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:31.702496 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f1fdc-fc76-497c-acfa-8b769eb451a4 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:31.702946 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f1fdc-fc76-497c-acfa-8b769eb451a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:31.703445 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f1fdc-fc76-497c-acfa-8b769eb451a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:31.704470 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f1fdc-fc76-497c-acfa-8b769eb451a4 None admin] RBAC: Adding query filter params (role.id=567077e602b043f8b81abc208831228a, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=686c869be43c40a9b63b3647bf689c7a) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:31.704939 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f1fdc-fc76-497c-acfa-8b769eb451a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:31.706617 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f1fdc-fc76-497c-acfa-8b769eb451a4 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:31.714394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 426/870] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:48:31 2022] GET /identity/v3/role_assignments?user.id=686c869be43c40a9b63b3647bf689c7a&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=567077e602b043f8b81abc208831228a => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:31.902141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5dd08-a634-47a6-8000-97ecba7f69e3 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:31.903947 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5dd08-a634-47a6-8000-97ecba7f69e3 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:31.903947 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5dd08-a634-47a6-8000-97ecba7f69e3 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:31.905226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 445/871] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:31.911857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c8c7c-8aec-41fb-be14-6cc092569179 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:31.912583 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c8c7c-8aec-41fb-be14-6cc092569179 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:31.912583 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c8c7c-8aec-41fb-be14-6cc092569179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:31.931050 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-a79c8c7c-8aec-41fb-be14-6cc092569179 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:31.932326 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a79c8c7c-8aec-41fb-be14-6cc092569179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:32.017304 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 427/872] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:32.040880 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5dd08-a634-47a6-8000-97ecba7f69e3 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:32.169230 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5dd08-a634-47a6-8000-97ecba7f69e3 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:32.205722 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6a600-3384-4816-8b1e-12e8d8a75e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:32.206835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6a600-3384-4816-8b1e-12e8d8a75e1e None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:32.207347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6a600-3384-4816-8b1e-12e8d8a75e1e None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:32.207821 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6a600-3384-4816-8b1e-12e8d8a75e1e None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:32.208745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6a600-3384-4816-8b1e-12e8d8a75e1e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:32.210343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6a600-3384-4816-8b1e-12e8d8a75e1e None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:32.230367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 446/873] 10.222.0.32 () {60 vars in 1141 bytes} [Tue May 10 13:48:32 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:48:33.709032 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330448ab-c676-45c7-9854-5fe467fbbeab None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:33.709566 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330448ab-c676-45c7-9854-5fe467fbbeab None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:33.709566 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330448ab-c676-45c7-9854-5fe467fbbeab None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:33.711316 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 428/874] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:33.714861 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e41092-9968-4e80-b088-6e5537221701 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:33.715805 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e41092-9968-4e80-b088-6e5537221701 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:33.716521 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e41092-9968-4e80-b088-6e5537221701 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:33.717864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba066af4-9819-4691-88fd-e3714846173d None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:33.718404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba066af4-9819-4691-88fd-e3714846173d None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:33.718521 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 447/875] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:33.718942 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba066af4-9819-4691-88fd-e3714846173d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:33.727584 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f29971-babe-496d-bdb5-f583519f6abb None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:33.728820 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f29971-babe-496d-bdb5-f583519f6abb None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:33.729314 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f29971-babe-496d-bdb5-f583519f6abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:33.740688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-ba066af4-9819-4691-88fd-e3714846173d None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:33.741878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-ba066af4-9819-4691-88fd-e3714846173d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:33.752074 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-e9f29971-babe-496d-bdb5-f583519f6abb None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:33.753660 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-e9f29971-babe-496d-bdb5-f583519f6abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:33.830611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 429/876] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:33 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:48:33.845096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba066af4-9819-4691-88fd-e3714846173d None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:33.866170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 448/877] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:33 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:33.889586 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f29971-babe-496d-bdb5-f583519f6abb None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:33.965248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba066af4-9819-4691-88fd-e3714846173d None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:34.006490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1fb2a-8b82-4612-849d-e710a72eeb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:34.007719 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1fb2a-8b82-4612-849d-e710a72eeb14 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:34.008320 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1fb2a-8b82-4612-849d-e710a72eeb14 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:34.009028 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1fb2a-8b82-4612-849d-e710a72eeb14 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:34.010292 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1fb2a-8b82-4612-849d-e710a72eeb14 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:34.012470 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1fb2a-8b82-4612-849d-e710a72eeb14 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:34.018108 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f29971-babe-496d-bdb5-f583519f6abb None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:34.026061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-a2b1fb2a-8b82-4612-849d-e710a72eeb14 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:48:34.026061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:34.026061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:48:34.026061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:48:34.026061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:48:34.026061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:48:34.026061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:48:34.026061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:34.026061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:48:34.026061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:34.026061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:34.026061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:34.026061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:34.026061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:34.026061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:34.026061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:34.026061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:34.027091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:34.027091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:34.027091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:34.027091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:34.027091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:34.027091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:34.027091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:48:34.027091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:48:34.027091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:48:34.027091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:48:34.027091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:34.027091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:34.027091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:34.027091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:34.027091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:34.027091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:34.027956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:34.027956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:34.027956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:34.027956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:34.027956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:34.027956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:34.027956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:34.027956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:34.027956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:34.027956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:34.027956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:48:34.027956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:34.027956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:48:34.027956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:34.034542 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 430/878] 10.222.0.32 () {56 vars in 1126 bytes} [Tue May 10 13:48:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:34.037106 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1fb2a-8b82-4612-849d-e710a72eeb14 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:34.058315 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423142a-64c1-4a1a-acd3-b597c44e5c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:34.059095 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423142a-64c1-4a1a-acd3-b597c44e5c18 None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:34.059375 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423142a-64c1-4a1a-acd3-b597c44e5c18 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:34.059648 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423142a-64c1-4a1a-acd3-b597c44e5c18 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:34.060389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423142a-64c1-4a1a-acd3-b597c44e5c18 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:34.062345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423142a-64c1-4a1a-acd3-b597c44e5c18 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:34.098238 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 449/879] 10.222.0.32 () {60 vars in 1141 bytes} [Tue May 10 13:48:33 2022] POST /identity/v3/services => generated 269 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:48:34.223774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1fb2a-8b82-4612-849d-e710a72eeb14 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:34.293049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0c6b4-d4b3-4a6a-81a1-ed41317877b6 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:34.293585 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0c6b4-d4b3-4a6a-81a1-ed41317877b6 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:34.294439 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0c6b4-d4b3-4a6a-81a1-ed41317877b6 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:34.298099 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 450/880] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:48:34.308633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d93d9b-2aa0-4b49-aa26-b81961ce5cdd None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:34.310049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d93d9b-2aa0-4b49-aa26-b81961ce5cdd None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:34.310280 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf29f9-cb81-4633-b551-e0697ec1f47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:34.310457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d93d9b-2aa0-4b49-aa26-b81961ce5cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:34.310609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf29f9-cb81-4633-b551-e0697ec1f47f None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:34.310758 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf29f9-cb81-4633-b551-e0697ec1f47f None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:34.311252 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf29f9-cb81-4633-b551-e0697ec1f47f None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:34.311783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf29f9-cb81-4633-b551-e0697ec1f47f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:34.312194 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf29f9-cb81-4633-b551-e0697ec1f47f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:34.316086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf29f9-cb81-4633-b551-e0697ec1f47f None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:34.323044 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 431/881] 10.222.0.32 () {56 vars in 1122 bytes} [Tue May 10 13:48:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:34.332489 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf29f9-cb81-4633-b551-e0697ec1f47f None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:34.332781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-48d93d9b-2aa0-4b49-aa26-b81961ce5cdd None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:34.334011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-48d93d9b-2aa0-4b49-aa26-b81961ce5cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:34.467051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 451/882] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:34.468873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf29f9-cb81-4633-b551-e0697ec1f47f None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:34.491726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d93d9b-2aa0-4b49-aa26-b81961ce5cdd None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:34.546752 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b4a55-d9fd-41b8-b097-cd9e7b92fb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:34.549122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b4a55-d9fd-41b8-b097-cd9e7b92fb32 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:34.549854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b4a55-d9fd-41b8-b097-cd9e7b92fb32 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:34.550780 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b4a55-d9fd-41b8-b097-cd9e7b92fb32 None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:34.553338 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b4a55-d9fd-41b8-b097-cd9e7b92fb32 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:34.554149 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b4a55-d9fd-41b8-b097-cd9e7b92fb32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:34.557655 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b4a55-d9fd-41b8-b097-cd9e7b92fb32 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:34.568321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 432/883] 10.222.0.32 () {56 vars in 1122 bytes} [Tue May 10 13:48:34 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:34.627224 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d93d9b-2aa0-4b49-aa26-b81961ce5cdd None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:34.653046 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b4c38-3025-4dee-a27d-1b22b42d85ff None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:34.653997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b4c38-3025-4dee-a27d-1b22b42d85ff None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:34.654828 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b4c38-3025-4dee-a27d-1b22b42d85ff None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:34.658032 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 433/884] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:34.665637 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31cf32-3af5-4378-b4fc-170d6b968fb2 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:34.666341 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31cf32-3af5-4378-b4fc-170d6b968fb2 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:34.667058 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31cf32-3af5-4378-b4fc-170d6b968fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:34.671861 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32568de-3e4c-4471-8f56-fca7e3e90fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:34.673697 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32568de-3e4c-4471-8f56-fca7e3e90fe0 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:34.674461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32568de-3e4c-4471-8f56-fca7e3e90fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:34.675313 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32568de-3e4c-4471-8f56-fca7e3e90fe0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:34.697683 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32568de-3e4c-4471-8f56-fca7e3e90fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:34.699188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-6a31cf32-3af5-4378-b4fc-170d6b968fb2 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:34.701609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-6a31cf32-3af5-4378-b4fc-170d6b968fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:34.715437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-d32568de-3e4c-4471-8f56-fca7e3e90fe0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:48:34.715437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:34.715437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:34.715437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:34.715437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:34.715437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:34.715437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:34.715437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:34.715437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:34.715437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:34.715437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:34.715437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:34.715437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:34.715437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:34.715437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:34.715437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:34.717975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:34.717975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:34.717975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:34.717975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:34.717975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:34.717975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:34.717975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:34.717975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:34.717975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:34.717975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:34.717975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:34.717975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:34.717975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:34.717975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:34.717975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:34.717975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:34.719939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:34.719939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:34.719939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:34.719939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:34.719939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:34.719939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:34.719939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:34.719939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:34.719939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:34.719939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:34.719939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:48:34.719939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:34.724394 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 452/885] 10.222.0.32 () {56 vars in 1120 bytes} [Tue May 10 13:48:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:34.731810 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32568de-3e4c-4471-8f56-fca7e3e90fe0 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:34.818580 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 434/886] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:34.842631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31cf32-3af5-4378-b4fc-170d6b968fb2 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:34.884794 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32568de-3e4c-4471-8f56-fca7e3e90fe0 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:34.952810 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c80bd8-b7f3-4764-9eb2-94d8ac37c683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:34.953101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31cf32-3af5-4378-b4fc-170d6b968fb2 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:34.954592 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c80bd8-b7f3-4764-9eb2-94d8ac37c683 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:34.955400 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c80bd8-b7f3-4764-9eb2-94d8ac37c683 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:34.956170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c80bd8-b7f3-4764-9eb2-94d8ac37c683 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:34.957988 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c80bd8-b7f3-4764-9eb2-94d8ac37c683 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:34.958881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c80bd8-b7f3-4764-9eb2-94d8ac37c683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:34.961795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c80bd8-b7f3-4764-9eb2-94d8ac37c683 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:34.979033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 453/887] 10.222.0.32 () {56 vars in 1115 bytes} [Tue May 10 13:48:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:34.986171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c80bd8-b7f3-4764-9eb2-94d8ac37c683 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:35.013028 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d08b36-aa25-430d-b77f-f82cc46ebf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:35.015031 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d08b36-aa25-430d-b77f-f82cc46ebf8f None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:35.015543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d08b36-aa25-430d-b77f-f82cc46ebf8f None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:35.016044 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d08b36-aa25-430d-b77f-f82cc46ebf8f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:35.017349 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d08b36-aa25-430d-b77f-f82cc46ebf8f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:35.021461 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d08b36-aa25-430d-b77f-f82cc46ebf8f None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:35.049612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-a9d08b36-aa25-430d-b77f-f82cc46ebf8f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 13:48:35.049612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:35.049612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:48:35.049612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:48:35.049612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:48:35.049612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:48:35.049612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:48:35.049612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:35.049612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 13:48:35.049612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:35.049612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:35.049612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:35.049612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:35.049612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:35.049612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:35.049612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:35.049612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:35.051677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:35.051677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:35.051677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:35.051677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:35.051677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:35.051677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:35.051677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:48:35.051677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:48:35.051677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:48:35.051677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:48:35.051677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:35.051677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:35.051677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:35.051677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:35.051677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:35.051677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:35.053379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:35.053379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:35.053379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:35.053379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:35.053379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:35.053379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:35.053379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:35.053379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:35.053379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:35.053379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:35.053379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:48:35.053379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:35.053379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 13:48:35.053379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:35.053379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 435/888] 10.222.0.32 () {56 vars in 1114 bytes} [Tue May 10 13:48:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:35.057450 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d08b36-aa25-430d-b77f-f82cc46ebf8f None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:35.169768 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c80bd8-b7f3-4764-9eb2-94d8ac37c683 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:35.173354 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d08b36-aa25-430d-b77f-f82cc46ebf8f None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:35.222072 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8942c-0b43-4cce-a508-57857550ba88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:35.222851 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8942c-0b43-4cce-a508-57857550ba88 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:35.223131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8942c-0b43-4cce-a508-57857550ba88 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:35.223402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8942c-0b43-4cce-a508-57857550ba88 None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:35.224604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8942c-0b43-4cce-a508-57857550ba88 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:35.224921 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8942c-0b43-4cce-a508-57857550ba88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:35.226653 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8942c-0b43-4cce-a508-57857550ba88 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:35.238174 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 436/889] 10.222.0.32 () {56 vars in 1114 bytes} [Tue May 10 13:48:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:35.239479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576933f-d64e-4dcf-a7ad-9dc075ff83c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:35.240596 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8942c-0b43-4cce-a508-57857550ba88 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:35.241723 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576933f-d64e-4dcf-a7ad-9dc075ff83c2 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:35.242454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576933f-d64e-4dcf-a7ad-9dc075ff83c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:35.243188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576933f-d64e-4dcf-a7ad-9dc075ff83c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:35.267197 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576933f-d64e-4dcf-a7ad-9dc075ff83c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:35.270557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576933f-d64e-4dcf-a7ad-9dc075ff83c2 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:35.303939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-1576933f-d64e-4dcf-a7ad-9dc075ff83c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:35.303939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:35.303939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:35.303939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:35.303939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:35.303939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:35.303939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:35.303939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:35.303939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:35.303939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:35.303939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:35.303939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:35.303939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:35.303939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:35.303939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:35.305761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:35.305761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:35.305761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:35.305761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:35.305761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:35.305761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:35.305761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:35.305761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:35.305761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:35.305761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:35.305761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:35.305761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:35.305761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:35.305761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:35.305761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:35.305761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:35.305761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:35.307622 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:35.307622 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:35.307622 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:35.307622 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:35.312468 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 454/890] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:35.326326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576933f-d64e-4dcf-a7ad-9dc075ff83c2 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:35.372690 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8942c-0b43-4cce-a508-57857550ba88 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:35.423314 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621eebb-ca7f-4c5f-8aa5-dfc8eaf1c207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:35.424408 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621eebb-ca7f-4c5f-8aa5-dfc8eaf1c207 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:35.424689 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621eebb-ca7f-4c5f-8aa5-dfc8eaf1c207 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:35.424959 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621eebb-ca7f-4c5f-8aa5-dfc8eaf1c207 None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:35.426002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621eebb-ca7f-4c5f-8aa5-dfc8eaf1c207 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:35.426343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621eebb-ca7f-4c5f-8aa5-dfc8eaf1c207 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:35.427974 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621eebb-ca7f-4c5f-8aa5-dfc8eaf1c207 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:35.438354 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 437/891] 10.222.0.32 () {56 vars in 1114 bytes} [Tue May 10 13:48:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:35.441911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621eebb-ca7f-4c5f-8aa5-dfc8eaf1c207 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:35.486126 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576933f-d64e-4dcf-a7ad-9dc075ff83c2 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:35.538880 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b1c50-d33f-4074-86c9-1b3f6838c231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:35.539598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b1c50-d33f-4074-86c9-1b3f6838c231 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:35.540013 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b1c50-d33f-4074-86c9-1b3f6838c231 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:35.540168 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b1c50-d33f-4074-86c9-1b3f6838c231 None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:35.540934 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b1c50-d33f-4074-86c9-1b3f6838c231 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:35.541253 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b1c50-d33f-4074-86c9-1b3f6838c231 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:35.542826 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b1c50-d33f-4074-86c9-1b3f6838c231 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:35.562230 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 455/892] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:35.563269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b1c50-d33f-4074-86c9-1b3f6838c231 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:35.622923 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621eebb-ca7f-4c5f-8aa5-dfc8eaf1c207 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:35.660625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd19ab-d164-427f-9cf8-b6c120f17355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:35.661667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd19ab-d164-427f-9cf8-b6c120f17355 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:35.662178 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd19ab-d164-427f-9cf8-b6c120f17355 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:35.662673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd19ab-d164-427f-9cf8-b6c120f17355 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:35.663682 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd19ab-d164-427f-9cf8-b6c120f17355 None admin] RBAC: Adding query filter params (interface=public, service_id=6ca0762be8ec4d3885db596359120f12, region_id=RegionOne) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:35.664190 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd19ab-d164-427f-9cf8-b6c120f17355 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:35.665778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd19ab-d164-427f-9cf8-b6c120f17355 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:35.676433 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 438/893] 10.222.0.32 () {56 vars in 1251 bytes} [Tue May 10 13:48:35 2022] GET /identity/v3/endpoints?service_id=6ca0762be8ec4d3885db596359120f12&interface=public®ion_id=RegionOne => generated 194 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:35.678143 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd19ab-d164-427f-9cf8-b6c120f17355 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:35.759911 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b1c50-d33f-4074-86c9-1b3f6838c231 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:35.788892 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd19ab-d164-427f-9cf8-b6c120f17355 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:35.806341 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88fc84-5ae8-4792-8c18-ffa063a4ac6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:35.807499 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88fc84-5ae8-4792-8c18-ffa063a4ac6b None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:35.807969 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88fc84-5ae8-4792-8c18-ffa063a4ac6b None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:35.808455 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88fc84-5ae8-4792-8c18-ffa063a4ac6b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:35.817633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88fc84-5ae8-4792-8c18-ffa063a4ac6b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:35.819440 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88fc84-5ae8-4792-8c18-ffa063a4ac6b None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:35.827593 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567812b-1c3f-434b-8360-3d1c0877e4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:35.829005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567812b-1c3f-434b-8360-3d1c0877e4c0 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:35.829511 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567812b-1c3f-434b-8360-3d1c0877e4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:35.829988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567812b-1c3f-434b-8360-3d1c0877e4c0 None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:35.831134 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567812b-1c3f-434b-8360-3d1c0877e4c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:35.837049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-7f88fc84-5ae8-4792-8c18-ffa063a4ac6b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:48:35.837049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:35.837049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:35.837049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:35.837049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:35.837049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:35.837049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:35.837049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:35.837049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:35.837049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:35.837049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:35.837049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:35.837049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:48:35.837049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:48:35.837049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:48:35.837049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:48:35.838041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:35.838041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:35.838041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:35.838041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:35.838041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:35.838041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:35.838041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:35.838041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:35.838041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:35.838041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:35.838041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:35.838041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:35.838041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:35.838041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:35.838041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:35.838041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:35.838041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:35.838041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:35.839553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:35.839553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:35.839553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:48:35.839553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:48:35.839553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:48:35.839553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:48:35.839553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:48:35.839553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:48:35.839553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:48:35.839553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:35.841829 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567812b-1c3f-434b-8360-3d1c0877e4c0 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:35.843269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 456/894] 10.222.0.32 () {56 vars in 1117 bytes} [Tue May 10 13:48:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:35.844246 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88fc84-5ae8-4792-8c18-ffa063a4ac6b None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:35.858947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 439/895] 10.222.0.32 () {56 vars in 1087 bytes} [Tue May 10 13:48:35 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:48:35.971343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88fc84-5ae8-4792-8c18-ffa063a4ac6b None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:36.012426 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0000a6-f56f-4b09-a1e3-d0a1b11607a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:36.013350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0000a6-f56f-4b09-a1e3-d0a1b11607a7 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:36.013638 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0000a6-f56f-4b09-a1e3-d0a1b11607a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:36.013945 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0000a6-f56f-4b09-a1e3-d0a1b11607a7 None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:36.015002 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0000a6-f56f-4b09-a1e3-d0a1b11607a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:36.015313 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0000a6-f56f-4b09-a1e3-d0a1b11607a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:36.017176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0000a6-f56f-4b09-a1e3-d0a1b11607a7 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:36.040340 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 457/896] 10.222.0.32 () {56 vars in 1149 bytes} [Tue May 10 13:48:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:36.047719 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567812b-1c3f-434b-8360-3d1c0877e4c0 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:36.164801 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567812b-1c3f-434b-8360-3d1c0877e4c0 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:36.201382 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaee5ae-6b36-46c8-bddb-277cb7d3e36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:36.202040 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaee5ae-6b36-46c8-bddb-277cb7d3e36a None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:36.202355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaee5ae-6b36-46c8-bddb-277cb7d3e36a None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:36.202629 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaee5ae-6b36-46c8-bddb-277cb7d3e36a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:36.278481 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaee5ae-6b36-46c8-bddb-277cb7d3e36a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:36.280283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaee5ae-6b36-46c8-bddb-277cb7d3e36a None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:36.392821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 440/897] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:48:36 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 13:48:36.398390 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0000a6-f56f-4b09-a1e3-d0a1b11607a7 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:36.510085 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0000a6-f56f-4b09-a1e3-d0a1b11607a7 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:36.550162 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9a7bc-8823-4a5b-9efb-1cc47964fb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:36.550916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9a7bc-8823-4a5b-9efb-1cc47964fb30 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:36.551195 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9a7bc-8823-4a5b-9efb-1cc47964fb30 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:36.551471 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9a7bc-8823-4a5b-9efb-1cc47964fb30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:36.563443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9a7bc-8823-4a5b-9efb-1cc47964fb30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:36.564912 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9a7bc-8823-4a5b-9efb-1cc47964fb30 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:36.579732 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870476e2-b10c-4969-b9ea-783947ef6a50 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:36.580150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870476e2-b10c-4969-b9ea-783947ef6a50 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:36.580310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870476e2-b10c-4969-b9ea-783947ef6a50 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:36.581908 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 441/898] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:36.584004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-09e9a7bc-8823-4a5b-9efb-1cc47964fb30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:36.584004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:36.584004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:36.584004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:36.584004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:36.584004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:36.584004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:36.584004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:36.584004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:36.584004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:36.584004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:36.584004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:36.584004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:36.584004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:36.584004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:36.586243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:36.586243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:36.586243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:36.586243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:36.586243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:36.586243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:36.586243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:36.586243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:36.586243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:36.586243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:36.586243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:36.586243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:36.586243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:36.586243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:36.586243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:36.586243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:36.586243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:36.589651 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:36.589651 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:36.589651 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:36.589651 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:36.589651 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 458/899] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:36.594931 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca52b42-1010-41e7-ae97-a1ae541f9f7b None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:36.594931 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca52b42-1010-41e7-ae97-a1ae541f9f7b None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:36.594931 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca52b42-1010-41e7-ae97-a1ae541f9f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:36.596653 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9a7bc-8823-4a5b-9efb-1cc47964fb30 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:36.608917 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-eca52b42-1010-41e7-ae97-a1ae541f9f7b None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:36.610275 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-eca52b42-1010-41e7-ae97-a1ae541f9f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:36.710906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9a7bc-8823-4a5b-9efb-1cc47964fb30 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:36.734474 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 442/900] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:36.757223 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca52b42-1010-41e7-ae97-a1ae541f9f7b None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:36.761384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb890f-8534-4bc4-8e69-4478930ab840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:36.763482 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb890f-8534-4bc4-8e69-4478930ab840 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:36.764002 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb890f-8534-4bc4-8e69-4478930ab840 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:36.764474 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb890f-8534-4bc4-8e69-4478930ab840 None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:36.765425 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb890f-8534-4bc4-8e69-4478930ab840 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:36.765929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb890f-8534-4bc4-8e69-4478930ab840 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:36.767561 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb890f-8534-4bc4-8e69-4478930ab840 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:36.781542 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 459/901] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:36.786838 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb890f-8534-4bc4-8e69-4478930ab840 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:36.928353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb890f-8534-4bc4-8e69-4478930ab840 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:36.931865 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca52b42-1010-41e7-ae97-a1ae541f9f7b None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:36.976020 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e2285-d5ef-4ef2-a497-97be62a9ba4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:36.976847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e2285-d5ef-4ef2-a497-97be62a9ba4b None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:36.977128 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e2285-d5ef-4ef2-a497-97be62a9ba4b None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:36.977406 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e2285-d5ef-4ef2-a497-97be62a9ba4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:36.987236 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e2285-d5ef-4ef2-a497-97be62a9ba4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:36.988603 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d165c3-b34e-4e09-8aff-496986bda852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:36.988763 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e2285-d5ef-4ef2-a497-97be62a9ba4b None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:36.990055 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d165c3-b34e-4e09-8aff-496986bda852 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:36.990682 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d165c3-b34e-4e09-8aff-496986bda852 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:36.991175 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d165c3-b34e-4e09-8aff-496986bda852 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:36.992336 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d165c3-b34e-4e09-8aff-496986bda852 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:36.994584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d165c3-b34e-4e09-8aff-496986bda852 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:37.005269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-1d0e2285-d5ef-4ef2-a497-97be62a9ba4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:37.005269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:37.005269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:37.005269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:37.005269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:37.005269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:37.005269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:37.005269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:37.005269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:37.005269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:37.005269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:37.005269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:37.005269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:37.005269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:37.005269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:37.006879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:37.006879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:37.006879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:37.006879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:37.006879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:37.006879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:37.006879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:37.006879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:37.006879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:37.006879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:37.006879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:37.006879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:37.006879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:37.006879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:37.006879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:37.006879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:37.006879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:37.007937 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:37.007937 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:37.007937 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:37.007937 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:37.007937 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:37.007937 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:37.007937 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:37.007937 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:37.011365 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 460/902] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:37.012770 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e2285-d5ef-4ef2-a497-97be62a9ba4b None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:37.014486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-64d165c3-b34e-4e09-8aff-496986bda852 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 13:48:37.014486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:37.014486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:48:37.014486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:48:37.014486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:48:37.014486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:48:37.014486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:48:37.014486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:37.014486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 13:48:37.014486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:37.014486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:37.014486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:37.014486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:37.014486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:37.014486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:37.014486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:37.015395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:37.015395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:37.015395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:37.015395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:37.015395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:37.015395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:37.015395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:37.015395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:48:37.015395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:48:37.015395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:48:37.015395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:48:37.015395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:37.015395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:37.015395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:37.015395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:37.015395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:37.016213 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:37.016213 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:37.016213 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:37.016213 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:37.016213 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:37.016213 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:37.016213 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:37.016213 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:37.016213 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:37.016213 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:37.016213 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:37.016213 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:48:37.016213 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:37.016213 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 13:48:37.016213 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:37.019111 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 443/903] 10.222.0.32 () {56 vars in 1132 bytes} [Tue May 10 13:48:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:37.024761 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d165c3-b34e-4e09-8aff-496986bda852 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:37.168965 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e2285-d5ef-4ef2-a497-97be62a9ba4b None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:37.212576 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d165c3-b34e-4e09-8aff-496986bda852 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:37.242884 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ece308-0b6b-42f1-87e2-c3a3f4aa5eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:37.243573 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ece308-0b6b-42f1-87e2-c3a3f4aa5eb5 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:37.243860 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ece308-0b6b-42f1-87e2-c3a3f4aa5eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:37.244135 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ece308-0b6b-42f1-87e2-c3a3f4aa5eb5 None admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:37.245145 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ece308-0b6b-42f1-87e2-c3a3f4aa5eb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:37.245849 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ece308-0b6b-42f1-87e2-c3a3f4aa5eb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:37.248804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ece308-0b6b-42f1-87e2-c3a3f4aa5eb5 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:37.258573 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca27c9-96ef-4be9-80bd-bdab1abece5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:37.259632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca27c9-96ef-4be9-80bd-bdab1abece5e None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:37.260120 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca27c9-96ef-4be9-80bd-bdab1abece5e None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:37.260594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca27c9-96ef-4be9-80bd-bdab1abece5e None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:37.261548 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca27c9-96ef-4be9-80bd-bdab1abece5e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:37.262159 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca27c9-96ef-4be9-80bd-bdab1abece5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:37.263833 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca27c9-96ef-4be9-80bd-bdab1abece5e None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:37.266293 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 461/904] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:48:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:37.270852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ece308-0b6b-42f1-87e2-c3a3f4aa5eb5 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:37.274388 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 444/905] 10.222.0.32 () {56 vars in 1126 bytes} [Tue May 10 13:48:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:37.282787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca27c9-96ef-4be9-80bd-bdab1abece5e None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:37.409437 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca27c9-96ef-4be9-80bd-bdab1abece5e None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:37.431460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ece308-0b6b-42f1-87e2-c3a3f4aa5eb5 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:37.446147 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7eedf-8a83-4dfa-9404-7b6730d8de2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:37.446859 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7eedf-8a83-4dfa-9404-7b6730d8de2e None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:37.447135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7eedf-8a83-4dfa-9404-7b6730d8de2e None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:37.447409 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7eedf-8a83-4dfa-9404-7b6730d8de2e None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:37.448128 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7eedf-8a83-4dfa-9404-7b6730d8de2e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:37.448429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7eedf-8a83-4dfa-9404-7b6730d8de2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:37.450069 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7eedf-8a83-4dfa-9404-7b6730d8de2e None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:37.460653 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 445/906] 10.222.0.32 () {56 vars in 1126 bytes} [Tue May 10 13:48:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:37.460653 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecec75-cf3c-4d62-9157-041cb12c1043 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:37.460653 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecec75-cf3c-4d62-9157-041cb12c1043 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:37.460653 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecec75-cf3c-4d62-9157-041cb12c1043 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:37.460653 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 446/907] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:37.462889 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecec75-cf3c-4d62-9157-041cb12c1043 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:37.477330 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca65c83-b45d-43f5-8c95-27488a83caaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:37.478087 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca65c83-b45d-43f5-8c95-27488a83caaf None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:37.478434 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca65c83-b45d-43f5-8c95-27488a83caaf None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:37.478686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca65c83-b45d-43f5-8c95-27488a83caaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:37.479542 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca65c83-b45d-43f5-8c95-27488a83caaf None admin] RBAC: Adding query filter params (role.id=d4565519f0024088b8818c0f36bc4822, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=686c869be43c40a9b63b3647bf689c7a) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:37.479850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca65c83-b45d-43f5-8c95-27488a83caaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:37.483285 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca65c83-b45d-43f5-8c95-27488a83caaf None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:37.488831 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 462/908] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:48:37 2022] GET /identity/v3/role_assignments?user.id=686c869be43c40a9b63b3647bf689c7a&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=d4565519f0024088b8818c0f36bc4822 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:37.492528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf89b7-e490-425e-ab6d-b6a781de91b0 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:37.492528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf89b7-e490-425e-ab6d-b6a781de91b0 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:37.492528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf89b7-e490-425e-ab6d-b6a781de91b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:37.511884 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-efcf89b7-e490-425e-ab6d-b6a781de91b0 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:37.513804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-efcf89b7-e490-425e-ab6d-b6a781de91b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:37.610684 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 463/909] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:37.634306 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf89b7-e490-425e-ab6d-b6a781de91b0 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:37.667197 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecec75-cf3c-4d62-9157-041cb12c1043 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:37.730149 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc464a5-bcc4-48f6-8624-6c72d2b2da58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:37.731737 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc464a5-bcc4-48f6-8624-6c72d2b2da58 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:37.732049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc464a5-bcc4-48f6-8624-6c72d2b2da58 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:37.732765 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc464a5-bcc4-48f6-8624-6c72d2b2da58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:37.733876 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc464a5-bcc4-48f6-8624-6c72d2b2da58 None admin] RBAC: Adding query filter params (interface=public, service_id=b0e25d2c55764e78a452aa3038b60f36, region_id=RegionOne) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:37.734238 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc464a5-bcc4-48f6-8624-6c72d2b2da58 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:37.736123 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc464a5-bcc4-48f6-8624-6c72d2b2da58 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:37.745402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 447/910] 10.222.0.32 () {56 vars in 1251 bytes} [Tue May 10 13:48:37 2022] GET /identity/v3/endpoints?service_id=b0e25d2c55764e78a452aa3038b60f36&interface=public®ion_id=RegionOne => generated 194 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:37.757501 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc464a5-bcc4-48f6-8624-6c72d2b2da58 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:37.762518 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf89b7-e490-425e-ab6d-b6a781de91b0 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:37.824052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e7b2c-f188-4fae-b574-9a40f55ee684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:37.826391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e7b2c-f188-4fae-b574-9a40f55ee684 None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:37.826972 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e7b2c-f188-4fae-b574-9a40f55ee684 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:37.827460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e7b2c-f188-4fae-b574-9a40f55ee684 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:37.828468 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e7b2c-f188-4fae-b574-9a40f55ee684 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:37.830129 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e7b2c-f188-4fae-b574-9a40f55ee684 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:37.864399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 464/911] 10.222.0.32 () {60 vars in 1141 bytes} [Tue May 10 13:48:37 2022] POST /identity/v3/services => generated 241 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:48:37.929226 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc464a5-bcc4-48f6-8624-6c72d2b2da58 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:37.977278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1771f17-5bc0-4d3d-b526-d14a45830e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:37.978077 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1771f17-5bc0-4d3d-b526-d14a45830e05 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:37.978396 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1771f17-5bc0-4d3d-b526-d14a45830e05 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:37.978667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1771f17-5bc0-4d3d-b526-d14a45830e05 None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:37.979381 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1771f17-5bc0-4d3d-b526-d14a45830e05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:37.981747 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1771f17-5bc0-4d3d-b526-d14a45830e05 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:37.990481 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 448/912] 10.222.0.32 () {56 vars in 1087 bytes} [Tue May 10 13:48:37 2022] GET /identity/v3/services => generated 1497 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 13:48:38.354558 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f8788-b2b7-414f-85e0-f56e417bf1ea None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:38.354987 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f8788-b2b7-414f-85e0-f56e417bf1ea None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:38.355100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f8788-b2b7-414f-85e0-f56e417bf1ea None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:38.357049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 465/913] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:38.363478 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51343c09-1635-4e40-b82a-a4787bfac65e None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:38.363774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51343c09-1635-4e40-b82a-a4787bfac65e None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:38.364026 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51343c09-1635-4e40-b82a-a4787bfac65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:38.383014 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-51343c09-1635-4e40-b82a-a4787bfac65e None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:38.384228 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-51343c09-1635-4e40-b82a-a4787bfac65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:38.458049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 449/914] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:38.480217 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f8788-b2b7-414f-85e0-f56e417bf1ea None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:38.591619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f8788-b2b7-414f-85e0-f56e417bf1ea None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:38.629272 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb168c-324c-4b0e-bb25-94815cb25527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:38.630104 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb168c-324c-4b0e-bb25-94815cb25527 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:38.630418 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb168c-324c-4b0e-bb25-94815cb25527 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:38.630700 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb168c-324c-4b0e-bb25-94815cb25527 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:38.631367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb168c-324c-4b0e-bb25-94815cb25527 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:38.632749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb168c-324c-4b0e-bb25-94815cb25527 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:38.645176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-b4eb168c-324c-4b0e-bb25-94815cb25527 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 13:48:38.645176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:38.645176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:48:38.645176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:48:38.645176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:48:38.645176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:48:38.645176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:48:38.645176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:38.645176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 13:48:38.645176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:38.645176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:38.645176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:38.645176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:38.645176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:38.645176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:38.645176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:38.645176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:38.647557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:38.647557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:38.647557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:38.647557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:38.647557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:38.647557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:38.647557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:48:38.647557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:48:38.647557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:48:38.647557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:48:38.647557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:38.647557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:38.647557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:38.647557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:38.647557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:38.647557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:38.649496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:38.649496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:38.649496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:38.649496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:38.649496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:38.649496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:38.649496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:38.649496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:38.649496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:38.649496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:38.649496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:48:38.649496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:38.649496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 13:48:38.649496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:38.649496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 466/915] 10.222.0.32 () {56 vars in 1114 bytes} [Tue May 10 13:48:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:38.655532 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51343c09-1635-4e40-b82a-a4787bfac65e None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:38.765537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51343c09-1635-4e40-b82a-a4787bfac65e None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:38.804485 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9e1c1-e0da-4218-a278-ec68d98f8c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:38.805174 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9e1c1-e0da-4218-a278-ec68d98f8c2b None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:38.805455 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9e1c1-e0da-4218-a278-ec68d98f8c2b None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:38.805731 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9e1c1-e0da-4218-a278-ec68d98f8c2b None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:38.806482 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9e1c1-e0da-4218-a278-ec68d98f8c2b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:38.806789 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9e1c1-e0da-4218-a278-ec68d98f8c2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:38.808182 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9e1c1-e0da-4218-a278-ec68d98f8c2b None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:38.814158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 450/916] 10.222.0.32 () {56 vars in 1114 bytes} [Tue May 10 13:48:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:38.828414 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb168c-324c-4b0e-bb25-94815cb25527 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:38.966271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb168c-324c-4b0e-bb25-94815cb25527 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:39.005216 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147c7b7-4564-46a0-bc0e-b0e62d8bd765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:39.005911 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147c7b7-4564-46a0-bc0e-b0e62d8bd765 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:39.006214 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147c7b7-4564-46a0-bc0e-b0e62d8bd765 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:39.006504 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147c7b7-4564-46a0-bc0e-b0e62d8bd765 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:39.007237 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147c7b7-4564-46a0-bc0e-b0e62d8bd765 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:39.007545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147c7b7-4564-46a0-bc0e-b0e62d8bd765 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:39.008949 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147c7b7-4564-46a0-bc0e-b0e62d8bd765 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:39.015437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 467/917] 10.222.0.32 () {56 vars in 1114 bytes} [Tue May 10 13:48:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:39.021254 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9e1c1-e0da-4218-a278-ec68d98f8c2b None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:39.181436 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9e1c1-e0da-4218-a278-ec68d98f8c2b None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:39.233073 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e5769-c5ed-4b89-9f1c-d1229f15e342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:39.234131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e5769-c5ed-4b89-9f1c-d1229f15e342 None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:39.234674 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e5769-c5ed-4b89-9f1c-d1229f15e342 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:39.235170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e5769-c5ed-4b89-9f1c-d1229f15e342 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:39.236624 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e5769-c5ed-4b89-9f1c-d1229f15e342 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:39.239125 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e5769-c5ed-4b89-9f1c-d1229f15e342 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:39.276264 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 451/918] 10.222.0.32 () {60 vars in 1144 bytes} [Tue May 10 13:48:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:48:40.052745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3d603-8305-42eb-aeb6-a8f15cfb10cd None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:40.052745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3d603-8305-42eb-aeb6-a8f15cfb10cd None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:40.052745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3d603-8305-42eb-aeb6-a8f15cfb10cd None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:40.053741 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 468/919] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:40.060815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1e5e4-4f1b-49c7-ae92-d856486c2fac None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:40.062030 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1e5e4-4f1b-49c7-ae92-d856486c2fac None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:40.062030 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1e5e4-4f1b-49c7-ae92-d856486c2fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:40.081148 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-17e1e5e4-4f1b-49c7-ae92-d856486c2fac None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:40.082706 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-17e1e5e4-4f1b-49c7-ae92-d856486c2fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:40.210821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 452/920] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:48:40.252501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3d603-8305-42eb-aeb6-a8f15cfb10cd None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:40.293022 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd8b28-84bd-41ff-bb9d-acfe21809437 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:40.294218 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd8b28-84bd-41ff-bb9d-acfe21809437 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:40.294720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd8b28-84bd-41ff-bb9d-acfe21809437 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:40.298002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 453/921] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:48:40.302958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615e062-b3a8-4334-8859-9865eb244dfc None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:40.303583 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615e062-b3a8-4334-8859-9865eb244dfc None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:40.304056 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615e062-b3a8-4334-8859-9865eb244dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:40.330490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-d615e062-b3a8-4334-8859-9865eb244dfc None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:40.333366 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-d615e062-b3a8-4334-8859-9865eb244dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:40.424487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3d603-8305-42eb-aeb6-a8f15cfb10cd None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:40.460137 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed11858-41f0-4972-a7ef-fc7afb2bb781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:40.461396 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed11858-41f0-4972-a7ef-fc7afb2bb781 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:40.461874 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed11858-41f0-4972-a7ef-fc7afb2bb781 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:40.462403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed11858-41f0-4972-a7ef-fc7afb2bb781 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:40.467313 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 454/922] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:48:40.483690 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed11858-41f0-4972-a7ef-fc7afb2bb781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:40.490123 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615e062-b3a8-4334-8859-9865eb244dfc None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:40.503782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-3ed11858-41f0-4972-a7ef-fc7afb2bb781 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:48:40.503782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:40.503782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:40.503782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:40.503782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:40.503782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:40.503782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:40.503782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:40.503782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:40.503782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:40.503782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:40.503782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:40.503782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:40.503782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:40.503782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:40.503782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:40.504791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:40.504791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:40.504791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:40.504791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:40.504791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:40.504791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:40.504791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:40.504791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:40.504791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:40.504791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:40.504791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:40.504791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:40.504791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:40.504791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:40.504791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:40.504791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:40.506035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:40.506035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:40.506035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:40.506035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:40.506035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:40.506035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:40.506035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:40.506035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:40.506035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:40.506035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:40.506035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:48:40.506035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:40.506035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 469/923] 10.222.0.32 () {56 vars in 1120 bytes} [Tue May 10 13:48:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:40.511628 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed11858-41f0-4972-a7ef-fc7afb2bb781 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:40.608009 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615e062-b3a8-4334-8859-9865eb244dfc None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:40.635334 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed11858-41f0-4972-a7ef-fc7afb2bb781 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:40.647155 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f6547-3843-4011-9f79-a3055c107fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:40.648002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f6547-3843-4011-9f79-a3055c107fce None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:40.648279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f6547-3843-4011-9f79-a3055c107fce None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:40.648552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f6547-3843-4011-9f79-a3055c107fce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:40.649241 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f6547-3843-4011-9f79-a3055c107fce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:40.650744 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f6547-3843-4011-9f79-a3055c107fce None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:40.663425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-a33f6547-3843-4011-9f79-a3055c107fce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:48:40.663425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:40.663425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:48:40.663425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:48:40.663425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:48:40.663425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:48:40.663425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:48:40.663425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:40.663425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:48:40.663425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:40.663425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:40.663425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:40.663425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:40.663425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:40.663425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:40.663425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:40.663425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:40.664571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:40.664571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:40.664571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:40.664571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:40.664571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:40.664571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:40.664571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:48:40.664571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:48:40.664571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:48:40.664571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:48:40.664571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:40.664571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:40.664571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:40.664571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:40.664571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:40.664571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:40.665397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:40.665397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:40.665397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:40.665397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:40.665397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:40.665397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:40.665397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:40.665397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:40.665397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:40.665397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:40.665397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:48:40.665397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:40.665397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:48:40.665397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:40.665397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 455/924] 10.222.0.32 () {56 vars in 1126 bytes} [Tue May 10 13:48:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:40.666716 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9c796-33ba-4bb8-946e-c9e52e44c935 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:40.666716 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9c796-33ba-4bb8-946e-c9e52e44c935 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:40.666889 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9c796-33ba-4bb8-946e-c9e52e44c935 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:40.668941 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 456/925] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:40.673597 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9c796-33ba-4bb8-946e-c9e52e44c935 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:40.681785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ceca1a-4f73-4337-9e44-fd5eaccf8b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:40.682498 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ceca1a-4f73-4337-9e44-fd5eaccf8b24 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:40.682783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ceca1a-4f73-4337-9e44-fd5eaccf8b24 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:40.683079 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ceca1a-4f73-4337-9e44-fd5eaccf8b24 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:40.684575 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ceca1a-4f73-4337-9e44-fd5eaccf8b24 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:40.684885 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ceca1a-4f73-4337-9e44-fd5eaccf8b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:40.686300 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ceca1a-4f73-4337-9e44-fd5eaccf8b24 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:40.696276 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 470/926] 10.222.0.32 () {56 vars in 1115 bytes} [Tue May 10 13:48:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:40.697594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b09a97-c75b-4ac8-91bf-674c8126a39e None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:40.697887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b09a97-c75b-4ac8-91bf-674c8126a39e None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:40.698155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b09a97-c75b-4ac8-91bf-674c8126a39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:40.725772 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-22b09a97-c75b-4ac8-91bf-674c8126a39e None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:40.726925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-22b09a97-c75b-4ac8-91bf-674c8126a39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:40.813993 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 471/927] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:40.815443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b09a97-c75b-4ac8-91bf-674c8126a39e None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:40.828249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9c796-33ba-4bb8-946e-c9e52e44c935 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:40.877869 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033cbfb-5adb-40b6-b5ea-a30bf1f792cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:40.879013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033cbfb-5adb-40b6-b5ea-a30bf1f792cc None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:40.879515 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033cbfb-5adb-40b6-b5ea-a30bf1f792cc None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:40.879993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033cbfb-5adb-40b6-b5ea-a30bf1f792cc None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:40.881301 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033cbfb-5adb-40b6-b5ea-a30bf1f792cc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:40.882556 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033cbfb-5adb-40b6-b5ea-a30bf1f792cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:40.886120 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033cbfb-5adb-40b6-b5ea-a30bf1f792cc None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:40.895282 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 457/928] 10.222.0.32 () {56 vars in 1122 bytes} [Tue May 10 13:48:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:40.896199 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033cbfb-5adb-40b6-b5ea-a30bf1f792cc None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:40.955466 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b09a97-c75b-4ac8-91bf-674c8126a39e None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:40.990664 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c4215-766a-45cc-b9f3-15fb7d989494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:40.991406 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c4215-766a-45cc-b9f3-15fb7d989494 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:40.991691 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c4215-766a-45cc-b9f3-15fb7d989494 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:40.991969 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c4215-766a-45cc-b9f3-15fb7d989494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:41.004301 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c4215-766a-45cc-b9f3-15fb7d989494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:41.006226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c4215-766a-45cc-b9f3-15fb7d989494 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:41.009785 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033cbfb-5adb-40b6-b5ea-a30bf1f792cc None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:41.025727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-5b6c4215-766a-45cc-b9f3-15fb7d989494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:41.025727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:41.025727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:41.025727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:41.025727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:41.025727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:41.025727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:41.025727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:41.025727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:41.025727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:41.025727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:41.025727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:41.025727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:41.025727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:41.025727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:41.026808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:41.026808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:41.026808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:41.026808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:41.026808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:41.026808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:41.026808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:41.026808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:41.026808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:41.026808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:41.026808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:41.026808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:41.026808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:41.026808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:41.026808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:41.026808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:41.026808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:41.028559 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:41.028559 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:41.028559 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:41.028559 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:41.032370 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 472/929] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:41.033007 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c4215-766a-45cc-b9f3-15fb7d989494 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:41.050314 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e30c2-53ef-45d4-8e4f-34f3f46511a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:41.051143 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e30c2-53ef-45d4-8e4f-34f3f46511a1 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:41.051423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e30c2-53ef-45d4-8e4f-34f3f46511a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:41.051693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e30c2-53ef-45d4-8e4f-34f3f46511a1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:41.052354 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e30c2-53ef-45d4-8e4f-34f3f46511a1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:41.053735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e30c2-53ef-45d4-8e4f-34f3f46511a1 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:41.066922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-893e30c2-53ef-45d4-8e4f-34f3f46511a1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 13:48:41.066922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:41.066922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:48:41.066922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:48:41.066922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:48:41.066922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:48:41.066922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:48:41.066922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:41.066922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 13:48:41.066922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:41.066922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:41.066922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:41.066922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:41.066922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:41.066922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:41.066922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:41.068372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:41.068372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:41.068372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:41.068372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:41.068372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:41.068372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:41.068372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:41.068372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:48:41.068372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:48:41.068372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:48:41.068372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:48:41.068372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:41.068372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:41.068372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:41.068372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:41.068372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:41.069195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:41.069195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:41.069195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:41.069195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:41.069195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:41.069195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:41.069195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:41.069195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:41.069195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:41.069195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:41.069195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:41.069195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:48:41.069195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:41.069195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 13:48:41.069195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:41.069195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 458/930] 10.222.0.32 () {56 vars in 1132 bytes} [Tue May 10 13:48:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:41.070020 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e30c2-53ef-45d4-8e4f-34f3f46511a1 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:41.154497 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c4215-766a-45cc-b9f3-15fb7d989494 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:41.177613 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e30c2-53ef-45d4-8e4f-34f3f46511a1 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:41.192071 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acd64d-9fc7-4516-a92c-c72aa73fa005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:41.192773 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acd64d-9fc7-4516-a92c-c72aa73fa005 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:41.193028 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acd64d-9fc7-4516-a92c-c72aa73fa005 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:41.193300 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acd64d-9fc7-4516-a92c-c72aa73fa005 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:41.194018 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acd64d-9fc7-4516-a92c-c72aa73fa005 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:41.194351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acd64d-9fc7-4516-a92c-c72aa73fa005 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:41.195739 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acd64d-9fc7-4516-a92c-c72aa73fa005 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:41.211837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 473/931] 10.222.0.32 () {56 vars in 1122 bytes} [Tue May 10 13:48:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:41.211837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acd64d-9fc7-4516-a92c-c72aa73fa005 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:41.231619 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2503e-574b-4da0-b784-f35e712ee245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:41.232548 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2503e-574b-4da0-b784-f35e712ee245 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:41.232824 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2503e-574b-4da0-b784-f35e712ee245 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:41.233084 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2503e-574b-4da0-b784-f35e712ee245 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:41.233965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2503e-574b-4da0-b784-f35e712ee245 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:41.234192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2503e-574b-4da0-b784-f35e712ee245 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:41.234192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2503e-574b-4da0-b784-f35e712ee245 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:41.249925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 459/932] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:41.250594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2503e-574b-4da0-b784-f35e712ee245 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:41.340430 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acd64d-9fc7-4516-a92c-c72aa73fa005 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:41.386175 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2503e-574b-4da0-b784-f35e712ee245 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:41.394520 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4720e0-8190-4073-afdd-3b091d070e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:41.395578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4720e0-8190-4073-afdd-3b091d070e1f None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:41.396027 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4720e0-8190-4073-afdd-3b091d070e1f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:41.396475 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4720e0-8190-4073-afdd-3b091d070e1f None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:41.397711 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4720e0-8190-4073-afdd-3b091d070e1f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:41.398226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4720e0-8190-4073-afdd-3b091d070e1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:41.400250 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4720e0-8190-4073-afdd-3b091d070e1f None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:41.408300 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 474/933] 10.222.0.32 () {56 vars in 1126 bytes} [Tue May 10 13:48:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:41.410236 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4720e0-8190-4073-afdd-3b091d070e1f None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:41.435700 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd50236-4020-402f-9999-f601f25e6220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:41.436369 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd50236-4020-402f-9999-f601f25e6220 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:41.436649 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd50236-4020-402f-9999-f601f25e6220 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:41.436914 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd50236-4020-402f-9999-f601f25e6220 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:41.437718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd50236-4020-402f-9999-f601f25e6220 None admin] RBAC: Adding query filter params (interface=public, service_id=ede42d9ba92945549805e1963385be3f, region_id=RegionOne) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:41.438029 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd50236-4020-402f-9999-f601f25e6220 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:41.439459 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd50236-4020-402f-9999-f601f25e6220 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:41.449907 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 460/934] 10.222.0.32 () {56 vars in 1251 bytes} [Tue May 10 13:48:41 2022] GET /identity/v3/endpoints?service_id=ede42d9ba92945549805e1963385be3f&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:41.449907 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd50236-4020-402f-9999-f601f25e6220 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:41.546614 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4720e0-8190-4073-afdd-3b091d070e1f None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:41.574041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd50236-4020-402f-9999-f601f25e6220 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:41.600150 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd1a04-32cc-41cf-b2a7-6d7bdaef06c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:41.601004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd1a04-32cc-41cf-b2a7-6d7bdaef06c6 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:41.601293 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd1a04-32cc-41cf-b2a7-6d7bdaef06c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:41.601570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd1a04-32cc-41cf-b2a7-6d7bdaef06c6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:41.610953 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd1a04-32cc-41cf-b2a7-6d7bdaef06c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:41.612491 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd1a04-32cc-41cf-b2a7-6d7bdaef06c6 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:41.629360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-e5fd1a04-32cc-41cf-b2a7-6d7bdaef06c6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:48:41.629360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:41.629360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:41.629360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:41.629360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:41.629360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:41.629360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:41.629360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:41.629360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:41.629360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:41.629360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:41.629360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:41.629360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:48:41.629360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:48:41.629360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:48:41.629360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:48:41.631219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:41.631219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:41.631219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:41.631219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:41.631219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:41.631219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:41.631219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:41.631219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:41.631219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:41.631219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:41.631219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:41.631219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:41.631219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:41.631219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:41.631219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:41.631219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:41.631219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:41.631219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:41.633148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:41.633148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:41.633148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:48:41.633148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:48:41.633148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:48:41.633148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:48:41.633148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:48:41.633148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:48:41.633148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:48:41.633148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:41.634294 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed18a0b-44dd-4d4c-92cc-aa99456316e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:41.634454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 475/935] 10.222.0.32 () {56 vars in 1117 bytes} [Tue May 10 13:48:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:41.634454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd1a04-32cc-41cf-b2a7-6d7bdaef06c6 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:41.635775 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed18a0b-44dd-4d4c-92cc-aa99456316e9 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:41.635775 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed18a0b-44dd-4d4c-92cc-aa99456316e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:41.635775 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed18a0b-44dd-4d4c-92cc-aa99456316e9 None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:41.636385 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed18a0b-44dd-4d4c-92cc-aa99456316e9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:41.636601 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed18a0b-44dd-4d4c-92cc-aa99456316e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:41.638879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed18a0b-44dd-4d4c-92cc-aa99456316e9 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:41.646606 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 461/936] 10.222.0.32 () {56 vars in 1126 bytes} [Tue May 10 13:48:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:41.647517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed18a0b-44dd-4d4c-92cc-aa99456316e9 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:41.762861 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd1a04-32cc-41cf-b2a7-6d7bdaef06c6 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:41.779678 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed18a0b-44dd-4d4c-92cc-aa99456316e9 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:41.801237 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61024c46-a72b-43ef-86ae-35487a6f17d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:41.801829 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61024c46-a72b-43ef-86ae-35487a6f17d8 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:41.802108 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61024c46-a72b-43ef-86ae-35487a6f17d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:41.802424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61024c46-a72b-43ef-86ae-35487a6f17d8 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:41.803109 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61024c46-a72b-43ef-86ae-35487a6f17d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:41.804506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61024c46-a72b-43ef-86ae-35487a6f17d8 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:41.815604 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 476/937] 10.222.0.32 () {56 vars in 1087 bytes} [Tue May 10 13:48:41 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:48:41.816744 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61024c46-a72b-43ef-86ae-35487a6f17d8 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:41.846136 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348aa5b3-03cd-415d-b970-da95a8bc8709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:41.847026 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348aa5b3-03cd-415d-b970-da95a8bc8709 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:41.847461 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348aa5b3-03cd-415d-b970-da95a8bc8709 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:41.847812 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348aa5b3-03cd-415d-b970-da95a8bc8709 None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:41.848772 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348aa5b3-03cd-415d-b970-da95a8bc8709 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:41.849134 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348aa5b3-03cd-415d-b970-da95a8bc8709 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:41.851067 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348aa5b3-03cd-415d-b970-da95a8bc8709 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:41.875542 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 462/938] 10.222.0.32 () {56 vars in 1149 bytes} [Tue May 10 13:48:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:41.878916 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2735557-2242-4a0d-979e-98e6fc5379a1 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:41.878916 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2735557-2242-4a0d-979e-98e6fc5379a1 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:41.878916 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2735557-2242-4a0d-979e-98e6fc5379a1 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:41.878916 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 463/939] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:41.882351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2735557-2242-4a0d-979e-98e6fc5379a1 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:41.950455 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61024c46-a72b-43ef-86ae-35487a6f17d8 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:41.988997 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008085a-155a-45e7-817f-04889507d5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:41.989683 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008085a-155a-45e7-817f-04889507d5fd None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:41.989967 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008085a-155a-45e7-817f-04889507d5fd None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:41.990272 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008085a-155a-45e7-817f-04889507d5fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:41.991044 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008085a-155a-45e7-817f-04889507d5fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:41.992455 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008085a-155a-45e7-817f-04889507d5fd None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:42.015874 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2735557-2242-4a0d-979e-98e6fc5379a1 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:42.021267 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 477/940] 10.222.0.32 () {60 vars in 1144 bytes} [Tue May 10 13:48:41 2022] POST /identity/v3/endpoints => generated 347 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:48:42.022647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9456-14e1-424f-b52e-da9f5eae5995 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:42.022950 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9456-14e1-424f-b52e-da9f5eae5995 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:42.023208 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9456-14e1-424f-b52e-da9f5eae5995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:42.048928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-4eac9456-14e1-424f-b52e-da9f5eae5995 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:42.051983 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-4eac9456-14e1-424f-b52e-da9f5eae5995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:42.084491 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db365f6-c299-4315-9fee-de5294334ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:42.085401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db365f6-c299-4315-9fee-de5294334ee5 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:42.085601 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db365f6-c299-4315-9fee-de5294334ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:42.086014 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db365f6-c299-4315-9fee-de5294334ee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:42.098088 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db365f6-c299-4315-9fee-de5294334ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:42.099641 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db365f6-c299-4315-9fee-de5294334ee5 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:42.120740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-8db365f6-c299-4315-9fee-de5294334ee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:42.120740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:42.120740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:42.120740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:42.120740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:42.120740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:42.120740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:42.120740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:42.120740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:42.120740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:42.120740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:42.120740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:42.120740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:42.120740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:42.120740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:42.122557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:42.122557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:42.122557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:42.122557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:42.122557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:42.122557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:42.122557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:42.122557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:42.122557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:42.122557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:42.122557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:42.122557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:42.122557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:42.122557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:42.122557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:42.122557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:42.122557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:42.123451 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:42.123451 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:42.123451 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:42.123451 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:42.125628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 464/941] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:42.130948 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db365f6-c299-4315-9fee-de5294334ee5 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:42.165020 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 478/942] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:42.190687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac9456-14e1-424f-b52e-da9f5eae5995 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:42.258131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db365f6-c299-4315-9fee-de5294334ee5 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:42.297718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a1f3e-4ba8-483b-aad7-3cb31b823ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:42.298425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a1f3e-4ba8-483b-aad7-3cb31b823ade None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:42.298709 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a1f3e-4ba8-483b-aad7-3cb31b823ade None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:42.298985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a1f3e-4ba8-483b-aad7-3cb31b823ade None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:42.299730 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a1f3e-4ba8-483b-aad7-3cb31b823ade None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:42.300035 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a1f3e-4ba8-483b-aad7-3cb31b823ade None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:42.301430 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a1f3e-4ba8-483b-aad7-3cb31b823ade None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:42.318899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 465/943] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:42.326517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a1f3e-4ba8-483b-aad7-3cb31b823ade None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:42.337411 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac9456-14e1-424f-b52e-da9f5eae5995 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:42.382671 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca46181-b38f-4e3b-8578-87f4ed889110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:42.383351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca46181-b38f-4e3b-8578-87f4ed889110 None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:42.383633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca46181-b38f-4e3b-8578-87f4ed889110 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:42.383933 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca46181-b38f-4e3b-8578-87f4ed889110 None admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:42.384603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca46181-b38f-4e3b-8578-87f4ed889110 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:42.386048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca46181-b38f-4e3b-8578-87f4ed889110 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:42.388005 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: WARNING keystone.server.flask.common [None req-bca46181-b38f-4e3b-8578-87f4ed889110 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 10 13:48:42.407381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.sql.core [None req-bca46181-b38f-4e3b-8578-87f4ed889110 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 13:48:42.407381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 13:48:42.407381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [parameters: {'id': '22b2013d75dc48e48ad58ee2ecb3a72c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 13:48:42.407381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79936) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 13:48:42.415483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-bca46181-b38f-4e3b-8578-87f4ed889110 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 22b2013d75dc48e48ad58ee2ecb3a72c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 22b2013d75dc48e48ad58ee2ecb3a72c. May 10 13:48:42.415483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:42.415483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 13:48:42.415483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 13:48:42.415483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 13:48:42.415483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 13:48:42.415483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 13:48:42.415483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application result = self._query(query) May 10 13:48:42.415483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 13:48:42.415483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application conn.query(q) May 10 13:48:42.415483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 13:48:42.415483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 13:48:42.415483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 13:48:42.416492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application result.read() May 10 13:48:42.416492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 13:48:42.416492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 13:48:42.416492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 13:48:42.416492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 13:48:42.416492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 13:48:42.416492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 13:48:42.416492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 13:48:42.416492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 13:48:42.416492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 13:48:42.416492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:42.416492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 13:48:42.416492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:42.416492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:42.416492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 13:48:42.416492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 13:48:42.416492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 10 13:48:42.416492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return project_ref.to_dict() May 10 13:48:42.417686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 13:48:42.417686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application next(self.gen) May 10 13:48:42.417686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 13:48:42.417686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application yield resource May 10 13:48:42.417686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 13:48:42.417686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application next(self.gen) May 10 13:48:42.417686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 13:48:42.417686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self.session.rollback() May 10 13:48:42.417686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 13:48:42.417686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self.force_reraise() May 10 13:48:42.417686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 13:48:42.417686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise self.value May 10 13:48:42.417686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 13:48:42.417686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 13:48:42.417686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 13:48:42.417686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application session.commit() May 10 13:48:42.417686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 13:48:42.418734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 13:48:42.418734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 13:48:42.418734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._prepare_impl() May 10 13:48:42.418734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 13:48:42.418734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self.session.flush() May 10 13:48:42.418734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 13:48:42.418734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._flush(objects) May 10 13:48:42.418734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 13:48:42.418734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 13:48:42.418734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 13:48:42.418734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application compat.raise_( May 10 13:48:42.418734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 13:48:42.418734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception May 10 13:48:42.418734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 13:48:42.418734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application flush_context.execute() May 10 13:48:42.418734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 13:48:42.418734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rec.execute(self) May 10 13:48:42.419656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 13:48:42.419656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 13:48:42.419656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 13:48:42.419656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 13:48:42.419656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 13:48:42.419656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 13:48:42.419656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 13:48:42.419656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 13:48:42.419656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 13:48:42.419656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 13:48:42.419656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 13:48:42.419656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 13:48:42.419656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 13:48:42.419656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 13:48:42.419656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 13:48:42.420706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 13:48:42.420706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 13:48:42.420706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception May 10 13:48:42.420706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 13:48:42.420706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 13:48:42.420706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 13:48:42.420706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 13:48:42.420706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 13:48:42.420706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application result = self._query(query) May 10 13:48:42.420706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 13:48:42.420706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application conn.query(q) May 10 13:48:42.420706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 13:48:42.420706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 13:48:42.420706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 13:48:42.420706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application result.read() May 10 13:48:42.420706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 13:48:42.420706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 13:48:42.421677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 13:48:42.421677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 13:48:42.421677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 13:48:42.421677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 13:48:42.421677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 13:48:42.421677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 13:48:42.421677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 13:48:42.421677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 13:48:42.421677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [parameters: {'id': '22b2013d75dc48e48ad58ee2ecb3a72c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 13:48:42.421677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 13:48:42.421677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:42.421677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:42.421677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:42.421677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:42.421677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 10 13:48:42.423292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 10 13:48:42.423292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 13:48:42.423292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 13:48:42.423292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 10 13:48:42.423292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:42.423292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:42.423292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:42.423292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:42.423292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:42.423292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:42.423292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:42.423292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:42.423292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:42.423292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:42.423292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:42.423292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:42.423292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:42.424856 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:42.424856 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 10 13:48:42.424856 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 10 13:48:42.424856 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:42.424856 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:42.424856 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 10 13:48:42.424856 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.Conflict( May 10 13:48:42.424856 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 22b2013d75dc48e48ad58ee2ecb3a72c. May 10 13:48:42.424856 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:42.424856 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 479/944] 10.222.0.32 () {60 vars in 1140 bytes} [Tue May 10 13:48:42 2022] POST /identity/v3/projects => generated 262 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:42.424856 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca46181-b38f-4e3b-8578-87f4ed889110 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:42.480502 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a1f3e-4ba8-483b-aad7-3cb31b823ade None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:42.519280 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba600dd5-c473-4d21-a281-e4038e5a640c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:42.520418 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba600dd5-c473-4d21-a281-e4038e5a640c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:42.520937 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba600dd5-c473-4d21-a281-e4038e5a640c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:42.521442 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba600dd5-c473-4d21-a281-e4038e5a640c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:42.529501 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba600dd5-c473-4d21-a281-e4038e5a640c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:42.531266 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba600dd5-c473-4d21-a281-e4038e5a640c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:42.545162 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca46181-b38f-4e3b-8578-87f4ed889110 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:42.547291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-ba600dd5-c473-4d21-a281-e4038e5a640c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:42.547291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:42.547291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:42.547291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:42.547291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:42.547291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:42.547291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:42.547291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:42.547291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:42.547291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:42.547291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:42.547291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:42.547291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:42.547291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:42.547291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:42.548162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:42.548162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:42.548162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:42.548162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:42.548162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:42.548162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:42.548162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:42.548162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:42.548162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:42.548162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:42.548162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:42.548162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:42.548162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:42.548162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:42.548162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:42.548162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:42.548162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:42.549047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:42.549047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:42.549047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:42.549047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:42.549047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:42.549047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:42.549047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:42.549047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:42.553504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 466/945] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:42.554439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba600dd5-c473-4d21-a281-e4038e5a640c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:42.590183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e6988-0948-497c-bc9e-432de4b2b227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:42.591397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e6988-0948-497c-bc9e-432de4b2b227 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:42.591952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e6988-0948-497c-bc9e-432de4b2b227 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:42.592450 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e6988-0948-497c-bc9e-432de4b2b227 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:42.602871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e6988-0948-497c-bc9e-432de4b2b227 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:42.605692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e6988-0948-497c-bc9e-432de4b2b227 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:42.626481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-474e6988-0948-497c-bc9e-432de4b2b227 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:42.626481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:42.626481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:42.626481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:42.626481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:42.626481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:42.626481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:42.626481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:42.626481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:42.626481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:42.626481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:42.626481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:42.626481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:42.626481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:42.626481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:42.627461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:42.627461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:42.627461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:42.627461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:42.627461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:42.627461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:42.627461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:42.627461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:42.627461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:42.627461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:42.627461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:42.627461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:42.627461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:42.627461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:42.627461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:42.627461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:42.627461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:42.628346 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:42.628346 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:42.628346 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:42.628346 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:42.628346 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:42.628346 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:42.628346 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:42.628346 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:42.631565 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 480/946] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:42.637589 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e6988-0948-497c-bc9e-432de4b2b227 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:42.681414 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba600dd5-c473-4d21-a281-e4038e5a640c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:42.729381 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93972c-64ff-4901-b1a4-632e3150022c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:42.730227 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93972c-64ff-4901-b1a4-632e3150022c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:42.730806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93972c-64ff-4901-b1a4-632e3150022c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:42.731358 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93972c-64ff-4901-b1a4-632e3150022c None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:42.732567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93972c-64ff-4901-b1a4-632e3150022c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:42.733191 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93972c-64ff-4901-b1a4-632e3150022c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:42.735027 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93972c-64ff-4901-b1a4-632e3150022c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:42.754049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 467/947] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:48:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:42.764105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93972c-64ff-4901-b1a4-632e3150022c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:42.771603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e6988-0948-497c-bc9e-432de4b2b227 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:42.816011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c23a7-f40f-4014-9825-558467aa9083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:42.817230 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c23a7-f40f-4014-9825-558467aa9083 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:42.817516 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c23a7-f40f-4014-9825-558467aa9083 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:42.817796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c23a7-f40f-4014-9825-558467aa9083 None admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:42.819199 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c23a7-f40f-4014-9825-558467aa9083 None admin] RBAC: Adding query filter params (name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:42.819729 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c23a7-f40f-4014-9825-558467aa9083 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:42.823783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c23a7-f40f-4014-9825-558467aa9083 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:42.852310 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 481/948] 10.222.0.32 () {56 vars in 1112 bytes} [Tue May 10 13:48:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:42.923481 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93972c-64ff-4901-b1a4-632e3150022c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:42.962511 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fda8c-654d-4553-9e84-a43466db4204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:42.963805 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fda8c-654d-4553-9e84-a43466db4204 None admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:42.964346 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fda8c-654d-4553-9e84-a43466db4204 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:42.964899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fda8c-654d-4553-9e84-a43466db4204 None admin] PATH_INFO: `/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/686c869be43c40a9b63b3647bf689c7a/roles/d4565519f0024088b8818c0f36bc4822` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:42.967948 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fda8c-654d-4553-9e84-a43466db4204 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1cda14bca5c497dba2d18685dfe6cc2, user_id=686c869be43c40a9b63b3647bf689c7a, role_id=d4565519f0024088b8818c0f36bc4822)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:42.969790 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fda8c-654d-4553-9e84-a43466db4204 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:42.985654 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 468/949] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:48:42 2022] PUT /identity/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/686c869be43c40a9b63b3647bf689c7a/roles/d4565519f0024088b8818c0f36bc4822 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:48:44.294253 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d77058-f201-475f-88b0-94cb7cbe9bec None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:44.294901 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d77058-f201-475f-88b0-94cb7cbe9bec None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:44.294901 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d77058-f201-475f-88b0-94cb7cbe9bec None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:44.296454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 482/950] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:44.302444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627480d-63cd-45e3-88ea-7b75d43bde29 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:44.302970 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627480d-63cd-45e3-88ea-7b75d43bde29 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:44.302970 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627480d-63cd-45e3-88ea-7b75d43bde29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:44.320958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-5627480d-63cd-45e3-88ea-7b75d43bde29 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:44.322174 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-5627480d-63cd-45e3-88ea-7b75d43bde29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:44.395307 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 469/951] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:44.418766 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d77058-f201-475f-88b0-94cb7cbe9bec None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:44.471503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f766180-c571-4e10-809e-1d808b52b990 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:44.471797 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f766180-c571-4e10-809e-1d808b52b990 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:44.472055 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f766180-c571-4e10-809e-1d808b52b990 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:44.473413 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 470/952] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:48:44.479684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133be3e2-7695-4eb2-8d91-923ae4bd3371 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:44.479986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133be3e2-7695-4eb2-8d91-923ae4bd3371 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:44.480239 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133be3e2-7695-4eb2-8d91-923ae4bd3371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:44.501199 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-133be3e2-7695-4eb2-8d91-923ae4bd3371 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:44.502400 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-133be3e2-7695-4eb2-8d91-923ae4bd3371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:44.542622 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d77058-f201-475f-88b0-94cb7cbe9bec None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:44.581515 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 471/953] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) May 10 13:48:44.592884 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b454d49-455e-4834-aa98-79b391f2f5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:44.594087 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b454d49-455e-4834-aa98-79b391f2f5ce None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:44.594747 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b454d49-455e-4834-aa98-79b391f2f5ce None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:44.595248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b454d49-455e-4834-aa98-79b391f2f5ce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:44.596210 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b454d49-455e-4834-aa98-79b391f2f5ce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:44.597802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b454d49-455e-4834-aa98-79b391f2f5ce None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:44.604289 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133be3e2-7695-4eb2-8d91-923ae4bd3371 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:44.622404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-1b454d49-455e-4834-aa98-79b391f2f5ce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:48:44.622404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:44.622404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:48:44.622404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:48:44.622404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:48:44.622404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:48:44.622404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:48:44.622404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:44.622404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:48:44.622404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:44.622404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:44.622404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:44.622404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:44.622404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:44.622404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:44.622404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:44.622404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:44.623609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:44.623609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:44.623609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:44.623609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:44.623609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:44.623609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:44.623609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:48:44.623609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:48:44.623609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:48:44.623609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:48:44.623609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:44.623609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:44.623609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:44.623609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:44.623609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:44.623609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:44.625062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:44.625062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:44.625062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:44.625062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:44.625062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:44.625062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:44.625062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:44.625062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:44.625062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:44.625062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:44.625062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:48:44.625062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:44.625062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:48:44.625062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:44.625062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 483/954] 10.222.0.32 () {56 vars in 1126 bytes} [Tue May 10 13:48:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:44.629649 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b454d49-455e-4834-aa98-79b391f2f5ce None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:44.741487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133be3e2-7695-4eb2-8d91-923ae4bd3371 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:44.763983 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b454d49-455e-4834-aa98-79b391f2f5ce None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:44.781540 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571e96e-9a4c-4530-bfde-6a6019de01fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:44.782458 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571e96e-9a4c-4530-bfde-6a6019de01fb None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:44.782748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571e96e-9a4c-4530-bfde-6a6019de01fb None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:44.783025 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571e96e-9a4c-4530-bfde-6a6019de01fb None admin] PATH_INFO: `/v3/services/compute` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:44.783756 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571e96e-9a4c-4530-bfde-6a6019de01fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:44.785172 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571e96e-9a4c-4530-bfde-6a6019de01fb None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:44.799236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-1571e96e-9a4c-4530-bfde-6a6019de01fb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 13:48:44.799236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:44.799236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:48:44.799236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:48:44.799236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:48:44.799236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:48:44.799236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:48:44.799236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:44.799236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 13:48:44.799236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:44.799236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:44.799236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:44.799236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:44.799236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:44.799236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:44.799236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:44.799236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:44.800350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:44.800350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:44.800350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:44.800350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:44.800350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:44.800350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:44.800350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:48:44.800350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:48:44.800350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:48:44.800350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:48:44.800350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:44.800350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:44.800350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:44.800350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:44.800350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:44.800350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:44.801185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:44.801185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:44.801185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:44.801185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:44.801185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:44.801185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:44.801185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:44.801185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:44.801185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:44.801185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:44.801185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:48:44.801185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:44.801185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 13:48:44.801185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:44.801185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 472/955] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:44.808163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571e96e-9a4c-4530-bfde-6a6019de01fb None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:44.815062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd826709-0b83-4760-89bd-2b824594379c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:44.815984 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd826709-0b83-4760-89bd-2b824594379c None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:44.816416 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd826709-0b83-4760-89bd-2b824594379c None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:44.816850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd826709-0b83-4760-89bd-2b824594379c None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:44.817717 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd826709-0b83-4760-89bd-2b824594379c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:44.818174 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd826709-0b83-4760-89bd-2b824594379c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:44.819740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd826709-0b83-4760-89bd-2b824594379c None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:44.827112 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 484/956] 10.222.0.32 () {56 vars in 1122 bytes} [Tue May 10 13:48:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:44.838784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd826709-0b83-4760-89bd-2b824594379c None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:44.932691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571e96e-9a4c-4530-bfde-6a6019de01fb None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:44.944921 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd826709-0b83-4760-89bd-2b824594379c None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:44.973507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9428418-dda5-43d1-970c-ef4aaa579e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:44.974303 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9428418-dda5-43d1-970c-ef4aaa579e8c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:44.974659 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9428418-dda5-43d1-970c-ef4aaa579e8c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:44.975262 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9428418-dda5-43d1-970c-ef4aaa579e8c None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:44.975821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9428418-dda5-43d1-970c-ef4aaa579e8c None admin] RBAC: Adding query filter params (name=compute) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:44.976202 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9428418-dda5-43d1-970c-ef4aaa579e8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:44.977901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9428418-dda5-43d1-970c-ef4aaa579e8c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:44.984333 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3147a90-8631-47a1-863b-116ed922aa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:44.984557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 473/957] 10.222.0.32 () {56 vars in 1112 bytes} [Tue May 10 13:48:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:44.985471 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3147a90-8631-47a1-863b-116ed922aa33 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:44.985758 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3147a90-8631-47a1-863b-116ed922aa33 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:44.986035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3147a90-8631-47a1-863b-116ed922aa33 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:44.986826 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3147a90-8631-47a1-863b-116ed922aa33 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:44.987136 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3147a90-8631-47a1-863b-116ed922aa33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:44.988586 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3147a90-8631-47a1-863b-116ed922aa33 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:44.989777 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9428418-dda5-43d1-970c-ef4aaa579e8c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:45.000195 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 485/958] 10.222.0.32 () {56 vars in 1122 bytes} [Tue May 10 13:48:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:45.001181 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3147a90-8631-47a1-863b-116ed922aa33 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:45.111455 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3147a90-8631-47a1-863b-116ed922aa33 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:45.155389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be700d61-4abe-4539-96a6-818ca67bc62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:45.156094 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be700d61-4abe-4539-96a6-818ca67bc62c None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:45.156379 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be700d61-4abe-4539-96a6-818ca67bc62c None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:45.156660 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be700d61-4abe-4539-96a6-818ca67bc62c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:45.157480 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be700d61-4abe-4539-96a6-818ca67bc62c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:45.158990 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be700d61-4abe-4539-96a6-818ca67bc62c None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:45.167200 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9428418-dda5-43d1-970c-ef4aaa579e8c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:45.206803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 486/959] 10.222.0.32 () {60 vars in 1144 bytes} [Tue May 10 13:48:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:48:45.227800 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c46ca-aad2-4f7f-bde2-6449694df3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:45.228974 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c46ca-aad2-4f7f-bde2-6449694df3d2 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:45.229535 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c46ca-aad2-4f7f-bde2-6449694df3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:45.230041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c46ca-aad2-4f7f-bde2-6449694df3d2 None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:45.232641 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c46ca-aad2-4f7f-bde2-6449694df3d2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:45.233280 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c46ca-aad2-4f7f-bde2-6449694df3d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:45.235171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c46ca-aad2-4f7f-bde2-6449694df3d2 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:45.242239 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 474/960] 10.222.0.32 () {56 vars in 1112 bytes} [Tue May 10 13:48:44 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:45.384034 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e9bcc-e988-4af9-8732-3e8618ad3b17 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:45.385062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e9bcc-e988-4af9-8732-3e8618ad3b17 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:45.385573 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e9bcc-e988-4af9-8732-3e8618ad3b17 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:45.388786 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 487/961] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:48:45.395424 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894adc90-4b2a-4bd3-8a4c-3d27c0ab55dd None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:45.396471 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894adc90-4b2a-4bd3-8a4c-3d27c0ab55dd None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:45.396986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894adc90-4b2a-4bd3-8a4c-3d27c0ab55dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:45.422826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-894adc90-4b2a-4bd3-8a4c-3d27c0ab55dd None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:45.424598 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-894adc90-4b2a-4bd3-8a4c-3d27c0ab55dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:45.487700 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd650b-233e-430f-8644-f049843b1120 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:45.488136 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd650b-233e-430f-8644-f049843b1120 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:45.488593 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd650b-233e-430f-8644-f049843b1120 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:45.491106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 488/962] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:48:45.499624 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d5ca6-f4b8-4118-a96c-febb180e03b8 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:45.500091 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d5ca6-f4b8-4118-a96c-febb180e03b8 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:45.500500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d5ca6-f4b8-4118-a96c-febb180e03b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:45.526003 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 475/963] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:48:45.526337 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-575d5ca6-f4b8-4118-a96c-febb180e03b8 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:45.529259 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-575d5ca6-f4b8-4118-a96c-febb180e03b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:45.552145 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894adc90-4b2a-4bd3-8a4c-3d27c0ab55dd None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:45.682737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 489/964] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:45.728540 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d5ca6-f4b8-4118-a96c-febb180e03b8 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:45.766132 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894adc90-4b2a-4bd3-8a4c-3d27c0ab55dd None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:45.826317 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fb12e-78ad-426a-9ef5-2bf45b2540d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:45.827392 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fb12e-78ad-426a-9ef5-2bf45b2540d7 None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:45.827905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fb12e-78ad-426a-9ef5-2bf45b2540d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:45.828400 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fb12e-78ad-426a-9ef5-2bf45b2540d7 None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:45.829760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fb12e-78ad-426a-9ef5-2bf45b2540d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:45.837310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fb12e-78ad-426a-9ef5-2bf45b2540d7 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:45.839948 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: WARNING keystone.server.flask.common [None req-f61fb12e-78ad-426a-9ef5-2bf45b2540d7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 10 13:48:45.864737 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.sql.core [None req-f61fb12e-78ad-426a-9ef5-2bf45b2540d7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 13:48:45.864737 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 13:48:45.864737 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [parameters: {'user_id': '552e05f6f8054075b46bdf6348a87f34', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 13:48:45.864737 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79937) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 13:48:45.890431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-f61fb12e-78ad-426a-9ef5-2bf45b2540d7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 13:48:45.890431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:45.890431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 13:48:45.890431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 13:48:45.890431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 13:48:45.890431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 13:48:45.890431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 13:48:45.890431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application result = self._query(query) May 10 13:48:45.890431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 13:48:45.890431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application conn.query(q) May 10 13:48:45.890431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 13:48:45.890431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 13:48:45.890431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 13:48:45.890431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application result.read() May 10 13:48:45.890431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 13:48:45.891884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 13:48:45.891884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 13:48:45.891884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 13:48:45.891884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 13:48:45.891884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 13:48:45.891884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 13:48:45.891884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 13:48:45.891884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 13:48:45.891884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:45.891884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 13:48:45.891884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:45.891884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:45.891884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 13:48:45.891884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 13:48:45.891884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 10 13:48:45.891884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 10 13:48:45.891884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 13:48:45.891884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application next(self.gen) May 10 13:48:45.893281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 13:48:45.893281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application yield resource May 10 13:48:45.893281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 13:48:45.893281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application next(self.gen) May 10 13:48:45.893281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 13:48:45.893281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self.session.rollback() May 10 13:48:45.893281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 13:48:45.893281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self.force_reraise() May 10 13:48:45.893281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 13:48:45.893281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise self.value May 10 13:48:45.893281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 13:48:45.893281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 13:48:45.893281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 13:48:45.893281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application session.commit() May 10 13:48:45.893281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 13:48:45.893281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 13:48:45.893281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 13:48:45.894340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._prepare_impl() May 10 13:48:45.894340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 13:48:45.894340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self.session.flush() May 10 13:48:45.894340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 13:48:45.894340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._flush(objects) May 10 13:48:45.894340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 13:48:45.894340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 13:48:45.894340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 13:48:45.894340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application compat.raise_( May 10 13:48:45.894340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 13:48:45.894340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception May 10 13:48:45.894340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 13:48:45.894340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application flush_context.execute() May 10 13:48:45.894340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 13:48:45.894340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rec.execute(self) May 10 13:48:45.894340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 13:48:45.894340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 13:48:45.895507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 13:48:45.895507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 13:48:45.895507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 10 13:48:45.895507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application result = connection._execute_20( May 10 13:48:45.895507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 13:48:45.895507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 13:48:45.895507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 13:48:45.895507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 13:48:45.895507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 13:48:45.895507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 13:48:45.895507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 13:48:45.895507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 13:48:45.895507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 13:48:45.895507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 13:48:45.895507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 13:48:45.895507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception May 10 13:48:45.897005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 13:48:45.897005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 13:48:45.897005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 13:48:45.897005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 13:48:45.897005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 13:48:45.897005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application result = self._query(query) May 10 13:48:45.897005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 13:48:45.897005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application conn.query(q) May 10 13:48:45.897005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 13:48:45.897005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 13:48:45.897005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 13:48:45.897005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application result.read() May 10 13:48:45.897005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 13:48:45.897005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 13:48:45.897005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 13:48:45.897005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 13:48:45.898376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 13:48:45.898376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 13:48:45.898376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 13:48:45.898376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 13:48:45.898376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 13:48:45.898376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 13:48:45.898376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [parameters: {'user_id': '552e05f6f8054075b46bdf6348a87f34', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 13:48:45.898376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 13:48:45.898376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:45.898376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:45.898376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:45.898376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:45.898376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:45.898376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:45.898376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:45.900105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:45.900105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:45.900105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:45.900105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:45.900105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:45.900105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:45.900105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:45.900105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 10 13:48:45.900105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 10 13:48:45.900105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:45.900105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:45.900105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:45.900105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:45.900105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:45.900105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:45.900105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 10 13:48:45.900105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 10 13:48:45.906306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 10 13:48:45.906306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 10 13:48:45.906306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 13:48:45.906306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 13:48:45.906306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 13:48:45.906306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:45.907985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 476/965] 10.222.0.32 () {60 vars in 1131 bytes} [Tue May 10 13:48:45 2022] POST /identity/v3/users => generated 160 bytes in 357 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:45.916123 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fb12e-78ad-426a-9ef5-2bf45b2540d7 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:45.950459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d5ca6-f4b8-4118-a96c-febb180e03b8 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:46.012366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b22a72-07c7-458a-91f2-b7215de7b1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:46.014432 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b22a72-07c7-458a-91f2-b7215de7b1dc None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:46.015255 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b22a72-07c7-458a-91f2-b7215de7b1dc None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:46.016077 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b22a72-07c7-458a-91f2-b7215de7b1dc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:46.036713 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b22a72-07c7-458a-91f2-b7215de7b1dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:46.049505 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fb12e-78ad-426a-9ef5-2bf45b2540d7 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:46.054811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-83b22a72-07c7-458a-91f2-b7215de7b1dc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:48:46.054811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:46.054811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:46.054811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:46.054811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:46.054811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:46.054811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:46.054811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:46.054811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:46.054811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:46.054811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:46.054811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:46.054811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:46.054811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:46.054811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:46.054811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:46.056737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:46.056737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:46.056737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:46.056737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:46.056737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:46.056737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:46.056737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:46.056737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:46.056737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:46.056737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:46.056737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:46.056737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:46.056737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:46.056737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:46.056737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:46.056737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:46.058554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:46.058554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:46.058554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:46.058554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:46.058554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:46.058554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:46.058554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:46.058554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:46.058554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:46.058554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:46.058554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:48:46.058554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:46.063677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 490/966] 10.222.0.32 () {56 vars in 1120 bytes} [Tue May 10 13:48:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:46.070467 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b22a72-07c7-458a-91f2-b7215de7b1dc None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:46.107694 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21611364-c29e-47cf-a015-78374029debd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:46.109706 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21611364-c29e-47cf-a015-78374029debd None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:46.110566 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21611364-c29e-47cf-a015-78374029debd None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:46.111387 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21611364-c29e-47cf-a015-78374029debd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:46.129961 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21611364-c29e-47cf-a015-78374029debd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:46.133522 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21611364-c29e-47cf-a015-78374029debd None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:46.159905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-21611364-c29e-47cf-a015-78374029debd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 13:48:46.159905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:46.159905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:46.159905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:46.159905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:46.159905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:46.159905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:46.159905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:46.159905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:46.159905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:46.159905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:46.159905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:46.159905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:48:46.159905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:48:46.159905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:48:46.159905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:48:46.162043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:46.162043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:46.162043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:46.162043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:46.162043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:46.162043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:46.162043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:46.162043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:46.162043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:46.162043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:46.162043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:46.162043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:46.162043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:46.162043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:46.162043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:46.162043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:46.162043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:46.162043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:46.164516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:46.164516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:46.164516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:48:46.164516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:48:46.164516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:48:46.164516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:48:46.164516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:48:46.164516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:48:46.164516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 13:48:46.164516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:46.174374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 477/967] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:48:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:46.179579 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21611364-c29e-47cf-a015-78374029debd None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:46.188382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b22a72-07c7-458a-91f2-b7215de7b1dc None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:46.227746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864d352-198e-4237-b25a-af64bfbacd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:46.228432 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864d352-198e-4237-b25a-af64bfbacd3e None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:46.228624 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864d352-198e-4237-b25a-af64bfbacd3e None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:46.228899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864d352-198e-4237-b25a-af64bfbacd3e None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:46.229858 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864d352-198e-4237-b25a-af64bfbacd3e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:46.229982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864d352-198e-4237-b25a-af64bfbacd3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:46.231534 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864d352-198e-4237-b25a-af64bfbacd3e None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:46.245994 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 491/968] 10.222.0.32 () {56 vars in 1115 bytes} [Tue May 10 13:48:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:46.247127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864d352-198e-4237-b25a-af64bfbacd3e None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:46.311061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21611364-c29e-47cf-a015-78374029debd None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:46.350238 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0fc69-6e66-488a-a972-6e54b4692a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:46.351264 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0fc69-6e66-488a-a972-6e54b4692a28 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:46.351706 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0fc69-6e66-488a-a972-6e54b4692a28 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:46.352138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0fc69-6e66-488a-a972-6e54b4692a28 None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:46.353115 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0fc69-6e66-488a-a972-6e54b4692a28 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:46.353577 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0fc69-6e66-488a-a972-6e54b4692a28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:46.355881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0fc69-6e66-488a-a972-6e54b4692a28 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:46.357535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864d352-198e-4237-b25a-af64bfbacd3e None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:46.394432 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c2aa4-d2a5-478c-bcb4-80bed87f67b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:46.395248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c2aa4-d2a5-478c-bcb4-80bed87f67b0 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:46.395524 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c2aa4-d2a5-478c-bcb4-80bed87f67b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:46.395808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c2aa4-d2a5-478c-bcb4-80bed87f67b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:46.408057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c2aa4-d2a5-478c-bcb4-80bed87f67b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:46.408745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 478/969] 10.222.0.32 () {56 vars in 1101 bytes} [Tue May 10 13:48:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:46.409514 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c2aa4-d2a5-478c-bcb4-80bed87f67b0 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:46.432728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-f93c2aa4-d2a5-478c-bcb4-80bed87f67b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:46.432728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:46.432728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:46.432728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:46.432728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:46.432728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:46.432728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:46.432728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:46.432728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:46.432728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:46.432728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:46.432728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:46.432728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:46.432728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:46.432728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:46.434656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:46.434656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:46.434656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:46.434656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:46.434656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:46.434656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:46.434656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:46.434656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:46.434656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:46.434656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:46.434656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:46.434656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:46.434656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:46.434656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:46.434656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:46.434656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:46.434656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:46.435792 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:46.435792 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:46.435792 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:46.435792 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:46.436206 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 492/970] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:46.443413 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0fc69-6e66-488a-a972-6e54b4692a28 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:46.577435 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0fc69-6e66-488a-a972-6e54b4692a28 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:46.622987 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde46759-b653-4947-abe6-4c948f31dd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:46.624053 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde46759-b653-4947-abe6-4c948f31dd1f None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:46.624504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde46759-b653-4947-abe6-4c948f31dd1f None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:46.624941 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde46759-b653-4947-abe6-4c948f31dd1f None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:46.625881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde46759-b653-4947-abe6-4c948f31dd1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:46.626395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde46759-b653-4947-abe6-4c948f31dd1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:46.628034 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde46759-b653-4947-abe6-4c948f31dd1f None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:46.643493 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 479/971] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:46.654230 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c2aa4-d2a5-478c-bcb4-80bed87f67b0 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:46.773214 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c2aa4-d2a5-478c-bcb4-80bed87f67b0 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:46.811531 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdaab3-16b0-435c-8c29-18c2d2b8b8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:46.812370 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdaab3-16b0-435c-8c29-18c2d2b8b8fb None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:46.812653 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdaab3-16b0-435c-8c29-18c2d2b8b8fb None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:46.812932 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdaab3-16b0-435c-8c29-18c2d2b8b8fb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:46.821418 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bdaab3-16b0-435c-8c29-18c2d2b8b8fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:46.822924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bdaab3-16b0-435c-8c29-18c2d2b8b8fb None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:46.840413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-65bdaab3-16b0-435c-8c29-18c2d2b8b8fb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:48:46.840413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:46.840413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:46.840413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:46.840413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:46.840413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:46.840413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:46.840413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:46.840413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:46.840413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:46.840413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:46.840413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:46.840413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:48:46.840413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:48:46.840413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:48:46.840413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:48:46.842407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:46.842407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:46.842407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:46.842407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:46.842407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:46.842407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:46.842407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:46.842407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:46.842407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:46.842407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:46.842407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:46.842407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:46.842407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:46.842407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:46.842407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:46.842407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:46.842407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:46.842407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:46.844144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:46.844144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:46.844144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:48:46.844144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:48:46.844144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:48:46.844144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:48:46.844144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:48:46.844144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:48:46.844144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:48:46.844144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:46.844144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 493/972] 10.222.0.32 () {56 vars in 1117 bytes} [Tue May 10 13:48:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:46.853134 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde46759-b653-4947-abe6-4c948f31dd1f None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:46.981586 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde46759-b653-4947-abe6-4c948f31dd1f None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:47.045290 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92471252-7de2-4140-8361-c5bab2371793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:47.046468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92471252-7de2-4140-8361-c5bab2371793 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:47.046965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92471252-7de2-4140-8361-c5bab2371793 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:47.047444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92471252-7de2-4140-8361-c5bab2371793 None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:47.049047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92471252-7de2-4140-8361-c5bab2371793 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:47.049590 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92471252-7de2-4140-8361-c5bab2371793 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:47.052363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92471252-7de2-4140-8361-c5bab2371793 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:47.091140 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 480/973] 10.222.0.32 () {56 vars in 1149 bytes} [Tue May 10 13:48:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:47.092588 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdaab3-16b0-435c-8c29-18c2d2b8b8fb None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:47.223348 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdaab3-16b0-435c-8c29-18c2d2b8b8fb None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:47.287013 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e33fb-7758-4f4d-9b49-935faad59225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:47.288285 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e33fb-7758-4f4d-9b49-935faad59225 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:47.288898 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e33fb-7758-4f4d-9b49-935faad59225 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:47.289464 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e33fb-7758-4f4d-9b49-935faad59225 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:47.419991 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e33fb-7758-4f4d-9b49-935faad59225 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:47.422836 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e33fb-7758-4f4d-9b49-935faad59225 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:47.616630 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 494/974] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:48:47 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:48:47.618358 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92471252-7de2-4140-8361-c5bab2371793 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:47.688489 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d2a25-f9e3-47bb-a069-4a8b6253b518 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:47.688690 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d2a25-f9e3-47bb-a069-4a8b6253b518 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:47.688966 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d2a25-f9e3-47bb-a069-4a8b6253b518 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:47.690731 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 495/975] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:48:47.696121 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda9b10-5771-47ee-8fb1-77d77b0ee927 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:47.696404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda9b10-5771-47ee-8fb1-77d77b0ee927 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:47.696677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda9b10-5771-47ee-8fb1-77d77b0ee927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:47.715597 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-deda9b10-5771-47ee-8fb1-77d77b0ee927 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:47.716825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-deda9b10-5771-47ee-8fb1-77d77b0ee927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:47.784349 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92471252-7de2-4140-8361-c5bab2371793 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:47.795882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 496/976] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:48:47.818921 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda9b10-5771-47ee-8fb1-77d77b0ee927 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:47.839989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4d575-81d2-4630-99ce-75146e93d437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:47.841187 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4d575-81d2-4630-99ce-75146e93d437 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:47.841466 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4d575-81d2-4630-99ce-75146e93d437 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:47.841985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4d575-81d2-4630-99ce-75146e93d437 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:47.859290 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4d575-81d2-4630-99ce-75146e93d437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:47.860796 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4d575-81d2-4630-99ce-75146e93d437 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:47.891404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-40a4d575-81d2-4630-99ce-75146e93d437 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:47.891404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:47.891404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:47.891404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:47.891404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:47.891404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:47.891404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:47.891404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:47.891404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:47.891404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:47.891404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:47.891404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:47.891404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:47.891404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:47.891404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:47.892398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:47.892398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:47.892398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:47.892398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:47.892398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:47.892398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:47.892398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:47.892398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:47.892398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:47.892398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:47.892398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:47.892398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:47.892398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:47.892398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:47.892398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:47.892398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:47.892398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:47.893281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:47.893281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:47.893281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:47.893281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:47.894622 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 481/977] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:47.898270 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4d575-81d2-4630-99ce-75146e93d437 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:47.960866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda9b10-5771-47ee-8fb1-77d77b0ee927 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:48.009105 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b465a-960b-4375-9fa8-1e040cac06d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:48.009798 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b465a-960b-4375-9fa8-1e040cac06d5 None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:48.010083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b465a-960b-4375-9fa8-1e040cac06d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:48.010388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b465a-960b-4375-9fa8-1e040cac06d5 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:48.011125 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b465a-960b-4375-9fa8-1e040cac06d5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:48.013071 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b465a-960b-4375-9fa8-1e040cac06d5 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:48.027571 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 497/978] 10.222.0.32 () {60 vars in 1141 bytes} [Tue May 10 13:48:47 2022] POST /identity/v3/services => generated 242 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:48:48.054762 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4d575-81d2-4630-99ce-75146e93d437 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:48.134536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37c30b-9433-415f-b536-d320e1842246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:48.135732 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37c30b-9433-415f-b536-d320e1842246 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:48.136240 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37c30b-9433-415f-b536-d320e1842246 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:48.137322 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37c30b-9433-415f-b536-d320e1842246 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:48.138867 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37c30b-9433-415f-b536-d320e1842246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:48.139420 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37c30b-9433-415f-b536-d320e1842246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:48.142175 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37c30b-9433-415f-b536-d320e1842246 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:48.165743 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 482/979] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:48.175802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b465a-960b-4375-9fa8-1e040cac06d5 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:48.326615 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b465a-960b-4375-9fa8-1e040cac06d5 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:48.369729 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d8895-206b-43fd-a15a-b249e3186bb7 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:48.370076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d8895-206b-43fd-a15a-b249e3186bb7 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:48.370310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d8895-206b-43fd-a15a-b249e3186bb7 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:48.372473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 483/980] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:48:48.378019 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcca97-cd5a-4f09-960a-4d86348fe41e None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:48.378336 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcca97-cd5a-4f09-960a-4d86348fe41e None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:48.378612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcca97-cd5a-4f09-960a-4d86348fe41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:48.385181 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeafbc3-1573-4d76-85b2-950730112150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:48.386031 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeafbc3-1573-4d76-85b2-950730112150 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:48.386349 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeafbc3-1573-4d76-85b2-950730112150 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:48.387219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeafbc3-1573-4d76-85b2-950730112150 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:48.394862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeafbc3-1573-4d76-85b2-950730112150 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:48.396330 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeafbc3-1573-4d76-85b2-950730112150 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:48.396459 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-8ddcca97-cd5a-4f09-960a-4d86348fe41e None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:48.397994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-8ddcca97-cd5a-4f09-960a-4d86348fe41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:48.412429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-5aeafbc3-1573-4d76-85b2-950730112150 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:48.412429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:48.412429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:48.412429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:48.412429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:48.412429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:48.412429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:48.412429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:48.412429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:48.412429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:48.412429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:48.412429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:48.412429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:48:48.412429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:48:48.412429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:48:48.413431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:48:48.413431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:48.413431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:48.413431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:48.413431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:48.413431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:48.413431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:48.413431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:48.413431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:48.413431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:48.413431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:48.413431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:48.413431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:48.413431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:48.413431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:48.413431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:48.413431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:48.414345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:48:48.414345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:48:48.414345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:48.414345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:48.414345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:48.414345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:48.414345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:48:48.414345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:48.418617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 498/981] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:48.419382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeafbc3-1573-4d76-85b2-950730112150 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:48.492822 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 484/982] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:48:48.516491 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcca97-cd5a-4f09-960a-4d86348fe41e None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:48.540601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeafbc3-1573-4d76-85b2-950730112150 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:48.586017 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb1d66-cd10-4cd8-990e-30005bb3cfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:48.586962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb1d66-cd10-4cd8-990e-30005bb3cfa2 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:48.587245 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb1d66-cd10-4cd8-990e-30005bb3cfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:48.587519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb1d66-cd10-4cd8-990e-30005bb3cfa2 None admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:48.588320 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb1d66-cd10-4cd8-990e-30005bb3cfa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:48.588634 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb1d66-cd10-4cd8-990e-30005bb3cfa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:48.590191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb1d66-cd10-4cd8-990e-30005bb3cfa2 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:48.602150 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 499/983] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:48:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:48.609481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb1d66-cd10-4cd8-990e-30005bb3cfa2 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:48.638214 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcca97-cd5a-4f09-960a-4d86348fe41e None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:48.685298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6070ae-3c08-4c16-89d1-58791de48439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:48.686130 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6070ae-3c08-4c16-89d1-58791de48439 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:48.686458 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6070ae-3c08-4c16-89d1-58791de48439 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:48.686735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6070ae-3c08-4c16-89d1-58791de48439 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:48.687370 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6070ae-3c08-4c16-89d1-58791de48439 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:48.688770 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6070ae-3c08-4c16-89d1-58791de48439 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:48.703368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-ea6070ae-3c08-4c16-89d1-58791de48439 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:48:48.703368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:48.703368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:48:48.703368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:48:48.703368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:48:48.703368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:48:48.703368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:48:48.703368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:48.703368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:48:48.703368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:48.703368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:48.703368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:48.703368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:48.703368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:48.703368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:48.703368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:48.703368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:48.704642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:48.704642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:48.704642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:48.704642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:48.704642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:48.704642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:48.704642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:48:48.704642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:48:48.704642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:48:48.704642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:48:48.704642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:48.704642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:48.704642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:48.704642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:48.704642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:48.704642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:48.706347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:48.706347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:48.706347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:48.706347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:48.706347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:48.706347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:48.706347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:48.706347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:48.706347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:48.706347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:48.706347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:48:48.706347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:48.706347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:48:48.706347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:48.706347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 485/984] 10.222.0.32 () {56 vars in 1126 bytes} [Tue May 10 13:48:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:48.712209 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6070ae-3c08-4c16-89d1-58791de48439 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:48.744382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb1d66-cd10-4cd8-990e-30005bb3cfa2 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:48.789808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1f861-1d58-4d7c-a17d-d765a000b84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:48.790990 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1f861-1d58-4d7c-a17d-d765a000b84e None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:48.791495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1f861-1d58-4d7c-a17d-d765a000b84e None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:48.791983 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1f861-1d58-4d7c-a17d-d765a000b84e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:48.793567 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1f861-1d58-4d7c-a17d-d765a000b84e None admin] RBAC: Adding query filter params (role.id=d4565519f0024088b8818c0f36bc4822, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=686c869be43c40a9b63b3647bf689c7a) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:48.794135 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1f861-1d58-4d7c-a17d-d765a000b84e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:48.796356 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1f861-1d58-4d7c-a17d-d765a000b84e None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:48.803582 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 500/985] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:48:48 2022] GET /identity/v3/role_assignments?user.id=686c869be43c40a9b63b3647bf689c7a&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=d4565519f0024088b8818c0f36bc4822 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:48.842448 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6070ae-3c08-4c16-89d1-58791de48439 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:48.882575 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6dcf22-9151-492b-bb39-706bfc8d03ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:48.883274 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6dcf22-9151-492b-bb39-706bfc8d03ff None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:48.883558 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6dcf22-9151-492b-bb39-706bfc8d03ff None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:48.883830 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6dcf22-9151-492b-bb39-706bfc8d03ff None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:48.884562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6dcf22-9151-492b-bb39-706bfc8d03ff None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:48.884868 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6dcf22-9151-492b-bb39-706bfc8d03ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:48.886451 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6dcf22-9151-492b-bb39-706bfc8d03ff None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:48.898659 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 486/986] 10.222.0.32 () {56 vars in 1122 bytes} [Tue May 10 13:48:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:48.900941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1f861-1d58-4d7c-a17d-d765a000b84e None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:49.023522 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1f861-1d58-4d7c-a17d-d765a000b84e None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:49.061434 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73af5b-8e3b-4a61-a745-bb71f5121ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:49.062538 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73af5b-8e3b-4a61-a745-bb71f5121ba9 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:49.063093 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73af5b-8e3b-4a61-a745-bb71f5121ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:49.063570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73af5b-8e3b-4a61-a745-bb71f5121ba9 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:49.064500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73af5b-8e3b-4a61-a745-bb71f5121ba9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:49.065038 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73af5b-8e3b-4a61-a745-bb71f5121ba9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:49.066676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73af5b-8e3b-4a61-a745-bb71f5121ba9 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:49.072666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 501/987] 10.222.0.32 () {56 vars in 1122 bytes} [Tue May 10 13:48:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:49.079272 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6dcf22-9151-492b-bb39-706bfc8d03ff None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:49.200792 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6dcf22-9151-492b-bb39-706bfc8d03ff None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:49.239681 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d81936-f54d-4bf7-9fd5-b0952b856178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:49.240721 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d81936-f54d-4bf7-9fd5-b0952b856178 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:49.241222 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d81936-f54d-4bf7-9fd5-b0952b856178 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:49.241703 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d81936-f54d-4bf7-9fd5-b0952b856178 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:49.242760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d81936-f54d-4bf7-9fd5-b0952b856178 None admin] RBAC: Adding query filter params (interface=admin, service_id=ede42d9ba92945549805e1963385be3f, region_id=RegionOne) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:49.243293 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d81936-f54d-4bf7-9fd5-b0952b856178 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:49.244967 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d81936-f54d-4bf7-9fd5-b0952b856178 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:49.251772 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 487/988] 10.222.0.32 () {56 vars in 1249 bytes} [Tue May 10 13:48:49 2022] GET /identity/v3/endpoints?service_id=ede42d9ba92945549805e1963385be3f&interface=admin®ion_id=RegionOne => generated 193 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:49.257804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73af5b-8e3b-4a61-a745-bb71f5121ba9 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:49.376486 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73af5b-8e3b-4a61-a745-bb71f5121ba9 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:49.409337 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23d7bc-e9c2-4bdb-8961-5579953e3cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:49.409998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d7bc-e9c2-4bdb-8961-5579953e3cb3 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:49.410313 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d7bc-e9c2-4bdb-8961-5579953e3cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:49.410589 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d7bc-e9c2-4bdb-8961-5579953e3cb3 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:49.411272 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23d7bc-e9c2-4bdb-8961-5579953e3cb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:49.412629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23d7bc-e9c2-4bdb-8961-5579953e3cb3 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:49.426238 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 502/989] 10.222.0.32 () {56 vars in 1087 bytes} [Tue May 10 13:48:49 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 13:48:50.702572 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db27df-a6f6-4895-a882-131e6bfa36af None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:50.703377 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db27df-a6f6-4895-a882-131e6bfa36af None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:50.703377 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db27df-a6f6-4895-a882-131e6bfa36af None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:50.704825 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 488/990] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:50.710910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476887a8-4e80-474e-859b-4f455831665b None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:50.711744 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476887a8-4e80-474e-859b-4f455831665b None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:50.711744 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476887a8-4e80-474e-859b-4f455831665b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:50.731259 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-476887a8-4e80-474e-859b-4f455831665b None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:50.732735 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-476887a8-4e80-474e-859b-4f455831665b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:50.811765 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 503/991] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:50.838343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db27df-a6f6-4895-a882-131e6bfa36af None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:50.976483 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db27df-a6f6-4895-a882-131e6bfa36af None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:51.020119 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46da3a5-9f8a-4af6-8686-f7a6703c45b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:51.020943 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46da3a5-9f8a-4af6-8686-f7a6703c45b3 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:51.021319 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46da3a5-9f8a-4af6-8686-f7a6703c45b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:51.021604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46da3a5-9f8a-4af6-8686-f7a6703c45b3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:51.022316 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46da3a5-9f8a-4af6-8686-f7a6703c45b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:51.023733 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46da3a5-9f8a-4af6-8686-f7a6703c45b3 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:51.037101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-c46da3a5-9f8a-4af6-8686-f7a6703c45b3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 13:48:51.037101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:51.037101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:48:51.037101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:48:51.037101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:48:51.037101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:48:51.037101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:48:51.037101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:51.037101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 13:48:51.037101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:51.037101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:51.037101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:51.037101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:51.037101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:51.037101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:51.037101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:51.037101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:51.038490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:51.038490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:51.038490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:51.038490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:51.038490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:51.038490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:51.038490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:48:51.038490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:48:51.038490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:48:51.038490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:48:51.038490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:51.038490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:51.038490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:51.038490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:51.038490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:51.038490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:51.047853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:51.047853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:51.047853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:51.047853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:51.047853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:51.047853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:51.047853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:51.047853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:51.047853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:51.047853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:51.047853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:48:51.047853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:51.047853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 13:48:51.047853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:51.047853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 489/992] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:51.052820 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476887a8-4e80-474e-859b-4f455831665b None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:51.177487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476887a8-4e80-474e-859b-4f455831665b None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:51.184598 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b811b42-00b4-41b1-8a62-364e65f2477b None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:51.184890 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b811b42-00b4-41b1-8a62-364e65f2477b None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:51.185128 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b811b42-00b4-41b1-8a62-364e65f2477b None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:51.187122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 490/993] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:48:51.195968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905dc4a-56af-4da3-bc0c-9e061385b961 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:51.196460 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905dc4a-56af-4da3-bc0c-9e061385b961 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:51.196954 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905dc4a-56af-4da3-bc0c-9e061385b961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:51.225473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-a905dc4a-56af-4da3-bc0c-9e061385b961 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:51.225707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b97a87-a6d1-4626-88f4-f48b05c132cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:51.226401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b97a87-a6d1-4626-88f4-f48b05c132cb None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:51.226745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b97a87-a6d1-4626-88f4-f48b05c132cb None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:51.226965 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b97a87-a6d1-4626-88f4-f48b05c132cb None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:51.227698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b97a87-a6d1-4626-88f4-f48b05c132cb None admin] RBAC: Adding query filter params (name=compute) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:51.229296 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b97a87-a6d1-4626-88f4-f48b05c132cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:51.229412 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a905dc4a-56af-4da3-bc0c-9e061385b961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:51.229493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b97a87-a6d1-4626-88f4-f48b05c132cb None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:51.236829 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 504/994] 10.222.0.32 () {56 vars in 1112 bytes} [Tue May 10 13:48:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:51.242532 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b97a87-a6d1-4626-88f4-f48b05c132cb None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:51.334247 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 491/995] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:51.352859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b97a87-a6d1-4626-88f4-f48b05c132cb None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:51.354394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905dc4a-56af-4da3-bc0c-9e061385b961 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:51.392873 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e367b2c-d92b-4643-a3d4-7847dfcccdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:51.394146 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e367b2c-d92b-4643-a3d4-7847dfcccdd4 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:51.394611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e367b2c-d92b-4643-a3d4-7847dfcccdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:51.394947 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e367b2c-d92b-4643-a3d4-7847dfcccdd4 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:51.395665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e367b2c-d92b-4643-a3d4-7847dfcccdd4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:51.395964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e367b2c-d92b-4643-a3d4-7847dfcccdd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:51.397376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e367b2c-d92b-4643-a3d4-7847dfcccdd4 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:51.403674 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 505/996] 10.222.0.32 () {56 vars in 1112 bytes} [Tue May 10 13:48:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:51.409254 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e367b2c-d92b-4643-a3d4-7847dfcccdd4 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:51.492709 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905dc4a-56af-4da3-bc0c-9e061385b961 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:51.520334 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e367b2c-d92b-4643-a3d4-7847dfcccdd4 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:51.557461 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d3983-9032-4bc3-aa19-d6efe53679e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:51.558926 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d3983-9032-4bc3-aa19-d6efe53679e2 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:51.559393 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d3983-9032-4bc3-aa19-d6efe53679e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:51.559955 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d3983-9032-4bc3-aa19-d6efe53679e2 None admin] PATH_INFO: `/v3/services/image` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:51.561146 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d3983-9032-4bc3-aa19-d6efe53679e2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:51.563798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d3983-9032-4bc3-aa19-d6efe53679e2 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:51.563988 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e75d9c-bd62-4a4e-a258-7384da9bc2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:51.564665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e75d9c-bd62-4a4e-a258-7384da9bc2b4 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:51.564925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e75d9c-bd62-4a4e-a258-7384da9bc2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:51.565198 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e75d9c-bd62-4a4e-a258-7384da9bc2b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:51.565998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e75d9c-bd62-4a4e-a258-7384da9bc2b4 None admin] RBAC: Adding query filter params (interface=public, service_id=fd37fa7c18024218976dcb488460cca7, region_id=RegionOne) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:51.566376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e75d9c-bd62-4a4e-a258-7384da9bc2b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:51.567741 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e75d9c-bd62-4a4e-a258-7384da9bc2b4 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:51.576378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 506/997] 10.222.0.32 () {56 vars in 1251 bytes} [Tue May 10 13:48:51 2022] GET /identity/v3/endpoints?service_id=fd37fa7c18024218976dcb488460cca7&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:51.582157 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e75d9c-bd62-4a4e-a258-7384da9bc2b4 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:51.587086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-763d3983-9032-4bc3-aa19-d6efe53679e2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 13:48:51.587086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:51.587086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:48:51.587086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:48:51.587086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:48:51.587086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:48:51.587086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:48:51.587086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:51.587086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 13:48:51.587086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:51.587086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:51.587086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:51.587086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:51.587086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:51.587086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:51.587086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:51.587086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:51.588208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:51.588208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:51.588208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:51.588208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:51.588208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:51.588208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:51.588208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:48:51.588208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:48:51.588208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:48:51.588208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:48:51.588208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:51.588208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:51.588208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:51.588208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:51.588208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:51.588208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:51.589042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:51.589042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:48:51.589042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:51.589042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:51.589042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:51.589042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:51.589042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:51.589042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:51.589042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:51.589042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:51.589042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:48:51.589042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:51.589042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 13:48:51.589042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:48:51.596523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 492/998] 10.222.0.32 () {56 vars in 1105 bytes} [Tue May 10 13:48:51 2022] GET /identity/v3/services/image => generated 86 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:51.596776 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d3983-9032-4bc3-aa19-d6efe53679e2 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:51.704850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e75d9c-bd62-4a4e-a258-7384da9bc2b4 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:51.738781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d3983-9032-4bc3-aa19-d6efe53679e2 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:51.757960 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cc9b5-8ecf-41a6-8734-e66e43c178e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:51.758669 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cc9b5-8ecf-41a6-8734-e66e43c178e6 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:51.758877 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cc9b5-8ecf-41a6-8734-e66e43c178e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:51.759137 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cc9b5-8ecf-41a6-8734-e66e43c178e6 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:51.759817 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2cc9b5-8ecf-41a6-8734-e66e43c178e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:51.761193 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2cc9b5-8ecf-41a6-8734-e66e43c178e6 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:51.770237 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 507/999] 10.222.0.32 () {56 vars in 1087 bytes} [Tue May 10 13:48:51 2022] GET /identity/v3/services => generated 1727 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 13:48:51.775472 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86731bf7-ede1-47e0-8fe4-b0709ed0a33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:51.776178 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86731bf7-ede1-47e0-8fe4-b0709ed0a33f None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:51.776514 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86731bf7-ede1-47e0-8fe4-b0709ed0a33f None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:51.776853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86731bf7-ede1-47e0-8fe4-b0709ed0a33f None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:51.778963 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86731bf7-ede1-47e0-8fe4-b0709ed0a33f None admin] RBAC: Adding query filter params (name=image) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:51.779445 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86731bf7-ede1-47e0-8fe4-b0709ed0a33f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:51.780953 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86731bf7-ede1-47e0-8fe4-b0709ed0a33f None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:51.787480 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 493/1000] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:51.794621 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cc9b5-8ecf-41a6-8734-e66e43c178e6 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:51.909490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591fd29-de34-4298-9621-ee50bb6bc97b None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:51.909876 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591fd29-de34-4298-9621-ee50bb6bc97b None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:51.910152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591fd29-de34-4298-9621-ee50bb6bc97b None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:51.911898 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 494/1001] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:48:51.912028 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cc9b5-8ecf-41a6-8734-e66e43c178e6 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:51.917711 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cc404-8f23-4d9f-9d09-2a58150c0fa0 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:51.918688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cc404-8f23-4d9f-9d09-2a58150c0fa0 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:51.918911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cc404-8f23-4d9f-9d09-2a58150c0fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:51.936401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-515cc404-8f23-4d9f-9d09-2a58150c0fa0 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:51.937700 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-515cc404-8f23-4d9f-9d09-2a58150c0fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:51.955639 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69938f31-5dbd-4cfe-b09e-3e622dbd70c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:51.956327 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69938f31-5dbd-4cfe-b09e-3e622dbd70c9 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:51.956614 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69938f31-5dbd-4cfe-b09e-3e622dbd70c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:51.956891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69938f31-5dbd-4cfe-b09e-3e622dbd70c9 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:51.957613 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69938f31-5dbd-4cfe-b09e-3e622dbd70c9 None admin] RBAC: Adding query filter params (type=image) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:51.957925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69938f31-5dbd-4cfe-b09e-3e622dbd70c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:51.959332 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69938f31-5dbd-4cfe-b09e-3e622dbd70c9 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:51.964251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 508/1002] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:51 2022] GET /identity/v3/services?type=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:52.019642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 495/1003] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:48:52.044145 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69938f31-5dbd-4cfe-b09e-3e622dbd70c9 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:52.158550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69938f31-5dbd-4cfe-b09e-3e622dbd70c9 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:52.194128 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee732f-971f-4809-8d4c-7526c8e8827f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:52.195020 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee732f-971f-4809-8d4c-7526c8e8827f None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:52.195300 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee732f-971f-4809-8d4c-7526c8e8827f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:52.195574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee732f-971f-4809-8d4c-7526c8e8827f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:52.196228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee732f-971f-4809-8d4c-7526c8e8827f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:52.197605 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee732f-971f-4809-8d4c-7526c8e8827f None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:52.210548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-e5ee732f-971f-4809-8d4c-7526c8e8827f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:48:52.210548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:52.210548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:48:52.210548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:48:52.210548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:48:52.210548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:48:52.210548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:48:52.210548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:52.210548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:48:52.210548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:52.210548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:52.210548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:52.210548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:52.210548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:52.210548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:52.210548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:52.210548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:52.211760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:52.211760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:52.211760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:52.211760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:52.211760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:52.211760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:52.211760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:48:52.211760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:48:52.211760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:48:52.211760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:48:52.211760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:52.211760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:52.211760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:52.211760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:52.211760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:52.211760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:52.212638 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:52.212638 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:52.212638 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:52.212638 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:52.212638 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:52.212638 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:52.212638 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:52.212638 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:52.212638 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:52.212638 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:52.212638 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:48:52.212638 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:52.212638 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:48:52.212638 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:52.212638 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 509/1004] 10.222.0.32 () {56 vars in 1126 bytes} [Tue May 10 13:48:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:52.218984 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cc404-8f23-4d9f-9d09-2a58150c0fa0 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:52.334443 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cc404-8f23-4d9f-9d09-2a58150c0fa0 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:52.374087 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43861c-9c03-42ab-b776-2372c926ed46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:52.375103 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43861c-9c03-42ab-b776-2372c926ed46 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:52.375512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43861c-9c03-42ab-b776-2372c926ed46 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:52.375912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43861c-9c03-42ab-b776-2372c926ed46 None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:52.377184 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43861c-9c03-42ab-b776-2372c926ed46 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:52.377718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43861c-9c03-42ab-b776-2372c926ed46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:52.380224 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43861c-9c03-42ab-b776-2372c926ed46 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:52.388562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 496/1005] 10.222.0.32 () {56 vars in 1122 bytes} [Tue May 10 13:48:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:52.394309 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee732f-971f-4809-8d4c-7526c8e8827f None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:52.509553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee732f-971f-4809-8d4c-7526c8e8827f None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:52.564115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0253f-18f6-46dd-aa53-22d2fcadfc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:52.565088 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0253f-18f6-46dd-aa53-22d2fcadfc74 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:52.565594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0253f-18f6-46dd-aa53-22d2fcadfc74 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:52.566095 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0253f-18f6-46dd-aa53-22d2fcadfc74 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:52.567503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0253f-18f6-46dd-aa53-22d2fcadfc74 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:52.567965 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0253f-18f6-46dd-aa53-22d2fcadfc74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:52.570493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0253f-18f6-46dd-aa53-22d2fcadfc74 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:52.586366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 510/1006] 10.222.0.32 () {56 vars in 1122 bytes} [Tue May 10 13:48:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:52.589557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43861c-9c03-42ab-b776-2372c926ed46 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:52.720345 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43861c-9c03-42ab-b776-2372c926ed46 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:52.771335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1b148-bdec-4253-a948-b04c0949bc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:52.772456 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1b148-bdec-4253-a948-b04c0949bc07 None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:52.772830 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1b148-bdec-4253-a948-b04c0949bc07 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:52.773237 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1b148-bdec-4253-a948-b04c0949bc07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:52.774120 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1b148-bdec-4253-a948-b04c0949bc07 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:52.775684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1b148-bdec-4253-a948-b04c0949bc07 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:52.793322 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 497/1007] 10.222.0.32 () {60 vars in 1144 bytes} [Tue May 10 13:48:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:48:54.113659 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b272d0-fccd-40a5-90cc-a19e2a4fd960 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:54.114163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b272d0-fccd-40a5-90cc-a19e2a4fd960 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:54.114163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b272d0-fccd-40a5-90cc-a19e2a4fd960 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:54.115693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 511/1008] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:54.121691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfb19a-ae46-413f-87e5-f83427c2a603 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:54.122217 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfb19a-ae46-413f-87e5-f83427c2a603 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:54.122447 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfb19a-ae46-413f-87e5-f83427c2a603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:54.140075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-9ecfb19a-ae46-413f-87e5-f83427c2a603 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:54.141282 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-9ecfb19a-ae46-413f-87e5-f83427c2a603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:54.228871 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 498/1009] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:54.253035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b272d0-fccd-40a5-90cc-a19e2a4fd960 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:54.360059 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef2bb5-e3f9-4acf-b53c-6d78b84fdc97 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:54.360428 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef2bb5-e3f9-4acf-b53c-6d78b84fdc97 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:54.360645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef2bb5-e3f9-4acf-b53c-6d78b84fdc97 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:54.362267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 499/1010] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:48:54.367998 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851d768-282c-4d07-a1e9-296d7af22a40 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:54.368194 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851d768-282c-4d07-a1e9-296d7af22a40 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:54.368482 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851d768-282c-4d07-a1e9-296d7af22a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:54.376040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b272d0-fccd-40a5-90cc-a19e2a4fd960 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:54.391840 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-5851d768-282c-4d07-a1e9-296d7af22a40 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:54.393120 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-5851d768-282c-4d07-a1e9-296d7af22a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:54.417375 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26368650-4f08-4f57-8a67-cf1268e8b8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:54.419027 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26368650-4f08-4f57-8a67-cf1268e8b8a6 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:54.419321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26368650-4f08-4f57-8a67-cf1268e8b8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:54.419594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26368650-4f08-4f57-8a67-cf1268e8b8a6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:54.420281 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26368650-4f08-4f57-8a67-cf1268e8b8a6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:54.421688 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26368650-4f08-4f57-8a67-cf1268e8b8a6 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:54.440326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-26368650-4f08-4f57-8a67-cf1268e8b8a6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 13:48:54.440326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:54.440326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:48:54.440326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:48:54.440326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:48:54.440326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:48:54.440326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:48:54.440326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:54.440326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 13:48:54.440326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:54.440326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:54.440326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:54.440326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:54.440326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:54.440326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:54.440326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:54.440326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:54.441505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:54.441505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:54.441505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:54.441505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:54.441505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:54.441505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:54.441505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:48:54.441505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:48:54.441505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:48:54.441505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:48:54.441505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:54.441505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:54.441505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:54.441505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:54.441505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:54.441505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:54.442397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:54.442397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:54.442397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:54.442397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:54.442397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:54.442397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:54.442397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:54.442397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:54.442397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:54.442397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:54.442397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:48:54.442397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:54.442397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 13:48:54.442397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:54.443457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 512/1011] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:48:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:54.452505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26368650-4f08-4f57-8a67-cf1268e8b8a6 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:54.473670 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 500/1012] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:48:54.497169 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851d768-282c-4d07-a1e9-296d7af22a40 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:54.555372 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26368650-4f08-4f57-8a67-cf1268e8b8a6 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:54.595304 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff40494-d8af-45a1-9070-5ba647f0b220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:54.596085 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff40494-d8af-45a1-9070-5ba647f0b220 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:54.596290 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff40494-d8af-45a1-9070-5ba647f0b220 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:54.596539 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff40494-d8af-45a1-9070-5ba647f0b220 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:54.597248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff40494-d8af-45a1-9070-5ba647f0b220 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:54.597544 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff40494-d8af-45a1-9070-5ba647f0b220 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:54.598950 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff40494-d8af-45a1-9070-5ba647f0b220 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:54.603898 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 513/1013] 10.222.0.32 () {56 vars in 1112 bytes} [Tue May 10 13:48:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:54.607586 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851d768-282c-4d07-a1e9-296d7af22a40 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:54.610604 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff40494-d8af-45a1-9070-5ba647f0b220 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:54.645237 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc436ac-1ec6-4190-95cf-856e07df4f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:54.646242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc436ac-1ec6-4190-95cf-856e07df4f9b None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:54.646515 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc436ac-1ec6-4190-95cf-856e07df4f9b None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:54.646783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc436ac-1ec6-4190-95cf-856e07df4f9b None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:54.647522 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc436ac-1ec6-4190-95cf-856e07df4f9b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:54.648899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc436ac-1ec6-4190-95cf-856e07df4f9b None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:54.678258 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 501/1014] 10.222.0.32 () {60 vars in 1141 bytes} [Tue May 10 13:48:54 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:48:54.735136 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff40494-d8af-45a1-9070-5ba647f0b220 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:54.789112 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6939ef-c654-4dde-830f-2f6f1fd1e778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:54.789792 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6939ef-c654-4dde-830f-2f6f1fd1e778 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:54.790068 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6939ef-c654-4dde-830f-2f6f1fd1e778 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:54.790378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6939ef-c654-4dde-830f-2f6f1fd1e778 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:54.791096 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6939ef-c654-4dde-830f-2f6f1fd1e778 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:54.791400 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6939ef-c654-4dde-830f-2f6f1fd1e778 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:54.792792 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6939ef-c654-4dde-830f-2f6f1fd1e778 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:54.799191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 514/1015] 10.222.0.32 () {56 vars in 1112 bytes} [Tue May 10 13:48:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:54.804778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc436ac-1ec6-4190-95cf-856e07df4f9b None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:54.970600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc436ac-1ec6-4190-95cf-856e07df4f9b None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:55.015129 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87821e76-0509-47e4-a57d-915627d63261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:55.015911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87821e76-0509-47e4-a57d-915627d63261 None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:55.016243 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87821e76-0509-47e4-a57d-915627d63261 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:55.016680 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87821e76-0509-47e4-a57d-915627d63261 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:55.017655 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87821e76-0509-47e4-a57d-915627d63261 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:55.019122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87821e76-0509-47e4-a57d-915627d63261 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:55.046254 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 502/1016] 10.222.0.32 () {60 vars in 1144 bytes} [Tue May 10 13:48:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:48:55.132942 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9b7ad-5069-4760-85cf-24f95416c820 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:55.133518 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9b7ad-5069-4760-85cf-24f95416c820 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:55.133954 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9b7ad-5069-4760-85cf-24f95416c820 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:55.135754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 515/1017] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:55.142422 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4fb07-d69b-4cc7-8d88-d5f36ad88f9c None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:55.142943 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4fb07-d69b-4cc7-8d88-d5f36ad88f9c None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:55.143041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4fb07-d69b-4cc7-8d88-d5f36ad88f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:55.163247 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-7bb4fb07-d69b-4cc7-8d88-d5f36ad88f9c None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:55.164485 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-7bb4fb07-d69b-4cc7-8d88-d5f36ad88f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:55.267889 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 503/1018] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:48:55.294226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9b7ad-5069-4760-85cf-24f95416c820 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:55.417036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9b7ad-5069-4760-85cf-24f95416c820 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:55.476797 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c76f0-3848-409f-95d1-745de18a5f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:55.478139 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c76f0-3848-409f-95d1-745de18a5f42 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:55.478652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c76f0-3848-409f-95d1-745de18a5f42 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:55.479141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c76f0-3848-409f-95d1-745de18a5f42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:55.481815 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c76f0-3848-409f-95d1-745de18a5f42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:55.484801 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c76f0-3848-409f-95d1-745de18a5f42 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:55.494315 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 516/1019] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:55.498420 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4fb07-d69b-4cc7-8d88-d5f36ad88f9c None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:55.644980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4fb07-d69b-4cc7-8d88-d5f36ad88f9c None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:55.683280 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a7800-e9b5-42cf-933a-814adec40787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:55.684707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a7800-e9b5-42cf-933a-814adec40787 None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:55.684990 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a7800-e9b5-42cf-933a-814adec40787 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:55.685266 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a7800-e9b5-42cf-933a-814adec40787 None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:55.686006 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a7800-e9b5-42cf-933a-814adec40787 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:55.687478 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a7800-e9b5-42cf-933a-814adec40787 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:55.724995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 504/1020] 10.222.0.32 () {60 vars in 1141 bytes} [Tue May 10 13:48:55 2022] POST /identity/v3/projects => generated 311 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:48:57.370943 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572501e6-24a5-4b69-a2e0-dc4fb6a877ae None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:57.371746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572501e6-24a5-4b69-a2e0-dc4fb6a877ae None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:57.371746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572501e6-24a5-4b69-a2e0-dc4fb6a877ae None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:57.372931 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 517/1021] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:57.382220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32680d3-b555-4c96-ae6a-dc102d4bdc63 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:57.382738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32680d3-b555-4c96-ae6a-dc102d4bdc63 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:57.383199 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32680d3-b555-4c96-ae6a-dc102d4bdc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:57.413188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-a32680d3-b555-4c96-ae6a-dc102d4bdc63 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:57.415189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a32680d3-b555-4c96-ae6a-dc102d4bdc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:57.542257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 505/1022] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:57.563566 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572501e6-24a5-4b69-a2e0-dc4fb6a877ae None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:57.687734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572501e6-24a5-4b69-a2e0-dc4fb6a877ae None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:57.728447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f73419-2f91-4f67-b6d9-a48f740741f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:57.729271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f73419-2f91-4f67-b6d9-a48f740741f5 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:57.729553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f73419-2f91-4f67-b6d9-a48f740741f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:57.729832 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f73419-2f91-4f67-b6d9-a48f740741f5 None admin] PATH_INFO: `/v3/services/image` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:57.731183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f73419-2f91-4f67-b6d9-a48f740741f5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:57.732781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f73419-2f91-4f67-b6d9-a48f740741f5 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:57.745191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-54f73419-2f91-4f67-b6d9-a48f740741f5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 13:48:57.745191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:57.745191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:48:57.745191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:48:57.745191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:48:57.745191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:48:57.745191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:48:57.745191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:57.745191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 13:48:57.745191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:57.745191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:57.745191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:57.745191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:57.745191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:57.745191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:57.745191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:57.745191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:57.748271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:57.748271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:57.748271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:57.748271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:57.748271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:57.748271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:57.748271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:48:57.748271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:48:57.748271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:48:57.748271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:48:57.748271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:57.748271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:57.748271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:57.748271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:57.748271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:57.748271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:57.749647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:57.749647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:57.749647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:57.749647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:57.749647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:57.749647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:57.749647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:57.749647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:57.749647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:57.749647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:57.749647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:48:57.749647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:48:57.749647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 13:48:57.749647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:57.749647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 518/1023] 10.222.0.32 () {56 vars in 1105 bytes} [Tue May 10 13:48:57 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:57.753713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32680d3-b555-4c96-ae6a-dc102d4bdc63 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:57.915045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32680d3-b555-4c96-ae6a-dc102d4bdc63 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:57.957133 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ba099-69bc-4c26-8d7d-50258dc14e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:57.957735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ba099-69bc-4c26-8d7d-50258dc14e99 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:57.958026 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ba099-69bc-4c26-8d7d-50258dc14e99 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:57.958322 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ba099-69bc-4c26-8d7d-50258dc14e99 None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:57.959059 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ba099-69bc-4c26-8d7d-50258dc14e99 None admin] RBAC: Adding query filter params (name=image) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:57.959366 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ba099-69bc-4c26-8d7d-50258dc14e99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:57.960783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ba099-69bc-4c26-8d7d-50258dc14e99 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:57.970397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 506/1024] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:57.973271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f73419-2f91-4f67-b6d9-a48f740741f5 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:58.006078 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc64d12-876f-4dd9-9d3c-baf83be1ff9b None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:58.006470 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc64d12-876f-4dd9-9d3c-baf83be1ff9b None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:58.006849 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc64d12-876f-4dd9-9d3c-baf83be1ff9b None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:58.008949 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 507/1025] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:48:58.015938 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb5623-c03b-40d0-95cd-60e483a5a0e2 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:58.016353 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb5623-c03b-40d0-95cd-60e483a5a0e2 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:58.016607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb5623-c03b-40d0-95cd-60e483a5a0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:58.038609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-fadb5623-c03b-40d0-95cd-60e483a5a0e2 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:58.039948 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-fadb5623-c03b-40d0-95cd-60e483a5a0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:58.096712 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f73419-2f91-4f67-b6d9-a48f740741f5 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:58.116178 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 508/1026] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:48:58.117534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7741e-5a85-4094-aa2a-d7d38b4ca506 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:58.117846 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7741e-5a85-4094-aa2a-d7d38b4ca506 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:58.118120 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7741e-5a85-4094-aa2a-d7d38b4ca506 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:58.119721 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 509/1027] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:58.128431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576b69f-9ac9-4256-a54a-ae437cf6d3e2 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:58.128707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576b69f-9ac9-4256-a54a-ae437cf6d3e2 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:58.128986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576b69f-9ac9-4256-a54a-ae437cf6d3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:58.146765 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-1576b69f-9ac9-4256-a54a-ae437cf6d3e2 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:58.148065 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-1576b69f-9ac9-4256-a54a-ae437cf6d3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:58.152807 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1716c8-2395-44ce-b9de-e54d2aff8445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:58.153905 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1716c8-2395-44ce-b9de-e54d2aff8445 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:58.154240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1716c8-2395-44ce-b9de-e54d2aff8445 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:58.154508 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1716c8-2395-44ce-b9de-e54d2aff8445 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:58.155250 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1716c8-2395-44ce-b9de-e54d2aff8445 None admin] RBAC: Adding query filter params (type=image) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:58.155560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1716c8-2395-44ce-b9de-e54d2aff8445 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:58.156996 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1716c8-2395-44ce-b9de-e54d2aff8445 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:58.162748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 519/1028] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:58.163865 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1716c8-2395-44ce-b9de-e54d2aff8445 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:58.258308 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 510/1029] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:48:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:48:58.258308 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576b69f-9ac9-4256-a54a-ae437cf6d3e2 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:58.285731 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1716c8-2395-44ce-b9de-e54d2aff8445 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:58.332644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff568a11-9ea0-4419-a503-097c4b780e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:58.333479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff568a11-9ea0-4419-a503-097c4b780e93 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:58.333756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff568a11-9ea0-4419-a503-097c4b780e93 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:58.334028 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff568a11-9ea0-4419-a503-097c4b780e93 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:58.349243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff568a11-9ea0-4419-a503-097c4b780e93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:58.357919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-ff568a11-9ea0-4419-a503-097c4b780e93 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:48:58.357919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:58.357919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:58.357919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:58.357919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:58.357919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:58.357919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:58.357919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:58.357919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:58.357919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:58.357919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:58.357919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:58.357919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:58.357919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:58.357919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:58.357919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:58.358982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:58.358982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:58.358982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:58.358982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:58.358982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:58.358982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:58.358982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:58.358982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:58.358982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:58.358982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:58.358982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:58.358982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:58.358982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:58.358982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:58.358982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:58.358982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:58.359837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:58.359837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:58.359837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:58.359837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:58.359837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:58.359837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:58.359837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:58.359837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:58.359837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:58.359837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:58.359837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:48:58.359837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:58.359837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 520/1030] 10.222.0.32 () {56 vars in 1120 bytes} [Tue May 10 13:48:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:58.360536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff568a11-9ea0-4419-a503-097c4b780e93 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:58.364943 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576b69f-9ac9-4256-a54a-ae437cf6d3e2 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:58.403183 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e06c7-6f8e-478d-a68c-d9fa8826fa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:58.404116 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e06c7-6f8e-478d-a68c-d9fa8826fa72 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:58.404116 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e06c7-6f8e-478d-a68c-d9fa8826fa72 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:58.404377 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e06c7-6f8e-478d-a68c-d9fa8826fa72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:58.405214 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e06c7-6f8e-478d-a68c-d9fa8826fa72 None admin] RBAC: Adding query filter params (interface=public, service_id=9c9646c080de4db5951740eacfbf069c, region_id=RegionOne) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:58.405525 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e06c7-6f8e-478d-a68c-d9fa8826fa72 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:58.407036 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e06c7-6f8e-478d-a68c-d9fa8826fa72 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:58.412451 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 511/1031] 10.222.0.32 () {56 vars in 1251 bytes} [Tue May 10 13:48:58 2022] GET /identity/v3/endpoints?service_id=9c9646c080de4db5951740eacfbf069c&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:58.413276 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e06c7-6f8e-478d-a68c-d9fa8826fa72 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:58.476704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff568a11-9ea0-4419-a503-097c4b780e93 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:58.515415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adaff31-0e58-4c0f-be57-523c4ea27864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:58.516127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaff31-0e58-4c0f-be57-523c4ea27864 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:58.516407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaff31-0e58-4c0f-be57-523c4ea27864 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:58.516684 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaff31-0e58-4c0f-be57-523c4ea27864 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:58.517869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adaff31-0e58-4c0f-be57-523c4ea27864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:58.519349 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adaff31-0e58-4c0f-be57-523c4ea27864 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:58.520985 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 521/1032] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:58.521776 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adaff31-0e58-4c0f-be57-523c4ea27864 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:58.529355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e06c7-6f8e-478d-a68c-d9fa8826fa72 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:58.566125 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e44e5-60b6-4698-9e6f-8c423f89bc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:58.566877 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e44e5-60b6-4698-9e6f-8c423f89bc6e None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:58.567113 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e44e5-60b6-4698-9e6f-8c423f89bc6e None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:58.567389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e44e5-60b6-4698-9e6f-8c423f89bc6e None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:58.568144 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e44e5-60b6-4698-9e6f-8c423f89bc6e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:58.568509 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e44e5-60b6-4698-9e6f-8c423f89bc6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:58.569893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e44e5-60b6-4698-9e6f-8c423f89bc6e None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:58.579602 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 512/1033] 10.222.0.32 () {56 vars in 1115 bytes} [Tue May 10 13:48:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:58.580260 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e44e5-60b6-4698-9e6f-8c423f89bc6e None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:58.627778 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adaff31-0e58-4c0f-be57-523c4ea27864 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:58.662880 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38c81d-e77f-4ce2-a59d-acc4c132942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:58.663557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38c81d-e77f-4ce2-a59d-acc4c132942c None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:58.663834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38c81d-e77f-4ce2-a59d-acc4c132942c None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:58.664122 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38c81d-e77f-4ce2-a59d-acc4c132942c None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:58.664783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38c81d-e77f-4ce2-a59d-acc4c132942c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:58.666158 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38c81d-e77f-4ce2-a59d-acc4c132942c None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:58.673608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 522/1034] 10.222.0.32 () {56 vars in 1087 bytes} [Tue May 10 13:48:58 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:48:58.674468 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38c81d-e77f-4ce2-a59d-acc4c132942c None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:58.686874 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e44e5-60b6-4698-9e6f-8c423f89bc6e None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:58.726902 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dba1a8-3e3a-4ff2-b109-76c180baa03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:58.727583 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dba1a8-3e3a-4ff2-b109-76c180baa03a None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:58.727862 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dba1a8-3e3a-4ff2-b109-76c180baa03a None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:58.728274 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dba1a8-3e3a-4ff2-b109-76c180baa03a None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:58.728873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dba1a8-3e3a-4ff2-b109-76c180baa03a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:58.730718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dba1a8-3e3a-4ff2-b109-76c180baa03a None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:58.758425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 513/1035] 10.222.0.32 () {60 vars in 1132 bytes} [Tue May 10 13:48:58 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:48:58.801840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38c81d-e77f-4ce2-a59d-acc4c132942c None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:58.849714 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ff7de-a891-4e16-b3ec-4e5604008e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:58.850589 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ff7de-a891-4e16-b3ec-4e5604008e41 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:58.850877 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ff7de-a891-4e16-b3ec-4e5604008e41 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:58.851159 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ff7de-a891-4e16-b3ec-4e5604008e41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:58.866791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ff7de-a891-4e16-b3ec-4e5604008e41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:58.868530 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ff7de-a891-4e16-b3ec-4e5604008e41 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:58.900153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-321ff7de-a891-4e16-b3ec-4e5604008e41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:58.900153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:58.900153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:58.900153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:58.900153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:58.900153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:58.900153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:58.900153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:58.900153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:58.900153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:58.900153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:58.900153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:58.900153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:58.900153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:58.900153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:58.901378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:58.901378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:58.901378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:58.901378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:58.901378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:58.901378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:58.901378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:58.901378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:58.901378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:58.901378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:58.901378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:58.901378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:58.901378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:58.901378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:58.901378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:58.901378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:58.901378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:58.903145 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:48:58.903145 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:58.903145 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:48:58.903145 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:58.903145 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 523/1036] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:58.909096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dba1a8-3e3a-4ff2-b109-76c180baa03a None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:59.023947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dba1a8-3e3a-4ff2-b109-76c180baa03a None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:59.065473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efeb4be-cbd4-4e67-bf3b-95e1b047b8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:59.066064 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeb4be-cbd4-4e67-bf3b-95e1b047b8bf None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:59.066375 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeb4be-cbd4-4e67-bf3b-95e1b047b8bf None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:59.066648 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeb4be-cbd4-4e67-bf3b-95e1b047b8bf None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:59.067371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efeb4be-cbd4-4e67-bf3b-95e1b047b8bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:59.067685 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efeb4be-cbd4-4e67-bf3b-95e1b047b8bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:59.069568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efeb4be-cbd4-4e67-bf3b-95e1b047b8bf None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:59.089486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 514/1037] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:59.096009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ff7de-a891-4e16-b3ec-4e5604008e41 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:59.283551 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ff7de-a891-4e16-b3ec-4e5604008e41 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:59.344634 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9548780-a245-44c9-83c8-f1260fb7f9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:59.345456 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9548780-a245-44c9-83c8-f1260fb7f9c7 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:59.345740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9548780-a245-44c9-83c8-f1260fb7f9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:59.346017 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9548780-a245-44c9-83c8-f1260fb7f9c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:59.357279 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9548780-a245-44c9-83c8-f1260fb7f9c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:59.359047 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9548780-a245-44c9-83c8-f1260fb7f9c7 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:59.374687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-b9548780-a245-44c9-83c8-f1260fb7f9c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 13:48:59.374687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:59.374687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:59.374687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:59.374687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:59.374687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:59.374687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:59.374687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:59.374687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:59.374687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:59.374687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:59.374687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:59.374687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:48:59.374687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:48:59.374687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:48:59.374687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:48:59.375753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:59.375753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:59.375753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:48:59.375753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:59.375753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:48:59.375753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:48:59.375753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:59.375753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:59.375753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:59.375753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:59.375753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:59.375753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:48:59.375753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:59.375753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:59.375753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:59.375753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:59.375753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:59.375753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:59.379002 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:59.379002 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:59.379002 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:48:59.379002 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:48:59.379002 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:48:59.379002 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:48:59.379002 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:48:59.379002 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:48:59.379002 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 13:48:59.379002 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:48:59.379002 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 524/1038] 10.222.0.32 () {56 vars in 1093 bytes} [Tue May 10 13:48:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:48:59.381847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efeb4be-cbd4-4e67-bf3b-95e1b047b8bf None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:59.491161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efeb4be-cbd4-4e67-bf3b-95e1b047b8bf None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:59.526930 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe972a86-6e94-418e-a05e-5ca28382ddd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:59.528788 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe972a86-6e94-418e-a05e-5ca28382ddd4 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:59.529069 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe972a86-6e94-418e-a05e-5ca28382ddd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:59.529339 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe972a86-6e94-418e-a05e-5ca28382ddd4 None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:59.530192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe972a86-6e94-418e-a05e-5ca28382ddd4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:59.530527 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe972a86-6e94-418e-a05e-5ca28382ddd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:59.531987 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe972a86-6e94-418e-a05e-5ca28382ddd4 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:59.556589 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 515/1039] 10.222.0.32 () {56 vars in 1133 bytes} [Tue May 10 13:48:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:59.558564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9548780-a245-44c9-83c8-f1260fb7f9c7 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:59.667399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9548780-a245-44c9-83c8-f1260fb7f9c7 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:59.701826 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fba86e-e6b8-41b7-9978-a437e5f10f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:59.702523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fba86e-e6b8-41b7-9978-a437e5f10f80 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:59.702811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fba86e-e6b8-41b7-9978-a437e5f10f80 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:59.703088 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fba86e-e6b8-41b7-9978-a437e5f10f80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:59.776459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fba86e-e6b8-41b7-9978-a437e5f10f80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:59.779182 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fba86e-e6b8-41b7-9978-a437e5f10f80 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:59.902117 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 525/1040] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:48:59 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:48:59.911679 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe972a86-6e94-418e-a05e-5ca28382ddd4 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:00.045838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe972a86-6e94-418e-a05e-5ca28382ddd4 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:00.115980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f180db-b1c0-4f19-ae83-0d3178607bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:00.117821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f180db-b1c0-4f19-ae83-0d3178607bfb None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:00.118685 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f180db-b1c0-4f19-ae83-0d3178607bfb None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:00.119478 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f180db-b1c0-4f19-ae83-0d3178607bfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:00.140547 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f180db-b1c0-4f19-ae83-0d3178607bfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:00.143775 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f180db-b1c0-4f19-ae83-0d3178607bfb None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:00.178815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-20f180db-b1c0-4f19-ae83-0d3178607bfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:00.178815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:00.178815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:00.178815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:00.178815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:00.178815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:00.178815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:00.178815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:00.178815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:00.178815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:00.178815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:00.178815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:00.178815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:49:00.178815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:49:00.178815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:49:00.180608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:49:00.180608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:00.180608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:00.180608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:00.180608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:00.180608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:00.180608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:00.180608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:00.180608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:49:00.180608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:00.180608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:00.180608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:00.180608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:00.180608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:00.180608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:00.180608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:00.180608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:00.182487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:49:00.182487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:49:00.182487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:00.182487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:49:00.189673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 516/1041] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:48:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:00.194815 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fba86e-e6b8-41b7-9978-a437e5f10f80 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:00.348174 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fba86e-e6b8-41b7-9978-a437e5f10f80 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:00.402491 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9a59d-79d7-4ee2-addf-1991d052b2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:00.403271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9a59d-79d7-4ee2-addf-1991d052b2b0 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:00.403552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9a59d-79d7-4ee2-addf-1991d052b2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:00.403819 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9a59d-79d7-4ee2-addf-1991d052b2b0 None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:00.404555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9a59d-79d7-4ee2-addf-1991d052b2b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:00.404852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9a59d-79d7-4ee2-addf-1991d052b2b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:00.406316 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9a59d-79d7-4ee2-addf-1991d052b2b0 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:00.423583 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 526/1042] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:00.425449 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f180db-b1c0-4f19-ae83-0d3178607bfb None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:00.536782 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f180db-b1c0-4f19-ae83-0d3178607bfb None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:00.576170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817dd5a-7292-466b-8b6d-bdd537ff5bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:00.576989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817dd5a-7292-466b-8b6d-bdd537ff5bac None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:00.577269 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817dd5a-7292-466b-8b6d-bdd537ff5bac None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:00.577537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817dd5a-7292-466b-8b6d-bdd537ff5bac None admin] PATH_INFO: `/v3/projects/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:00.586577 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817dd5a-7292-466b-8b6d-bdd537ff5bac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:00.588315 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817dd5a-7292-466b-8b6d-bdd537ff5bac None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:00.603900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-d817dd5a-7292-466b-8b6d-bdd537ff5bac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:49:00.603900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:00.603900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:00.603900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:00.603900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:00.603900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:00.603900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:00.603900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:00.603900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:00.603900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:00.603900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:00.603900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:00.603900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:49:00.603900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:49:00.603900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:49:00.605081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:49:00.605081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:00.605081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:00.605081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:00.605081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:00.605081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:00.605081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:00.605081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:00.605081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:49:00.605081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:00.605081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:00.605081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:00.605081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:00.605081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:00.605081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:00.605081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:00.605081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:00.613327 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:49:00.613327 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:49:00.613327 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:49:00.613327 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:49:00.613327 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:49:00.613327 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:49:00.613327 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:49:00.613327 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:49:00.613327 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 517/1043] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:49:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:00.615624 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9a59d-79d7-4ee2-addf-1991d052b2b0 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:00.744479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9a59d-79d7-4ee2-addf-1991d052b2b0 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:00.785553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b696e4-39e6-43a6-a660-8dffc6433b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:00.786244 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b696e4-39e6-43a6-a660-8dffc6433b23 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:00.786535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b696e4-39e6-43a6-a660-8dffc6433b23 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:00.786808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b696e4-39e6-43a6-a660-8dffc6433b23 None admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:00.787615 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b696e4-39e6-43a6-a660-8dffc6433b23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:00.787923 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b696e4-39e6-43a6-a660-8dffc6433b23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:00.789387 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b696e4-39e6-43a6-a660-8dffc6433b23 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:00.804808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 527/1044] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:49:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:00.811230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817dd5a-7292-466b-8b6d-bdd537ff5bac None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:00.944405 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817dd5a-7292-466b-8b6d-bdd537ff5bac None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:00.987115 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db98c1-d01b-4242-bfc7-c927ef44ab89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:00.987798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db98c1-d01b-4242-bfc7-c927ef44ab89 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:00.988084 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db98c1-d01b-4242-bfc7-c927ef44ab89 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:00.988365 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db98c1-d01b-4242-bfc7-c927ef44ab89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:00.989215 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db98c1-d01b-4242-bfc7-c927ef44ab89 None admin] RBAC: Adding query filter params (role.id=d4565519f0024088b8818c0f36bc4822, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=e5d4fd26c21f4170a6790369344f8334) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:00.989523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db98c1-d01b-4242-bfc7-c927ef44ab89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:00.991098 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db98c1-d01b-4242-bfc7-c927ef44ab89 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:01.002246 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 518/1045] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:49:00 2022] GET /identity/v3/role_assignments?user.id=e5d4fd26c21f4170a6790369344f8334&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=d4565519f0024088b8818c0f36bc4822 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:01.019080 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134d9c6-e12c-4243-a944-9f24210b1397 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:01.019384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134d9c6-e12c-4243-a944-9f24210b1397 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:01.019643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134d9c6-e12c-4243-a944-9f24210b1397 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:01.021408 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 528/1046] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:49:01.028462 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701927e0-540f-47e5-a7d8-bbeac3d55931 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:01.028862 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701927e0-540f-47e5-a7d8-bbeac3d55931 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:01.029056 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701927e0-540f-47e5-a7d8-bbeac3d55931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:01.048025 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-701927e0-540f-47e5-a7d8-bbeac3d55931 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:01.049247 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-701927e0-540f-47e5-a7d8-bbeac3d55931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:01.162407 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 519/1047] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:49:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:49:01.186706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134d9c6-e12c-4243-a944-9f24210b1397 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:01.208919 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05da258-182b-4e1d-a03f-c6c0d96877dd None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:01.209272 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05da258-182b-4e1d-a03f-c6c0d96877dd None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:01.209545 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05da258-182b-4e1d-a03f-c6c0d96877dd None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:01.211563 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 520/1048] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:49:01.218674 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dec87-7db0-49db-808d-51333891eeb9 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:01.219182 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dec87-7db0-49db-808d-51333891eeb9 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:01.219688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dec87-7db0-49db-808d-51333891eeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:01.241756 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-8e1dec87-7db0-49db-808d-51333891eeb9 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:01.243105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-8e1dec87-7db0-49db-808d-51333891eeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:01.321948 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 521/1049] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:49:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:49:01.330246 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134d9c6-e12c-4243-a944-9f24210b1397 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:01.346092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1dec87-7db0-49db-808d-51333891eeb9 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:01.379824 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cdbf7-643e-4935-af5b-010b6fc2fa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:01.380632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cdbf7-643e-4935-af5b-010b6fc2fa55 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:01.380914 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cdbf7-643e-4935-af5b-010b6fc2fa55 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:01.381188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cdbf7-643e-4935-af5b-010b6fc2fa55 None admin] PATH_INFO: `/v3/services/image` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:01.381867 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cdbf7-643e-4935-af5b-010b6fc2fa55 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:01.383304 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cdbf7-643e-4935-af5b-010b6fc2fa55 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:01.395783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-968cdbf7-643e-4935-af5b-010b6fc2fa55 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 13:49:01.395783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:01.395783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:49:01.395783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:49:01.395783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:49:01.395783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:49:01.395783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:49:01.395783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:49:01.395783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 13:49:01.395783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:49:01.395783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:49:01.395783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:49:01.395783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:01.395783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:01.395783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:01.395783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:01.395783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:01.397748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:01.397748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:01.397748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:01.397748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:01.397748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:01.397748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:01.397748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:49:01.397748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:49:01.397748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:49:01.397748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:49:01.397748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:01.397748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:01.397748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:01.397748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:01.397748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:01.397748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:01.399512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:01.399512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:49:01.399512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:01.399512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:01.399512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:01.399512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:01.399512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:01.399512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:01.399512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:01.399512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:01.399512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:49:01.399512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:49:01.399512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 13:49:01.399512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:49:01.399512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 529/1050] 10.222.0.32 () {56 vars in 1105 bytes} [Tue May 10 13:49:01 2022] GET /identity/v3/services/image => generated 86 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:49:01.404523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cdbf7-643e-4935-af5b-010b6fc2fa55 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:01.483100 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1dec87-7db0-49db-808d-51333891eeb9 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:01.524121 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8dabc-df80-44ce-8758-cc3479b28573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:01.525054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8dabc-df80-44ce-8758-cc3479b28573 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:01.525401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8dabc-df80-44ce-8758-cc3479b28573 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:01.525743 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8dabc-df80-44ce-8758-cc3479b28573 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:01.540375 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8dabc-df80-44ce-8758-cc3479b28573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:49:01.549096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-69e8dabc-df80-44ce-8758-cc3479b28573 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:49:01.549096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:01.549096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:01.549096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:01.549096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:01.549096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:01.549096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:01.549096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:01.549096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:01.549096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:01.549096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:01.549096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:01.549096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:49:01.549096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:49:01.549096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:49:01.549096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:49:01.550439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:49:01.550439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:49:01.550439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:49:01.550439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:49:01.550439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:01.550439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:01.550439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:01.550439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:01.550439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:01.550439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:01.550439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:01.550439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:49:01.550439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:01.550439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:01.550439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:01.550439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:01.551517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:01.551517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:01.551517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:01.551517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:01.551517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:49:01.551517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:49:01.551517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:49:01.551517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:49:01.551517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:49:01.551517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:49:01.551517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:49:01.551517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:49:01.554672 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 522/1051] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:49:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:49:01.556486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8dabc-df80-44ce-8758-cc3479b28573 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:01.564601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cdbf7-643e-4935-af5b-010b6fc2fa55 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:01.616441 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8877e4-f299-4667-81c8-4b68f9b2f4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:01.617224 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8877e4-f299-4667-81c8-4b68f9b2f4ce None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:01.617508 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8877e4-f299-4667-81c8-4b68f9b2f4ce None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:01.617842 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8877e4-f299-4667-81c8-4b68f9b2f4ce None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:01.618613 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8877e4-f299-4667-81c8-4b68f9b2f4ce None admin] RBAC: Adding query filter params (name=image) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:01.618930 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8877e4-f299-4667-81c8-4b68f9b2f4ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:01.620334 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8877e4-f299-4667-81c8-4b68f9b2f4ce None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:01.631478 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 530/1052] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:49:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:01.632706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8877e4-f299-4667-81c8-4b68f9b2f4ce None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:01.679197 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8dabc-df80-44ce-8758-cc3479b28573 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:01.716088 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8460e-d572-4919-a8be-474eeba43ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:01.716791 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8460e-d572-4919-a8be-474eeba43ccd None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:01.717048 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8460e-d572-4919-a8be-474eeba43ccd None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:01.717383 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8460e-d572-4919-a8be-474eeba43ccd None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:01.718080 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8460e-d572-4919-a8be-474eeba43ccd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:01.718411 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8460e-d572-4919-a8be-474eeba43ccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:01.719792 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8460e-d572-4919-a8be-474eeba43ccd None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:01.734499 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 523/1053] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:49:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:01.736114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8460e-d572-4919-a8be-474eeba43ccd None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:01.767423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8877e4-f299-4667-81c8-4b68f9b2f4ce None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:01.809565 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ee158-ea6f-4295-8d40-cb2f5e6e4341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:01.810273 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ee158-ea6f-4295-8d40-cb2f5e6e4341 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:01.810562 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ee158-ea6f-4295-8d40-cb2f5e6e4341 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:01.810839 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ee158-ea6f-4295-8d40-cb2f5e6e4341 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:01.811558 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ee158-ea6f-4295-8d40-cb2f5e6e4341 None admin] RBAC: Adding query filter params (type=image) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:01.812004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ee158-ea6f-4295-8d40-cb2f5e6e4341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:01.813266 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ee158-ea6f-4295-8d40-cb2f5e6e4341 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:01.822393 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 531/1054] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:49:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:01.829968 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ee158-ea6f-4295-8d40-cb2f5e6e4341 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:01.861600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8460e-d572-4919-a8be-474eeba43ccd None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:01.918396 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc314c-1297-4294-8ccb-ae80de3a1306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:01.919286 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc314c-1297-4294-8ccb-ae80de3a1306 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:01.919552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc314c-1297-4294-8ccb-ae80de3a1306 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:01.919824 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc314c-1297-4294-8ccb-ae80de3a1306 None admin] PATH_INFO: `/v3/users/5f41939da71447d89e7bf61bb85057fe` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:01.942331 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc314c-1297-4294-8ccb-ae80de3a1306 None admin] RBAC: Authorizing `identity:get_user(user_id=5f41939da71447d89e7bf61bb85057fe)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:01.944613 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc314c-1297-4294-8ccb-ae80de3a1306 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:01.948047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 524/1055] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:49:01 2022] GET /identity/v3/users/5f41939da71447d89e7bf61bb85057fe => generated 285 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:01.953799 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc314c-1297-4294-8ccb-ae80de3a1306 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:01.978755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ee158-ea6f-4295-8d40-cb2f5e6e4341 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:02.023616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca1c8b-8823-4831-8d4f-175251db339e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:02.024391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca1c8b-8823-4831-8d4f-175251db339e None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:02.024794 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca1c8b-8823-4831-8d4f-175251db339e None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:02.025256 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca1c8b-8823-4831-8d4f-175251db339e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:02.026187 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca1c8b-8823-4831-8d4f-175251db339e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:02.028501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca1c8b-8823-4831-8d4f-175251db339e None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:02.058938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 532/1056] 10.222.0.32 () {60 vars in 1144 bytes} [Tue May 10 13:49:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:49:02.094339 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc314c-1297-4294-8ccb-ae80de3a1306 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:02.151176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5799c-4512-468a-b3af-af3f477f17c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:02.153297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5799c-4512-468a-b3af-af3f477f17c7 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:02.153691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5799c-4512-468a-b3af-af3f477f17c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:02.153973 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5799c-4512-468a-b3af-af3f477f17c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:02.247651 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5799c-4512-468a-b3af-af3f477f17c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:02.249511 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5799c-4512-468a-b3af-af3f477f17c7 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:02.390123 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 525/1057] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:49:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 13:49:02.395903 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca1c8b-8823-4831-8d4f-175251db339e None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:02.513155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca1c8b-8823-4831-8d4f-175251db339e None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:02.558005 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d676198-c475-4ede-929b-bcda996082ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:02.559481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d676198-c475-4ede-929b-bcda996082ed None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:02.559770 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d676198-c475-4ede-929b-bcda996082ed None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:02.560050 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d676198-c475-4ede-929b-bcda996082ed None admin] PATH_INFO: `/v3/projects/1f19b3e69ad746e0abfb110f1f792a3d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:02.561394 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d676198-c475-4ede-929b-bcda996082ed None admin] RBAC: Authorizing `identity:get_project(project_id=1f19b3e69ad746e0abfb110f1f792a3d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:02.562964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d676198-c475-4ede-929b-bcda996082ed None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:02.569874 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 533/1058] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:49:02 2022] GET /identity/v3/projects/1f19b3e69ad746e0abfb110f1f792a3d => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:02.571143 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5799c-4512-468a-b3af-af3f477f17c7 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:02.681204 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5799c-4512-468a-b3af-af3f477f17c7 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:02.728272 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29b5c0-1f6a-42cc-a41d-a789feeedd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:02.729396 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29b5c0-1f6a-42cc-a41d-a789feeedd6e None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:02.729930 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29b5c0-1f6a-42cc-a41d-a789feeedd6e None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:02.731022 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29b5c0-1f6a-42cc-a41d-a789feeedd6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:02.732389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29b5c0-1f6a-42cc-a41d-a789feeedd6e None admin] RBAC: Adding query filter params (role.id=17e40821fc444dd0b040dcfce3eb222b, scope.project.id=1f19b3e69ad746e0abfb110f1f792a3d, user.id=5f41939da71447d89e7bf61bb85057fe) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:02.733298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29b5c0-1f6a-42cc-a41d-a789feeedd6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:02.735088 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29b5c0-1f6a-42cc-a41d-a789feeedd6e None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:02.742906 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 526/1059] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:49:02 2022] GET /identity/v3/role_assignments?user.id=5f41939da71447d89e7bf61bb85057fe&scope.project.id=1f19b3e69ad746e0abfb110f1f792a3d&role.id=17e40821fc444dd0b040dcfce3eb222b => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:03.567621 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f3422-399f-4e2c-8e4b-44424601540f None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:03.568152 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f3422-399f-4e2c-8e4b-44424601540f None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:03.568232 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f3422-399f-4e2c-8e4b-44424601540f None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:03.570059 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 534/1060] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:49:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:49:03.576633 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489233e-5ba1-468a-967f-8c4f606a3929 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:03.577141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489233e-5ba1-468a-967f-8c4f606a3929 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:03.577221 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489233e-5ba1-468a-967f-8c4f606a3929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:03.594991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-a489233e-5ba1-468a-967f-8c4f606a3929 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:03.596176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a489233e-5ba1-468a-967f-8c4f606a3929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:03.674190 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 527/1061] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:49:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:49:03.697061 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f3422-399f-4e2c-8e4b-44424601540f None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:03.800626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f3422-399f-4e2c-8e4b-44424601540f None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:03.842627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623f166-e072-4869-9605-e8ff1380603f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:03.843811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623f166-e072-4869-9605-e8ff1380603f None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:03.844290 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623f166-e072-4869-9605-e8ff1380603f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:03.844774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623f166-e072-4869-9605-e8ff1380603f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:03.862579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623f166-e072-4869-9605-e8ff1380603f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:49:03.876899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-a623f166-e072-4869-9605-e8ff1380603f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:49:03.876899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:03.876899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:03.876899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:03.876899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:03.876899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:03.876899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:03.876899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:03.876899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:03.876899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:03.876899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:03.876899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:03.876899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:49:03.876899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:49:03.876899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:49:03.876899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:49:03.877908 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:49:03.877908 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:49:03.877908 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:49:03.877908 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:49:03.877908 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:03.877908 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:03.877908 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:03.877908 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:03.877908 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:03.877908 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:03.877908 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:03.877908 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:49:03.877908 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:03.877908 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:03.877908 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:03.877908 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:03.878864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:03.878864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:03.878864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:03.878864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:03.878864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:49:03.878864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:49:03.878864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:49:03.878864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:49:03.878864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:49:03.878864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:49:03.878864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:49:03.878864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:49:03.880344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 535/1062] 10.222.0.32 () {56 vars in 1120 bytes} [Tue May 10 13:49:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:03.887914 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489233e-5ba1-468a-967f-8c4f606a3929 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:04.041615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489233e-5ba1-468a-967f-8c4f606a3929 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:04.077266 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4981c3-83ea-465a-8dac-d974cd4b7a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:04.077949 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4981c3-83ea-465a-8dac-d974cd4b7a03 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:04.078254 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4981c3-83ea-465a-8dac-d974cd4b7a03 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:04.078531 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4981c3-83ea-465a-8dac-d974cd4b7a03 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:04.079295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4981c3-83ea-465a-8dac-d974cd4b7a03 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:04.079599 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4981c3-83ea-465a-8dac-d974cd4b7a03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:04.081085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4981c3-83ea-465a-8dac-d974cd4b7a03 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:04.092011 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 528/1063] 10.222.0.32 () {56 vars in 1115 bytes} [Tue May 10 13:49:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:04.098627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623f166-e072-4869-9605-e8ff1380603f None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:04.218440 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623f166-e072-4869-9605-e8ff1380603f None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:04.259874 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b5950-bd3c-4438-a7f6-fc304b359a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:04.260677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b5950-bd3c-4438-a7f6-fc304b359a83 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:04.260962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b5950-bd3c-4438-a7f6-fc304b359a83 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:04.261235 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b5950-bd3c-4438-a7f6-fc304b359a83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:04.272438 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b5950-bd3c-4438-a7f6-fc304b359a83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:04.274091 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b5950-bd3c-4438-a7f6-fc304b359a83 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:04.295926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-9a8b5950-bd3c-4438-a7f6-fc304b359a83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:04.295926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:04.295926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:04.295926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:04.295926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:04.295926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:04.295926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:04.295926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:04.295926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:04.295926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:04.295926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:04.295926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:04.295926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:49:04.295926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:49:04.295926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:49:04.296915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:49:04.296915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:04.296915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:04.296915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:04.296915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:04.296915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:04.296915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:04.296915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:04.296915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:49:04.296915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:04.296915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:04.296915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:04.296915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:04.296915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:04.296915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:04.296915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:04.296915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:04.302662 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:49:04.302662 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:49:04.302662 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:04.302662 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:49:04.302662 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 536/1064] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:49:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:04.304559 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4981c3-83ea-465a-8dac-d974cd4b7a03 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:04.406190 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4981c3-83ea-465a-8dac-d974cd4b7a03 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:04.445393 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714c162-1137-4896-a8f5-584d0796a154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:04.446064 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714c162-1137-4896-a8f5-584d0796a154 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:04.446369 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714c162-1137-4896-a8f5-584d0796a154 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:04.446643 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714c162-1137-4896-a8f5-584d0796a154 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:04.447383 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714c162-1137-4896-a8f5-584d0796a154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:04.447685 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714c162-1137-4896-a8f5-584d0796a154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:04.449773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714c162-1137-4896-a8f5-584d0796a154 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:04.463567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 529/1065] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:04.469155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b5950-bd3c-4438-a7f6-fc304b359a83 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:04.574753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b5950-bd3c-4438-a7f6-fc304b359a83 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:04.597842 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312317b-d116-49b2-9a83-8592ceecd62d None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:04.598516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312317b-d116-49b2-9a83-8592ceecd62d None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:04.598516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312317b-d116-49b2-9a83-8592ceecd62d None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:04.599964 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 530/1066] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:49:04.605268 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f577ee-0fbb-40ba-b776-8579c31d660b None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:04.605586 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f577ee-0fbb-40ba-b776-8579c31d660b None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:04.605943 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f577ee-0fbb-40ba-b776-8579c31d660b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:04.617738 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438f5a7-7579-480c-b621-e403868dc01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:04.618627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438f5a7-7579-480c-b621-e403868dc01f None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:04.618916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438f5a7-7579-480c-b621-e403868dc01f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:04.619191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438f5a7-7579-480c-b621-e403868dc01f None admin] PATH_INFO: `/v3/users/nova` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:04.623854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-24f577ee-0fbb-40ba-b776-8579c31d660b None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:04.625048 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-24f577ee-0fbb-40ba-b776-8579c31d660b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:04.629181 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438f5a7-7579-480c-b621-e403868dc01f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:04.630674 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438f5a7-7579-480c-b621-e403868dc01f None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:04.645882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-a438f5a7-7579-480c-b621-e403868dc01f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 13:49:04.645882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:04.645882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:04.645882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:04.645882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:04.645882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:04.645882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:04.645882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:04.645882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:04.645882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:04.645882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:04.645882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:04.645882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:49:04.645882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:49:04.645882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:49:04.645882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:49:04.647081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:04.647081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:04.647081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:49:04.647081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:49:04.647081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:49:04.647081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:49:04.647081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:04.647081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:04.647081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:04.647081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:04.647081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:04.647081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:49:04.647081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:04.647081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:04.647081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:04.647081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:04.647081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:04.647081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:04.648580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:04.648580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:04.648580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:49:04.648580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:49:04.648580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:49:04.648580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:49:04.648580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:49:04.648580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:49:04.648580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 13:49:04.648580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:49:04.648580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 537/1067] 10.222.0.32 () {56 vars in 1093 bytes} [Tue May 10 13:49:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:04.652852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438f5a7-7579-480c-b621-e403868dc01f None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:04.711235 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 531/1068] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:49:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:49:04.723893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f577ee-0fbb-40ba-b776-8579c31d660b None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:04.795591 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438f5a7-7579-480c-b621-e403868dc01f None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:04.838356 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1ebe6-41df-4ac4-8042-3d595ef3199c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:04.839050 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1ebe6-41df-4ac4-8042-3d595ef3199c None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:04.839328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1ebe6-41df-4ac4-8042-3d595ef3199c None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:04.839634 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1ebe6-41df-4ac4-8042-3d595ef3199c None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:04.840500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1ebe6-41df-4ac4-8042-3d595ef3199c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:04.840801 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1ebe6-41df-4ac4-8042-3d595ef3199c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:04.842280 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1ebe6-41df-4ac4-8042-3d595ef3199c None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:04.862858 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 538/1069] 10.222.0.32 () {56 vars in 1133 bytes} [Tue May 10 13:49:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:04.867845 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f577ee-0fbb-40ba-b776-8579c31d660b None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:04.868636 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1ebe6-41df-4ac4-8042-3d595ef3199c None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:04.914289 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1e31b-02ef-4226-b0e2-09130e96adff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:04.914962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1e31b-02ef-4226-b0e2-09130e96adff None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:04.915241 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1e31b-02ef-4226-b0e2-09130e96adff None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:04.915508 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1e31b-02ef-4226-b0e2-09130e96adff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:04.998309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1e31b-02ef-4226-b0e2-09130e96adff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:05.000067 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1e31b-02ef-4226-b0e2-09130e96adff None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:05.013417 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1ebe6-41df-4ac4-8042-3d595ef3199c None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:05.050326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7210f5-ea1c-46c8-a9f0-c9120b304208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:05.051127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7210f5-ea1c-46c8-a9f0-c9120b304208 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:05.051404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7210f5-ea1c-46c8-a9f0-c9120b304208 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:05.051675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7210f5-ea1c-46c8-a9f0-c9120b304208 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:05.072657 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7210f5-ea1c-46c8-a9f0-c9120b304208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:05.075683 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7210f5-ea1c-46c8-a9f0-c9120b304208 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:05.095523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-5d7210f5-ea1c-46c8-a9f0-c9120b304208 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:05.095523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:05.095523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:05.095523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:05.095523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:05.095523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:05.095523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:05.095523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:05.095523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:05.095523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:05.095523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:05.095523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:05.095523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:49:05.095523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:49:05.095523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:49:05.096492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:49:05.096492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:05.096492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:05.096492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:05.096492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:05.096492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:05.096492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:05.096492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:05.096492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:49:05.096492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:05.096492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:05.096492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:05.096492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:05.096492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:05.096492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:05.096492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:05.096492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:05.097384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:49:05.097384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:49:05.097384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:05.097384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:49:05.097384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 539/1070] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:49:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:49:05.098264 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733c31f-f782-4ba7-94a5-617d40d03aed None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:05.098470 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733c31f-f782-4ba7-94a5-617d40d03aed None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:05.098720 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733c31f-f782-4ba7-94a5-617d40d03aed None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:05.100280 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 540/1071] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:49:05.103240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733c31f-f782-4ba7-94a5-617d40d03aed None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:05.139512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 532/1072] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:49:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 13:49:05.140919 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a8268-25d5-4207-a05c-495f5dc87309 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:05.141268 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a8268-25d5-4207-a05c-495f5dc87309 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:05.141551 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a8268-25d5-4207-a05c-495f5dc87309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:05.161455 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-318a8268-25d5-4207-a05c-495f5dc87309 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:05.162714 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-318a8268-25d5-4207-a05c-495f5dc87309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:05.225935 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733c31f-f782-4ba7-94a5-617d40d03aed None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:05.252710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 533/1073] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:49:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:49:05.253773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a8268-25d5-4207-a05c-495f5dc87309 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:05.268806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88751538-c63e-4de1-962e-3ebebc1c9d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:05.269957 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88751538-c63e-4de1-962e-3ebebc1c9d1f None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:05.270485 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88751538-c63e-4de1-962e-3ebebc1c9d1f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:05.270974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88751538-c63e-4de1-962e-3ebebc1c9d1f None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:05.272326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88751538-c63e-4de1-962e-3ebebc1c9d1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:05.272879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88751538-c63e-4de1-962e-3ebebc1c9d1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:05.275535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88751538-c63e-4de1-962e-3ebebc1c9d1f None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:05.291472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 541/1074] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:05.292303 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88751538-c63e-4de1-962e-3ebebc1c9d1f None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:05.407039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88751538-c63e-4de1-962e-3ebebc1c9d1f None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:05.418277 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a8268-25d5-4207-a05c-495f5dc87309 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:05.445509 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee893dc8-dbaf-4d81-9ac8-b741020e6d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:05.446352 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee893dc8-dbaf-4d81-9ac8-b741020e6d22 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:05.446634 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee893dc8-dbaf-4d81-9ac8-b741020e6d22 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:05.446907 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee893dc8-dbaf-4d81-9ac8-b741020e6d22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:05.458852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee893dc8-dbaf-4d81-9ac8-b741020e6d22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:49:05.460443 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf44d8-9a59-41c8-8031-fdba98c8cd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:05.461255 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf44d8-9a59-41c8-8031-fdba98c8cd98 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:05.461544 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf44d8-9a59-41c8-8031-fdba98c8cd98 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:05.461817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf44d8-9a59-41c8-8031-fdba98c8cd98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:05.467222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-ee893dc8-dbaf-4d81-9ac8-b741020e6d22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:49:05.467222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:05.467222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:05.467222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:05.467222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:05.467222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:05.467222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:05.467222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:05.467222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:05.467222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:05.467222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:05.467222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:05.467222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:49:05.467222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:49:05.467222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:49:05.467222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:49:05.468601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:49:05.468601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:49:05.468601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:49:05.468601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:49:05.468601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:05.468601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:05.468601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:05.468601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:05.468601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:05.468601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:05.468601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:05.468601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:49:05.468601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:05.468601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:05.468601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:05.468601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:05.469635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:05.469635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:05.469635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:05.469635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:05.469635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:49:05.469635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:49:05.469635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:49:05.469635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:49:05.469635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:49:05.469635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:49:05.469635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:49:05.469635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:49:05.469635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 542/1075] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:49:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:05.471150 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee893dc8-dbaf-4d81-9ac8-b741020e6d22 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:05.475189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf44d8-9a59-41c8-8031-fdba98c8cd98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:05.476670 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf44d8-9a59-41c8-8031-fdba98c8cd98 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:05.495749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-1ebf44d8-9a59-41c8-8031-fdba98c8cd98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:05.495749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:05.495749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:05.495749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:05.495749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:05.495749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:05.495749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:05.495749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:05.495749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:05.495749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:05.495749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:05.495749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:05.495749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:49:05.495749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:49:05.495749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:49:05.497161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:49:05.497161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:05.497161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:05.497161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:05.497161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:05.497161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:05.497161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:05.497161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:05.497161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:49:05.497161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:05.497161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:05.497161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:05.497161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:05.497161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:05.497161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:05.497161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:05.497161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:05.498065 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:49:05.498065 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:49:05.498065 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:05.498065 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:49:05.498065 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 534/1076] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:49:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:05.498900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf44d8-9a59-41c8-8031-fdba98c8cd98 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:05.589195 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee893dc8-dbaf-4d81-9ac8-b741020e6d22 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:05.614739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf44d8-9a59-41c8-8031-fdba98c8cd98 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:05.628087 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644ebfb-e57b-4b67-87e1-d0438d14d7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:05.628897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644ebfb-e57b-4b67-87e1-d0438d14d7f1 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:05.629176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644ebfb-e57b-4b67-87e1-d0438d14d7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:05.629448 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644ebfb-e57b-4b67-87e1-d0438d14d7f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:05.637295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644ebfb-e57b-4b67-87e1-d0438d14d7f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:05.638782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644ebfb-e57b-4b67-87e1-d0438d14d7f1 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:05.654676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-3644ebfb-e57b-4b67-87e1-d0438d14d7f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:49:05.654676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:05.654676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:05.654676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:05.654676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:05.654676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:05.654676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:05.654676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:05.654676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:05.654676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:05.654676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:05.654676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:05.654676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:49:05.654676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:49:05.654676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:49:05.655879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:49:05.655879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:05.655879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:05.655879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:05.655879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:05.655879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:05.655879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:05.655879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:05.655879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:49:05.655879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:05.655879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:05.655879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:05.655879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:05.655879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:05.655879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:05.655879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:05.655879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:05.656952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:49:05.656952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:49:05.656952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:49:05.656952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:49:05.656952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:49:05.656952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:49:05.656952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:49:05.656952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:49:05.656952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 543/1077] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:49:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:05.656952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644ebfb-e57b-4b67-87e1-d0438d14d7f1 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:05.660786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065f710-0b5d-456d-b70e-29ac8dd3a7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:05.661615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065f710-0b5d-456d-b70e-29ac8dd3a7e3 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:05.666243 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065f710-0b5d-456d-b70e-29ac8dd3a7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:05.666243 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065f710-0b5d-456d-b70e-29ac8dd3a7e3 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:05.666243 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065f710-0b5d-456d-b70e-29ac8dd3a7e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:05.666243 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065f710-0b5d-456d-b70e-29ac8dd3a7e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:05.666243 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065f710-0b5d-456d-b70e-29ac8dd3a7e3 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:05.679085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 535/1078] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:49:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:05.680044 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065f710-0b5d-456d-b70e-29ac8dd3a7e3 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:05.765280 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644ebfb-e57b-4b67-87e1-d0438d14d7f1 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:05.792953 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065f710-0b5d-456d-b70e-29ac8dd3a7e3 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:05.801544 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b387d8-f549-48ab-abca-631a25108791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:05.802253 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b387d8-f549-48ab-abca-631a25108791 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:05.802526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b387d8-f549-48ab-abca-631a25108791 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:05.802796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b387d8-f549-48ab-abca-631a25108791 None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:05.803535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b387d8-f549-48ab-abca-631a25108791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:05.803831 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b387d8-f549-48ab-abca-631a25108791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:05.805202 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b387d8-f549-48ab-abca-631a25108791 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:05.817682 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 544/1079] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:05.818572 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b387d8-f549-48ab-abca-631a25108791 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:05.835699 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d43cd2-82d8-4606-9769-1a2d268cb3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:05.836704 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d43cd2-82d8-4606-9769-1a2d268cb3ef None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:05.837126 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d43cd2-82d8-4606-9769-1a2d268cb3ef None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:05.837542 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d43cd2-82d8-4606-9769-1a2d268cb3ef None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:05.838827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d43cd2-82d8-4606-9769-1a2d268cb3ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:05.839381 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d43cd2-82d8-4606-9769-1a2d268cb3ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:05.842289 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d43cd2-82d8-4606-9769-1a2d268cb3ef None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:05.862869 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 536/1080] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:49:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:05.872534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d43cd2-82d8-4606-9769-1a2d268cb3ef None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:05.956804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b387d8-f549-48ab-abca-631a25108791 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:06.000473 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80d78f-1426-4b66-9505-d51e5401c39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:06.001378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80d78f-1426-4b66-9505-d51e5401c39f None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:06.001653 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80d78f-1426-4b66-9505-d51e5401c39f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:06.001930 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80d78f-1426-4b66-9505-d51e5401c39f None admin] PATH_INFO: `/v3/users/5f41939da71447d89e7bf61bb85057fe` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:06.003375 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80d78f-1426-4b66-9505-d51e5401c39f None admin] RBAC: Authorizing `identity:get_user(user_id=5f41939da71447d89e7bf61bb85057fe)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:06.004849 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80d78f-1426-4b66-9505-d51e5401c39f None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:06.006661 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 545/1081] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:49:05 2022] GET /identity/v3/users/5f41939da71447d89e7bf61bb85057fe => generated 285 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:06.013300 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80d78f-1426-4b66-9505-d51e5401c39f None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:06.045593 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d43cd2-82d8-4606-9769-1a2d268cb3ef None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:06.086601 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccfb42-03c5-4309-b308-d71f8d74fa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:06.087525 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccfb42-03c5-4309-b308-d71f8d74fa68 None admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:06.087807 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccfb42-03c5-4309-b308-d71f8d74fa68 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:06.088083 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccfb42-03c5-4309-b308-d71f8d74fa68 None admin] PATH_INFO: `/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/e5d4fd26c21f4170a6790369344f8334/roles/d4565519f0024088b8818c0f36bc4822` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:06.091362 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccfb42-03c5-4309-b308-d71f8d74fa68 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1cda14bca5c497dba2d18685dfe6cc2, user_id=e5d4fd26c21f4170a6790369344f8334, role_id=d4565519f0024088b8818c0f36bc4822)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:06.092767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccfb42-03c5-4309-b308-d71f8d74fa68 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:06.115297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 537/1082] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:49:05 2022] PUT /identity/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/e5d4fd26c21f4170a6790369344f8334/roles/d4565519f0024088b8818c0f36bc4822 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 13:49:06.195593 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80d78f-1426-4b66-9505-d51e5401c39f None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:06.259674 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ae39f-25b1-458f-8a60-61b04863aa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:06.261128 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ae39f-25b1-458f-8a60-61b04863aa0a None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:06.262135 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ae39f-25b1-458f-8a60-61b04863aa0a None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:06.262553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ae39f-25b1-458f-8a60-61b04863aa0a None admin] PATH_INFO: `/v3/projects/1f19b3e69ad746e0abfb110f1f792a3d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:06.264521 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ae39f-25b1-458f-8a60-61b04863aa0a None admin] RBAC: Authorizing `identity:get_project(project_id=1f19b3e69ad746e0abfb110f1f792a3d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:06.267172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ae39f-25b1-458f-8a60-61b04863aa0a None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:06.269195 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 546/1083] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:49:06 2022] GET /identity/v3/projects/1f19b3e69ad746e0abfb110f1f792a3d => generated 311 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:06.275884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccfb42-03c5-4309-b308-d71f8d74fa68 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:06.423018 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccfb42-03c5-4309-b308-d71f8d74fa68 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:06.462241 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ab397-6da3-4966-bcc0-7fb570b05d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:06.463162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ab397-6da3-4966-bcc0-7fb570b05d6e None admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:06.463435 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ab397-6da3-4966-bcc0-7fb570b05d6e None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:06.463704 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ab397-6da3-4966-bcc0-7fb570b05d6e None admin] PATH_INFO: `/v3/projects/1f19b3e69ad746e0abfb110f1f792a3d/users/5f41939da71447d89e7bf61bb85057fe/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:06.466000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ab397-6da3-4966-bcc0-7fb570b05d6e None admin] RBAC: Authorizing `identity:create_grant(project_id=1f19b3e69ad746e0abfb110f1f792a3d, user_id=5f41939da71447d89e7bf61bb85057fe, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:06.467507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ab397-6da3-4966-bcc0-7fb570b05d6e None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:06.484126 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 538/1084] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:49:06 2022] PUT /identity/v3/projects/1f19b3e69ad746e0abfb110f1f792a3d/users/5f41939da71447d89e7bf61bb85057fe/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 13:49:08.513249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd39e55-8e07-4abd-b228-f5252d8152c9 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:08.513832 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd39e55-8e07-4abd-b228-f5252d8152c9 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:08.514125 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd39e55-8e07-4abd-b228-f5252d8152c9 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:08.516781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 547/1085] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:49:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:49:08.524713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb9f62-15fc-4fe2-9f78-d1515e5e4057 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:08.525431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb9f62-15fc-4fe2-9f78-d1515e5e4057 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:08.525431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb9f62-15fc-4fe2-9f78-d1515e5e4057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:08.545177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-13bb9f62-15fc-4fe2-9f78-d1515e5e4057 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:08.546444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-13bb9f62-15fc-4fe2-9f78-d1515e5e4057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:08.624550 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 539/1086] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:49:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:49:08.648307 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd39e55-8e07-4abd-b228-f5252d8152c9 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:08.766755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd39e55-8e07-4abd-b228-f5252d8152c9 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:08.821306 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9471aa-0a6e-4e86-addb-a398c80d35ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:08.822370 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9471aa-0a6e-4e86-addb-a398c80d35ef None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:08.822781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9471aa-0a6e-4e86-addb-a398c80d35ef None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:08.823063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9471aa-0a6e-4e86-addb-a398c80d35ef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:08.845415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9471aa-0a6e-4e86-addb-a398c80d35ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:49:08.853656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-0b9471aa-0a6e-4e86-addb-a398c80d35ef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:49:08.853656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:08.853656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:08.853656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:08.853656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:08.853656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:08.853656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:08.853656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:08.853656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:08.853656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:08.853656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:08.853656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:08.853656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:49:08.853656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:49:08.853656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:49:08.853656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:49:08.861891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:49:08.861891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:49:08.861891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:49:08.861891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:49:08.861891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:08.861891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:08.861891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:08.861891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:08.861891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:08.861891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:08.861891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:08.861891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:49:08.861891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:08.861891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:08.861891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:08.861891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:08.863265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:08.863265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:08.863265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:08.863265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:08.863265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:49:08.863265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:49:08.863265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:49:08.863265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:49:08.863265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:49:08.863265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:49:08.863265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:49:08.863265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:49:08.863265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 548/1087] 10.222.0.32 () {56 vars in 1120 bytes} [Tue May 10 13:49:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:08.865168 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb9f62-15fc-4fe2-9f78-d1515e5e4057 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:08.999348 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb9f62-15fc-4fe2-9f78-d1515e5e4057 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:09.013549 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f6b5b-6cb6-4374-a376-bb2e206f0580 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:09.013993 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f6b5b-6cb6-4374-a376-bb2e206f0580 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:09.014517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f6b5b-6cb6-4374-a376-bb2e206f0580 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:09.017330 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 549/1088] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:49:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:49:09.026997 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfacf8-22cc-4935-b132-19bb3209c1f1 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:09.027507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfacf8-22cc-4935-b132-19bb3209c1f1 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:09.028162 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfacf8-22cc-4935-b132-19bb3209c1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:09.041762 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58679d37-933d-409a-903b-dce667a259b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:09.042944 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58679d37-933d-409a-903b-dce667a259b8 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:09.043393 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58679d37-933d-409a-903b-dce667a259b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:09.043862 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58679d37-933d-409a-903b-dce667a259b8 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:09.046863 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58679d37-933d-409a-903b-dce667a259b8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:09.047371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58679d37-933d-409a-903b-dce667a259b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:09.049770 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58679d37-933d-409a-903b-dce667a259b8 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:09.059054 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-7ebfacf8-22cc-4935-b132-19bb3209c1f1 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:09.061285 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-7ebfacf8-22cc-4935-b132-19bb3209c1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:09.065035 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 540/1089] 10.222.0.32 () {56 vars in 1115 bytes} [Tue May 10 13:49:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:09.071741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58679d37-933d-409a-903b-dce667a259b8 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:09.169666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 550/1090] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:49:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:49:09.196083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfacf8-22cc-4935-b132-19bb3209c1f1 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:09.216842 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58679d37-933d-409a-903b-dce667a259b8 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:09.254461 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71655d4-baf3-478a-a65a-01ea9cec1559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:09.255298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71655d4-baf3-478a-a65a-01ea9cec1559 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:09.255622 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71655d4-baf3-478a-a65a-01ea9cec1559 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:09.255927 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71655d4-baf3-478a-a65a-01ea9cec1559 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:09.268210 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71655d4-baf3-478a-a65a-01ea9cec1559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:09.269598 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71655d4-baf3-478a-a65a-01ea9cec1559 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:09.287631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-c71655d4-baf3-478a-a65a-01ea9cec1559 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:09.287631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:09.287631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:09.287631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:09.287631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:09.287631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:09.287631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:09.287631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:09.287631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:09.287631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:09.287631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:09.287631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:09.287631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:49:09.287631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:49:09.287631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:49:09.295242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:49:09.295242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:09.295242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:09.295242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:09.295242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:09.295242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:09.295242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:09.295242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:09.295242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:49:09.295242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:09.295242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:09.295242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:09.295242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:09.295242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:09.295242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:09.295242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:09.295242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:09.296172 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:49:09.296172 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:49:09.296172 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:09.296172 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:49:09.296172 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 541/1091] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:49:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:49:09.296478 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71655d4-baf3-478a-a65a-01ea9cec1559 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:09.378408 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfacf8-22cc-4935-b132-19bb3209c1f1 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:09.418662 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c3b61-46a9-4e5f-a473-fed0902a6961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:09.419482 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c3b61-46a9-4e5f-a473-fed0902a6961 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:09.419775 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c3b61-46a9-4e5f-a473-fed0902a6961 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:09.420026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c3b61-46a9-4e5f-a473-fed0902a6961 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:09.431938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c3b61-46a9-4e5f-a473-fed0902a6961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:49:09.439872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-5d9c3b61-46a9-4e5f-a473-fed0902a6961 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:49:09.439872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:09.439872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:09.439872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:09.439872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:09.439872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:09.439872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:09.439872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:09.439872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:09.439872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:09.439872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:09.439872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:09.439872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:49:09.439872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:49:09.439872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:49:09.439872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:49:09.441706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:49:09.441706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:49:09.441706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:49:09.441706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:49:09.441706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:09.441706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:09.441706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:09.441706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:09.441706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:09.441706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:09.441706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:09.441706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:49:09.441706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:09.441706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:09.441706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:09.441706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:09.442619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:09.442619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:09.442619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:09.442619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:09.442619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:49:09.442619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:49:09.442619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:49:09.442619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:49:09.442619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:49:09.442619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:49:09.442619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:49:09.442619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:49:09.442619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 551/1092] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:49:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:49:09.451154 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c3b61-46a9-4e5f-a473-fed0902a6961 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:09.456316 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71655d4-baf3-478a-a65a-01ea9cec1559 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:09.517799 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b6558-d484-4e07-aae4-d6987db3a1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:09.519069 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b6558-d484-4e07-aae4-d6987db3a1e1 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:09.519515 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b6558-d484-4e07-aae4-d6987db3a1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:09.520010 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b6558-d484-4e07-aae4-d6987db3a1e1 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:09.521417 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b6558-d484-4e07-aae4-d6987db3a1e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:09.521985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b6558-d484-4e07-aae4-d6987db3a1e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:09.524710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b6558-d484-4e07-aae4-d6987db3a1e1 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:09.547910 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 542/1093] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:09.554023 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b6558-d484-4e07-aae4-d6987db3a1e1 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:09.585367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c3b61-46a9-4e5f-a473-fed0902a6961 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:09.638920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147a6fe-7a76-49ae-8acd-5c2d92506ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:09.639762 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147a6fe-7a76-49ae-8acd-5c2d92506ce3 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:09.640146 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147a6fe-7a76-49ae-8acd-5c2d92506ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:09.640526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147a6fe-7a76-49ae-8acd-5c2d92506ce3 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:09.641386 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147a6fe-7a76-49ae-8acd-5c2d92506ce3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:09.641778 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147a6fe-7a76-49ae-8acd-5c2d92506ce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:09.643326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147a6fe-7a76-49ae-8acd-5c2d92506ce3 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:09.654711 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 552/1094] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:49:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:09.662138 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147a6fe-7a76-49ae-8acd-5c2d92506ce3 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:09.678091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b6558-d484-4e07-aae4-d6987db3a1e1 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:09.716613 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa8ac9-dd18-494f-90fb-dfd985130c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:09.717633 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa8ac9-dd18-494f-90fb-dfd985130c45 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:09.718022 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa8ac9-dd18-494f-90fb-dfd985130c45 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:09.718456 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa8ac9-dd18-494f-90fb-dfd985130c45 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:09.727651 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa8ac9-dd18-494f-90fb-dfd985130c45 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:09.729139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa8ac9-dd18-494f-90fb-dfd985130c45 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:09.754446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-9afa8ac9-dd18-494f-90fb-dfd985130c45 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 13:49:09.754446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:09.754446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:09.754446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:09.754446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:09.754446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:09.754446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:09.754446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:09.754446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:09.754446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:09.754446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:09.754446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:09.754446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:49:09.754446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:49:09.754446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:49:09.754446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:49:09.755989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:09.755989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:09.755989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:49:09.755989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:49:09.755989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:49:09.755989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:49:09.755989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:09.755989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:09.755989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:09.755989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:09.755989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:09.755989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:49:09.755989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:09.755989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:09.755989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:09.755989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:09.755989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:09.755989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:09.757543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:09.757543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:09.757543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:49:09.757543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:49:09.757543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:49:09.757543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:49:09.757543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:49:09.757543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:49:09.757543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 13:49:09.757543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:49:09.757543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 543/1095] 10.222.0.32 () {56 vars in 1093 bytes} [Tue May 10 13:49:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:49:09.765572 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa8ac9-dd18-494f-90fb-dfd985130c45 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:09.820487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147a6fe-7a76-49ae-8acd-5c2d92506ce3 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:09.872290 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01c5e0-aab4-46d8-a463-6d673a4cd542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:09.872870 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01c5e0-aab4-46d8-a463-6d673a4cd542 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:09.873151 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01c5e0-aab4-46d8-a463-6d673a4cd542 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:09.873419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01c5e0-aab4-46d8-a463-6d673a4cd542 None admin] PATH_INFO: `/v3/users/5f41939da71447d89e7bf61bb85057fe` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:09.874766 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01c5e0-aab4-46d8-a463-6d673a4cd542 None admin] RBAC: Authorizing `identity:get_user(user_id=5f41939da71447d89e7bf61bb85057fe)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:09.876216 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01c5e0-aab4-46d8-a463-6d673a4cd542 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:09.877937 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 553/1096] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:49:09 2022] GET /identity/v3/users/5f41939da71447d89e7bf61bb85057fe => generated 285 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:09.880413 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa8ac9-dd18-494f-90fb-dfd985130c45 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:09.883795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01c5e0-aab4-46d8-a463-6d673a4cd542 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:09.922917 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa399802-f974-4e95-af9b-619ee05467a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:09.923764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa399802-f974-4e95-af9b-619ee05467a2 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:09.924139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa399802-f974-4e95-af9b-619ee05467a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:09.924692 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa399802-f974-4e95-af9b-619ee05467a2 None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:09.925723 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa399802-f974-4e95-af9b-619ee05467a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:09.926135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa399802-f974-4e95-af9b-619ee05467a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:09.927793 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa399802-f974-4e95-af9b-619ee05467a2 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:09.957314 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 544/1097] 10.222.0.32 () {56 vars in 1133 bytes} [Tue May 10 13:49:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:09.962736 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa399802-f974-4e95-af9b-619ee05467a2 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:10.008217 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01c5e0-aab4-46d8-a463-6d673a4cd542 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:10.061512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc00056-ea7c-4c32-bf56-62846fb94b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:10.062572 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc00056-ea7c-4c32-bf56-62846fb94b20 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:10.063021 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc00056-ea7c-4c32-bf56-62846fb94b20 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:10.063460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc00056-ea7c-4c32-bf56-62846fb94b20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:10.117798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa399802-f974-4e95-af9b-619ee05467a2 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:10.173921 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc00056-ea7c-4c32-bf56-62846fb94b20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:10.175862 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330e3e9-1aad-4ab1-9a23-b52d34bbd72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:10.176370 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc00056-ea7c-4c32-bf56-62846fb94b20 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:10.176868 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330e3e9-1aad-4ab1-9a23-b52d34bbd72d None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:10.177306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330e3e9-1aad-4ab1-9a23-b52d34bbd72d None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:10.177744 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330e3e9-1aad-4ab1-9a23-b52d34bbd72d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:10.262046 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330e3e9-1aad-4ab1-9a23-b52d34bbd72d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:10.263755 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330e3e9-1aad-4ab1-9a23-b52d34bbd72d None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:10.331778 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 554/1098] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:49:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 13:49:10.339109 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc00056-ea7c-4c32-bf56-62846fb94b20 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:10.371721 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 545/1099] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:49:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 13:49:10.377732 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330e3e9-1aad-4ab1-9a23-b52d34bbd72d None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:10.492630 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc00056-ea7c-4c32-bf56-62846fb94b20 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:10.506188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330e3e9-1aad-4ab1-9a23-b52d34bbd72d None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:10.529876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3c257-e1e8-48ae-97ab-1a64585b4e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:10.530781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3c257-e1e8-48ae-97ab-1a64585b4e29 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:10.531057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3c257-e1e8-48ae-97ab-1a64585b4e29 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:10.531330 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3c257-e1e8-48ae-97ab-1a64585b4e29 None admin] PATH_INFO: `/v3/projects/1f19b3e69ad746e0abfb110f1f792a3d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:10.532571 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3c257-e1e8-48ae-97ab-1a64585b4e29 None admin] RBAC: Authorizing `identity:get_project(project_id=1f19b3e69ad746e0abfb110f1f792a3d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:10.534001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3c257-e1e8-48ae-97ab-1a64585b4e29 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:10.535791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 555/1100] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:49:10 2022] GET /identity/v3/projects/1f19b3e69ad746e0abfb110f1f792a3d => generated 311 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:10.543413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3c257-e1e8-48ae-97ab-1a64585b4e29 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:10.545971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc30fc6-8936-4ec9-a7a4-e2000cc7e8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:10.546906 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc30fc6-8936-4ec9-a7a4-e2000cc7e8d7 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:10.547271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc30fc6-8936-4ec9-a7a4-e2000cc7e8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:10.547630 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc30fc6-8936-4ec9-a7a4-e2000cc7e8d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:10.559392 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc30fc6-8936-4ec9-a7a4-e2000cc7e8d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:10.560869 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc30fc6-8936-4ec9-a7a4-e2000cc7e8d7 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:10.579612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-bcc30fc6-8936-4ec9-a7a4-e2000cc7e8d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:10.579612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:10.579612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:10.579612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:10.579612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:10.579612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:10.579612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:10.579612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:10.579612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:10.579612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:10.579612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:10.579612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:10.579612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:49:10.579612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:49:10.579612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:49:10.581401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:49:10.581401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:10.581401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:10.581401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:10.581401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:10.581401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:10.581401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:10.581401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:10.581401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:49:10.581401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:10.581401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:10.581401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:10.581401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:10.581401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:10.581401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:10.581401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:10.581401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:10.583173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:49:10.583173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:49:10.583173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:10.583173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:49:10.583173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 546/1101] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:49:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:49:10.587964 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc30fc6-8936-4ec9-a7a4-e2000cc7e8d7 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:10.673206 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3c257-e1e8-48ae-97ab-1a64585b4e29 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:10.713602 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0364fc-deaa-4b32-9935-043e7b418e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:10.715457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0364fc-deaa-4b32-9935-043e7b418e2b None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:10.716315 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0364fc-deaa-4b32-9935-043e7b418e2b None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:10.716315 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0364fc-deaa-4b32-9935-043e7b418e2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:10.717438 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0364fc-deaa-4b32-9935-043e7b418e2b None admin] RBAC: Adding query filter params (role.id=17e40821fc444dd0b040dcfce3eb222b, scope.project.id=1f19b3e69ad746e0abfb110f1f792a3d, user.id=5f41939da71447d89e7bf61bb85057fe) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:10.717873 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0364fc-deaa-4b32-9935-043e7b418e2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:10.719364 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc30fc6-8936-4ec9-a7a4-e2000cc7e8d7 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:10.719632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0364fc-deaa-4b32-9935-043e7b418e2b None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:10.726445 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 556/1102] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:49:10 2022] GET /identity/v3/role_assignments?user.id=5f41939da71447d89e7bf61bb85057fe&scope.project.id=1f19b3e69ad746e0abfb110f1f792a3d&role.id=17e40821fc444dd0b040dcfce3eb222b => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:10.763178 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1703fc5-e07d-4ccf-8385-c81fd0759ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:10.763972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1703fc5-e07d-4ccf-8385-c81fd0759ab0 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:10.764266 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1703fc5-e07d-4ccf-8385-c81fd0759ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:10.764537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1703fc5-e07d-4ccf-8385-c81fd0759ab0 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:10.765387 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1703fc5-e07d-4ccf-8385-c81fd0759ab0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:10.765710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1703fc5-e07d-4ccf-8385-c81fd0759ab0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:10.767234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1703fc5-e07d-4ccf-8385-c81fd0759ab0 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:10.782914 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 547/1103] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:10.789468 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0364fc-deaa-4b32-9935-043e7b418e2b None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:10.962825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0364fc-deaa-4b32-9935-043e7b418e2b None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:11.020760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2051a28-ad3e-4812-929d-9030816cbe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:11.021736 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2051a28-ad3e-4812-929d-9030816cbe00 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:11.022020 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2051a28-ad3e-4812-929d-9030816cbe00 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:11.022332 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2051a28-ad3e-4812-929d-9030816cbe00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:11.030760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2051a28-ad3e-4812-929d-9030816cbe00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:11.032215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2051a28-ad3e-4812-929d-9030816cbe00 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:11.046629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-a2051a28-ad3e-4812-929d-9030816cbe00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:49:11.046629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:11.046629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:11.046629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:11.046629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:11.046629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:11.046629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:11.046629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:11.046629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:11.046629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:11.046629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:11.046629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:11.046629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:49:11.046629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:49:11.046629 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:49:11.047637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:49:11.047637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:11.047637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:11.047637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:11.047637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:11.047637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:11.047637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:11.047637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:11.047637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:49:11.047637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:11.047637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:11.047637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:11.047637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:11.047637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:11.047637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:11.047637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:11.047637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:11.048556 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:49:11.048556 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:49:11.048556 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:49:11.048556 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:49:11.048556 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:49:11.048556 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:49:11.048556 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:49:11.048556 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:49:11.048556 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 557/1104] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:49:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:11.054508 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1703fc5-e07d-4ccf-8385-c81fd0759ab0 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:11.167754 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1703fc5-e07d-4ccf-8385-c81fd0759ab0 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:11.205692 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f6469-007c-4cab-8f36-06a2ccc4c9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:11.206396 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f6469-007c-4cab-8f36-06a2ccc4c9cd None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:11.206684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f6469-007c-4cab-8f36-06a2ccc4c9cd None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:11.206965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f6469-007c-4cab-8f36-06a2ccc4c9cd None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:11.207774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f6469-007c-4cab-8f36-06a2ccc4c9cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:11.208103 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f6469-007c-4cab-8f36-06a2ccc4c9cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:11.209562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f6469-007c-4cab-8f36-06a2ccc4c9cd None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:11.223696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 548/1105] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:49:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:11.230053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2051a28-ad3e-4812-929d-9030816cbe00 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:11.352014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2051a28-ad3e-4812-929d-9030816cbe00 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:11.405088 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35e9ce-004f-4b58-ae7f-ca12f4c66429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:11.406230 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35e9ce-004f-4b58-ae7f-ca12f4c66429 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:11.406661 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35e9ce-004f-4b58-ae7f-ca12f4c66429 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:11.407161 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35e9ce-004f-4b58-ae7f-ca12f4c66429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:11.408625 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35e9ce-004f-4b58-ae7f-ca12f4c66429 None admin] RBAC: Adding query filter params (role.id=d4565519f0024088b8818c0f36bc4822, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=e5d4fd26c21f4170a6790369344f8334) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:11.409100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35e9ce-004f-4b58-ae7f-ca12f4c66429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:11.411951 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35e9ce-004f-4b58-ae7f-ca12f4c66429 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:11.424027 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 558/1106] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:49:11 2022] GET /identity/v3/role_assignments?user.id=e5d4fd26c21f4170a6790369344f8334&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=d4565519f0024088b8818c0f36bc4822 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:13.149498 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7149b-cc51-42e8-aa3a-4d1b827f6cbe None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:13.150279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7149b-cc51-42e8-aa3a-4d1b827f6cbe None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:13.150279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7149b-cc51-42e8-aa3a-4d1b827f6cbe None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:13.151363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 549/1107] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:49:13.157501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20f010-84a9-44dc-9756-1850efde2df3 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:13.157966 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20f010-84a9-44dc-9756-1850efde2df3 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:13.158056 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20f010-84a9-44dc-9756-1850efde2df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:13.176436 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-6a20f010-84a9-44dc-9756-1850efde2df3 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:13.177626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-6a20f010-84a9-44dc-9756-1850efde2df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:13.251090 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 559/1108] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:49:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:49:13.275730 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7149b-cc51-42e8-aa3a-4d1b827f6cbe None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:13.384829 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7149b-cc51-42e8-aa3a-4d1b827f6cbe None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:13.422228 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dc213-ef7b-4221-8cbb-84f2d4a5bc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:13.422941 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dc213-ef7b-4221-8cbb-84f2d4a5bc9a None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:13.423223 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dc213-ef7b-4221-8cbb-84f2d4a5bc9a None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:13.423495 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dc213-ef7b-4221-8cbb-84f2d4a5bc9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:13.424700 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056dc213-ef7b-4221-8cbb-84f2d4a5bc9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:13.426140 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056dc213-ef7b-4221-8cbb-84f2d4a5bc9a None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:13.427821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 550/1109] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:49:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:13.437132 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20f010-84a9-44dc-9756-1850efde2df3 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:13.559839 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20f010-84a9-44dc-9756-1850efde2df3 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:13.593355 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc178ec-1bde-443a-bf4f-2717d84ac246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:13.594032 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc178ec-1bde-443a-bf4f-2717d84ac246 None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:13.594348 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc178ec-1bde-443a-bf4f-2717d84ac246 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:13.594623 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc178ec-1bde-443a-bf4f-2717d84ac246 None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:13.595326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc178ec-1bde-443a-bf4f-2717d84ac246 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:13.596762 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc178ec-1bde-443a-bf4f-2717d84ac246 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:13.618606 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 560/1110] 10.222.0.32 () {60 vars in 1132 bytes} [Tue May 10 13:49:13 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:49:16.028245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdec8d-db13-4713-815c-df03ab41962d None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:16.028935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdec8d-db13-4713-815c-df03ab41962d None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:16.028935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdec8d-db13-4713-815c-df03ab41962d None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:16.030133 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 551/1111] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:49:16.035637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7253314-1891-4305-9354-01411babd428 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:16.036080 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7253314-1891-4305-9354-01411babd428 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:16.036189 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7253314-1891-4305-9354-01411babd428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:16.054345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-c7253314-1891-4305-9354-01411babd428 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:16.055525 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c7253314-1891-4305-9354-01411babd428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:16.118592 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 561/1112] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:49:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:49:16.142445 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdec8d-db13-4713-815c-df03ab41962d None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:16.238229 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdec8d-db13-4713-815c-df03ab41962d None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:16.269983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8e4c4-9a5a-40aa-913b-bcd5b832d240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:16.270855 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8e4c4-9a5a-40aa-913b-bcd5b832d240 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:16.271132 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8e4c4-9a5a-40aa-913b-bcd5b832d240 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:16.271400 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8e4c4-9a5a-40aa-913b-bcd5b832d240 None admin] PATH_INFO: `/v3/roles/316da37136b4425f9ae486ae1e2bf4b4` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:16.272837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8e4c4-9a5a-40aa-913b-bcd5b832d240 None admin] RBAC: Authorizing `identity:get_role(role_id=316da37136b4425f9ae486ae1e2bf4b4)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:16.274218 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8e4c4-9a5a-40aa-913b-bcd5b832d240 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:16.275584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 552/1113] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:49:16 2022] GET /identity/v3/roles/316da37136b4425f9ae486ae1e2bf4b4 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:16.284891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7253314-1891-4305-9354-01411babd428 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:16.396748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7253314-1891-4305-9354-01411babd428 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:16.430092 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57426b30-8054-4a69-afc2-1d09f5678962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:16.430984 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57426b30-8054-4a69-afc2-1d09f5678962 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:16.431268 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57426b30-8054-4a69-afc2-1d09f5678962 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:16.431547 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57426b30-8054-4a69-afc2-1d09f5678962 None admin] PATH_INFO: `/v3/users/0e9b8b407dc1436d9c51c37d1440af46` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:16.445567 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57426b30-8054-4a69-afc2-1d09f5678962 None admin] RBAC: Authorizing `identity:get_user(user_id=0e9b8b407dc1436d9c51c37d1440af46)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:16.447059 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57426b30-8054-4a69-afc2-1d09f5678962 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:16.448838 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 562/1114] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:49:16 2022] GET /identity/v3/users/0e9b8b407dc1436d9c51c37d1440af46 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:16.455088 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8e4c4-9a5a-40aa-913b-bcd5b832d240 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:16.559769 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8e4c4-9a5a-40aa-913b-bcd5b832d240 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:16.594167 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35fab5-a542-4047-a4c6-e4d398c7b533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:16.594847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35fab5-a542-4047-a4c6-e4d398c7b533 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:16.595126 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35fab5-a542-4047-a4c6-e4d398c7b533 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:16.595398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35fab5-a542-4047-a4c6-e4d398c7b533 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:16.664532 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35fab5-a542-4047-a4c6-e4d398c7b533 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:16.665915 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35fab5-a542-4047-a4c6-e4d398c7b533 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:16.772288 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 553/1115] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:49:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:49:16.779680 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57426b30-8054-4a69-afc2-1d09f5678962 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:16.884885 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57426b30-8054-4a69-afc2-1d09f5678962 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:16.922578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0359630-dfe5-4733-a45a-62f0ef3ded2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:16.923371 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0359630-dfe5-4733-a45a-62f0ef3ded2f None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:16.923657 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0359630-dfe5-4733-a45a-62f0ef3ded2f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:16.923940 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0359630-dfe5-4733-a45a-62f0ef3ded2f None admin] PATH_INFO: `/v3/projects/1f19b3e69ad746e0abfb110f1f792a3d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:16.925157 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0359630-dfe5-4733-a45a-62f0ef3ded2f None admin] RBAC: Authorizing `identity:get_project(project_id=1f19b3e69ad746e0abfb110f1f792a3d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:16.926651 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0359630-dfe5-4733-a45a-62f0ef3ded2f None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:16.928389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 563/1116] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:49:16 2022] GET /identity/v3/projects/1f19b3e69ad746e0abfb110f1f792a3d => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:16.935229 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35fab5-a542-4047-a4c6-e4d398c7b533 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:17.043428 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35fab5-a542-4047-a4c6-e4d398c7b533 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:17.080405 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaca989-b50a-43ed-a410-785bc7d67736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:17.081073 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaca989-b50a-43ed-a410-785bc7d67736 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:17.081354 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaca989-b50a-43ed-a410-785bc7d67736 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:17.081626 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaca989-b50a-43ed-a410-785bc7d67736 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:17.082494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaca989-b50a-43ed-a410-785bc7d67736 None admin] RBAC: Adding query filter params (role.id=316da37136b4425f9ae486ae1e2bf4b4, scope.project.id=1f19b3e69ad746e0abfb110f1f792a3d, user.id=0e9b8b407dc1436d9c51c37d1440af46) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:17.082803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaca989-b50a-43ed-a410-785bc7d67736 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:17.084241 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaca989-b50a-43ed-a410-785bc7d67736 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:17.090282 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 554/1117] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:49:16 2022] GET /identity/v3/role_assignments?user.id=0e9b8b407dc1436d9c51c37d1440af46&scope.project.id=1f19b3e69ad746e0abfb110f1f792a3d&role.id=316da37136b4425f9ae486ae1e2bf4b4 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:19.353320 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba33125-08a1-4116-8aab-28b8a28e3597 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:19.353881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba33125-08a1-4116-8aab-28b8a28e3597 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:19.353881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba33125-08a1-4116-8aab-28b8a28e3597 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:19.356747 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 564/1118] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:49:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:49:19.365798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90589889-4f84-4792-9378-5e0e476367af None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:19.366340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90589889-4f84-4792-9378-5e0e476367af None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:19.366761 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90589889-4f84-4792-9378-5e0e476367af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:19.398438 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-90589889-4f84-4792-9378-5e0e476367af None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:19.400450 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-90589889-4f84-4792-9378-5e0e476367af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:19.494173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 555/1119] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:49:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:49:19.530521 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba33125-08a1-4116-8aab-28b8a28e3597 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:19.646808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba33125-08a1-4116-8aab-28b8a28e3597 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:19.684022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77fb03-0c54-4bef-ae9f-b09095fa1efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:19.684903 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77fb03-0c54-4bef-ae9f-b09095fa1efa None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:19.685185 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77fb03-0c54-4bef-ae9f-b09095fa1efa None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:19.685457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77fb03-0c54-4bef-ae9f-b09095fa1efa None admin] PATH_INFO: `/v3/roles/316da37136b4425f9ae486ae1e2bf4b4` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:19.687026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77fb03-0c54-4bef-ae9f-b09095fa1efa None admin] RBAC: Authorizing `identity:get_role(role_id=316da37136b4425f9ae486ae1e2bf4b4)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:19.688408 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77fb03-0c54-4bef-ae9f-b09095fa1efa None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:19.689805 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 565/1120] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:49:19 2022] GET /identity/v3/roles/316da37136b4425f9ae486ae1e2bf4b4 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:19.695912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90589889-4f84-4792-9378-5e0e476367af None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:19.804491 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90589889-4f84-4792-9378-5e0e476367af None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:19.841921 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5104e03-6139-4232-8d54-6c77911f771d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:19.842833 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5104e03-6139-4232-8d54-6c77911f771d None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:19.843114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5104e03-6139-4232-8d54-6c77911f771d None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:19.843387 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5104e03-6139-4232-8d54-6c77911f771d None admin] PATH_INFO: `/v3/users/0e9b8b407dc1436d9c51c37d1440af46` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:19.844611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5104e03-6139-4232-8d54-6c77911f771d None admin] RBAC: Authorizing `identity:get_user(user_id=0e9b8b407dc1436d9c51c37d1440af46)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:19.846064 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5104e03-6139-4232-8d54-6c77911f771d None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:19.847759 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 556/1121] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:49:19 2022] GET /identity/v3/users/0e9b8b407dc1436d9c51c37d1440af46 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:19.853788 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77fb03-0c54-4bef-ae9f-b09095fa1efa None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:19.967702 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77fb03-0c54-4bef-ae9f-b09095fa1efa None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:20.004580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e937e4-3db8-4021-ace4-0df3ca0b28fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:20.005546 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e937e4-3db8-4021-ace4-0df3ca0b28fb None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:20.005830 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e937e4-3db8-4021-ace4-0df3ca0b28fb None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:20.006109 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e937e4-3db8-4021-ace4-0df3ca0b28fb None admin] PATH_INFO: `/v3/projects/1f19b3e69ad746e0abfb110f1f792a3d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:20.007367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e937e4-3db8-4021-ace4-0df3ca0b28fb None admin] RBAC: Authorizing `identity:get_project(project_id=1f19b3e69ad746e0abfb110f1f792a3d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:20.008826 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e937e4-3db8-4021-ace4-0df3ca0b28fb None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:20.010603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 566/1122] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:49:19 2022] GET /identity/v3/projects/1f19b3e69ad746e0abfb110f1f792a3d => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:20.020854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5104e03-6139-4232-8d54-6c77911f771d None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:20.134861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5104e03-6139-4232-8d54-6c77911f771d None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:20.180646 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9d0d8-b359-4c20-a3ef-3f39ee36b541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:20.181537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9d0d8-b359-4c20-a3ef-3f39ee36b541 None admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:20.181814 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9d0d8-b359-4c20-a3ef-3f39ee36b541 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:20.182082 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9d0d8-b359-4c20-a3ef-3f39ee36b541 None admin] PATH_INFO: `/v3/projects/1f19b3e69ad746e0abfb110f1f792a3d/users/0e9b8b407dc1436d9c51c37d1440af46/roles/316da37136b4425f9ae486ae1e2bf4b4` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:20.184979 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9d0d8-b359-4c20-a3ef-3f39ee36b541 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f19b3e69ad746e0abfb110f1f792a3d, user_id=0e9b8b407dc1436d9c51c37d1440af46, role_id=316da37136b4425f9ae486ae1e2bf4b4)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:20.186460 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9d0d8-b359-4c20-a3ef-3f39ee36b541 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:20.201180 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 557/1123] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:49:20 2022] PUT /identity/v3/projects/1f19b3e69ad746e0abfb110f1f792a3d/users/0e9b8b407dc1436d9c51c37d1440af46/roles/316da37136b4425f9ae486ae1e2bf4b4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:49:22.472981 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ef38a-4a0f-4b69-be63-a9154cf8b2d3 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:22.473558 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ef38a-4a0f-4b69-be63-a9154cf8b2d3 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:22.473558 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ef38a-4a0f-4b69-be63-a9154cf8b2d3 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:22.474927 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 567/1124] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:49:22.481248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105f109-4770-4a05-b9c1-380f618bf57f None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:22.481735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105f109-4770-4a05-b9c1-380f618bf57f None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:22.481822 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105f109-4770-4a05-b9c1-380f618bf57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:22.498973 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-b105f109-4770-4a05-b9c1-380f618bf57f None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:22.500184 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b105f109-4770-4a05-b9c1-380f618bf57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:22.568852 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 558/1125] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:49:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:49:22.593387 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ef38a-4a0f-4b69-be63-a9154cf8b2d3 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:22.707417 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ef38a-4a0f-4b69-be63-a9154cf8b2d3 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:22.743586 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e4e7a-3392-473f-8e3a-2e919c2f38c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:22.744365 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e4e7a-3392-473f-8e3a-2e919c2f38c9 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:22.744650 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e4e7a-3392-473f-8e3a-2e919c2f38c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:22.744921 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e4e7a-3392-473f-8e3a-2e919c2f38c9 None admin] PATH_INFO: `/v3/roles/316da37136b4425f9ae486ae1e2bf4b4` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:22.747200 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e4e7a-3392-473f-8e3a-2e919c2f38c9 None admin] RBAC: Authorizing `identity:get_role(role_id=316da37136b4425f9ae486ae1e2bf4b4)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:22.748577 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e4e7a-3392-473f-8e3a-2e919c2f38c9 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:22.749980 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 568/1126] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:49:22 2022] GET /identity/v3/roles/316da37136b4425f9ae486ae1e2bf4b4 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:22.756061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105f109-4770-4a05-b9c1-380f618bf57f None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:22.859877 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105f109-4770-4a05-b9c1-380f618bf57f None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:22.894873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a33ca5-315d-4a40-b3d2-69af4e234de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:22.895746 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a33ca5-315d-4a40-b3d2-69af4e234de6 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:22.896022 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a33ca5-315d-4a40-b3d2-69af4e234de6 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:22.896289 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a33ca5-315d-4a40-b3d2-69af4e234de6 None admin] PATH_INFO: `/v3/users/0e9b8b407dc1436d9c51c37d1440af46` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:22.897478 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a33ca5-315d-4a40-b3d2-69af4e234de6 None admin] RBAC: Authorizing `identity:get_user(user_id=0e9b8b407dc1436d9c51c37d1440af46)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:22.898936 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a33ca5-315d-4a40-b3d2-69af4e234de6 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:22.900584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 559/1127] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:49:22 2022] GET /identity/v3/users/0e9b8b407dc1436d9c51c37d1440af46 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:22.906501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e4e7a-3392-473f-8e3a-2e919c2f38c9 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:23.017893 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e4e7a-3392-473f-8e3a-2e919c2f38c9 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:23.069062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cd393-38a0-4e12-b59a-b84beed29bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:23.069728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cd393-38a0-4e12-b59a-b84beed29bf8 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:23.070010 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cd393-38a0-4e12-b59a-b84beed29bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:23.070316 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cd393-38a0-4e12-b59a-b84beed29bf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:23.144584 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cd393-38a0-4e12-b59a-b84beed29bf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:23.146050 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cd393-38a0-4e12-b59a-b84beed29bf8 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:23.252365 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 569/1128] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:49:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:49:23.258685 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a33ca5-315d-4a40-b3d2-69af4e234de6 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:23.377206 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a33ca5-315d-4a40-b3d2-69af4e234de6 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:23.416450 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010a4ce-8875-4d7c-b5be-02fabca639a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:23.417954 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010a4ce-8875-4d7c-b5be-02fabca639a1 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:23.418441 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010a4ce-8875-4d7c-b5be-02fabca639a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:23.418747 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010a4ce-8875-4d7c-b5be-02fabca639a1 None admin] PATH_INFO: `/v3/projects/1f19b3e69ad746e0abfb110f1f792a3d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:23.420405 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010a4ce-8875-4d7c-b5be-02fabca639a1 None admin] RBAC: Authorizing `identity:get_project(project_id=1f19b3e69ad746e0abfb110f1f792a3d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:23.421876 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010a4ce-8875-4d7c-b5be-02fabca639a1 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:23.423679 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 560/1129] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:49:23 2022] GET /identity/v3/projects/1f19b3e69ad746e0abfb110f1f792a3d => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:23.430027 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cd393-38a0-4e12-b59a-b84beed29bf8 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:23.529378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cd393-38a0-4e12-b59a-b84beed29bf8 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:23.563367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d81f6f-7d05-42d7-b2ae-daa2a07860d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:23.564026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d81f6f-7d05-42d7-b2ae-daa2a07860d3 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:23.564303 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d81f6f-7d05-42d7-b2ae-daa2a07860d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:23.564576 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d81f6f-7d05-42d7-b2ae-daa2a07860d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:23.565407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d81f6f-7d05-42d7-b2ae-daa2a07860d3 None admin] RBAC: Adding query filter params (role.id=316da37136b4425f9ae486ae1e2bf4b4, scope.project.id=1f19b3e69ad746e0abfb110f1f792a3d, user.id=0e9b8b407dc1436d9c51c37d1440af46) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:23.565713 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d81f6f-7d05-42d7-b2ae-daa2a07860d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:23.567168 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d81f6f-7d05-42d7-b2ae-daa2a07860d3 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:23.573212 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 570/1130] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:49:23 2022] GET /identity/v3/role_assignments?user.id=0e9b8b407dc1436d9c51c37d1440af46&scope.project.id=1f19b3e69ad746e0abfb110f1f792a3d&role.id=316da37136b4425f9ae486ae1e2bf4b4 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:25.877429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19a521-7683-4c84-9261-068484bb5263 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:25.878017 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19a521-7683-4c84-9261-068484bb5263 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:25.878017 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19a521-7683-4c84-9261-068484bb5263 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:25.879553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 561/1131] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:49:25.886657 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a41171-6174-4881-a395-5f344ed95cc1 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:25.887198 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a41171-6174-4881-a395-5f344ed95cc1 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:25.887647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a41171-6174-4881-a395-5f344ed95cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:25.917796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-76a41171-6174-4881-a395-5f344ed95cc1 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:25.919853 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-76a41171-6174-4881-a395-5f344ed95cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:26.017478 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 571/1132] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:49:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:49:26.044194 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19a521-7683-4c84-9261-068484bb5263 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:26.181332 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19a521-7683-4c84-9261-068484bb5263 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:26.226801 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24f6c2-3f55-49dd-a1d6-a0a1542467a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:26.227617 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24f6c2-3f55-49dd-a1d6-a0a1542467a2 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:26.227899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24f6c2-3f55-49dd-a1d6-a0a1542467a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:26.228173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24f6c2-3f55-49dd-a1d6-a0a1542467a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:26.229446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24f6c2-3f55-49dd-a1d6-a0a1542467a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:26.232124 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24f6c2-3f55-49dd-a1d6-a0a1542467a2 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:26.234170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 562/1133] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:49:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:26.240537 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a41171-6174-4881-a395-5f344ed95cc1 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:26.362052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a41171-6174-4881-a395-5f344ed95cc1 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:26.406283 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609eddca-3bd8-4c43-8b26-ac0086e09cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:26.407024 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609eddca-3bd8-4c43-8b26-ac0086e09cb9 None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:26.407348 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609eddca-3bd8-4c43-8b26-ac0086e09cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:26.407667 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609eddca-3bd8-4c43-8b26-ac0086e09cb9 None admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:26.408528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609eddca-3bd8-4c43-8b26-ac0086e09cb9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:26.410061 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609eddca-3bd8-4c43-8b26-ac0086e09cb9 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:26.442288 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 572/1134] 10.222.0.32 () {60 vars in 1141 bytes} [Tue May 10 13:49:26 2022] POST /identity/v3/projects => generated 311 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:49:28.884750 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204b02c-4c26-4b0f-b513-46dd7c23bc8f None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:28.885285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204b02c-4c26-4b0f-b513-46dd7c23bc8f None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:28.885285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204b02c-4c26-4b0f-b513-46dd7c23bc8f None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:28.887190 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 563/1135] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:49:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:49:28.892936 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c102d-ec54-4464-a0aa-d565fb47cfef None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:28.893574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c102d-ec54-4464-a0aa-d565fb47cfef None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:28.893574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c102d-ec54-4464-a0aa-d565fb47cfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:28.913327 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-d02c102d-ec54-4464-a0aa-d565fb47cfef None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:28.914580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-d02c102d-ec54-4464-a0aa-d565fb47cfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:28.988486 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 573/1136] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:49:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:49:29.015000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204b02c-4c26-4b0f-b513-46dd7c23bc8f None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:29.126049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204b02c-4c26-4b0f-b513-46dd7c23bc8f None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:29.169916 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb018ff8-f274-4da4-99c4-77170353df96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:29.171286 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb018ff8-f274-4da4-99c4-77170353df96 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:29.171776 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb018ff8-f274-4da4-99c4-77170353df96 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:29.172268 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb018ff8-f274-4da4-99c4-77170353df96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:29.174389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb018ff8-f274-4da4-99c4-77170353df96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:29.177109 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb018ff8-f274-4da4-99c4-77170353df96 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:29.180226 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 564/1137] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:49:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:29.195546 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c102d-ec54-4464-a0aa-d565fb47cfef None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:29.301781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c102d-ec54-4464-a0aa-d565fb47cfef None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:29.339412 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27ab4a-e205-40e5-b1f2-cc42b7099175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:29.340258 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27ab4a-e205-40e5-b1f2-cc42b7099175 None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:29.340576 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27ab4a-e205-40e5-b1f2-cc42b7099175 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:29.340920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27ab4a-e205-40e5-b1f2-cc42b7099175 None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:29.341754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27ab4a-e205-40e5-b1f2-cc42b7099175 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:29.343408 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27ab4a-e205-40e5-b1f2-cc42b7099175 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:29.365290 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 574/1138] 10.222.0.32 () {60 vars in 1132 bytes} [Tue May 10 13:49:29 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:49:31.765384 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380a714-1f57-453d-b72a-7399091853bc None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:31.765993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380a714-1f57-453d-b72a-7399091853bc None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:31.765993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380a714-1f57-453d-b72a-7399091853bc None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:31.767363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 565/1139] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:49:31.781116 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68475648-d7bf-4324-b0b5-300dfc4ab5e7 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:31.781647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68475648-d7bf-4324-b0b5-300dfc4ab5e7 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:31.782088 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68475648-d7bf-4324-b0b5-300dfc4ab5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:31.801199 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-68475648-d7bf-4324-b0b5-300dfc4ab5e7 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:31.802450 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-68475648-d7bf-4324-b0b5-300dfc4ab5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:31.884761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 575/1140] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:49:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:49:31.909531 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380a714-1f57-453d-b72a-7399091853bc None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:32.075742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380a714-1f57-453d-b72a-7399091853bc None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:32.136615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc21e0b-ea52-4356-83cc-e4e95554041a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:32.137921 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc21e0b-ea52-4356-83cc-e4e95554041a None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:32.138451 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc21e0b-ea52-4356-83cc-e4e95554041a None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:32.138955 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc21e0b-ea52-4356-83cc-e4e95554041a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:32.158949 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc21e0b-ea52-4356-83cc-e4e95554041a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:49:32.174994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-5fc21e0b-ea52-4356-83cc-e4e95554041a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:49:32.174994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:32.174994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:32.174994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:32.174994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:32.174994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:32.174994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:32.174994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:32.174994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:32.174994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:32.174994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:32.174994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:32.174994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:49:32.174994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:49:32.174994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:49:32.174994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:49:32.176968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:49:32.176968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:49:32.176968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:49:32.176968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:49:32.176968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:32.176968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:32.176968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:32.176968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:32.176968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:32.176968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:32.176968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:32.176968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:49:32.176968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:32.176968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:32.176968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:32.176968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:32.178537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:32.178537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:32.178537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:32.178537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:32.178537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:49:32.178537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:49:32.178537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:49:32.178537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:49:32.178537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:49:32.178537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:49:32.178537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:49:32.178537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:49:32.178537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 566/1141] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:49:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:32.188033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68475648-d7bf-4324-b0b5-300dfc4ab5e7 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:32.297110 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68475648-d7bf-4324-b0b5-300dfc4ab5e7 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:32.333569 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb42d7a-010d-4242-a7a4-f5040af14330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:32.334165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb42d7a-010d-4242-a7a4-f5040af14330 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:32.334485 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb42d7a-010d-4242-a7a4-f5040af14330 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:32.334762 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb42d7a-010d-4242-a7a4-f5040af14330 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:32.335521 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb42d7a-010d-4242-a7a4-f5040af14330 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:32.335832 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb42d7a-010d-4242-a7a4-f5040af14330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:32.337210 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb42d7a-010d-4242-a7a4-f5040af14330 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:32.346667 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 576/1142] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:49:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:32.352496 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc21e0b-ea52-4356-83cc-e4e95554041a None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:32.454948 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc21e0b-ea52-4356-83cc-e4e95554041a None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:32.490768 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076cb65-85f5-453d-9db6-b5c9aba431ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:32.491779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076cb65-85f5-453d-9db6-b5c9aba431ae None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:32.492147 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076cb65-85f5-453d-9db6-b5c9aba431ae None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:32.492514 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076cb65-85f5-453d-9db6-b5c9aba431ae None admin] PATH_INFO: `/v3/users/a88bfcc1c4a246558d700c311bea99ad` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:32.508341 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076cb65-85f5-453d-9db6-b5c9aba431ae None admin] RBAC: Authorizing `identity:get_user(user_id=a88bfcc1c4a246558d700c311bea99ad)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:32.509808 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076cb65-85f5-453d-9db6-b5c9aba431ae None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:32.512015 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 567/1143] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:49:32 2022] GET /identity/v3/users/a88bfcc1c4a246558d700c311bea99ad => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:32.518129 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb42d7a-010d-4242-a7a4-f5040af14330 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:32.620028 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb42d7a-010d-4242-a7a4-f5040af14330 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:32.656083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8f176-1d15-401f-b4f8-0bf7bd8417ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:32.656742 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8f176-1d15-401f-b4f8-0bf7bd8417ae None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:32.657023 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8f176-1d15-401f-b4f8-0bf7bd8417ae None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:32.657294 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8f176-1d15-401f-b4f8-0bf7bd8417ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:32.728178 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8f176-1d15-401f-b4f8-0bf7bd8417ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:32.730166 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8f176-1d15-401f-b4f8-0bf7bd8417ae None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:32.845997 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 577/1144] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:49:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:49:32.852320 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076cb65-85f5-453d-9db6-b5c9aba431ae None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:32.984798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076cb65-85f5-453d-9db6-b5c9aba431ae None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:33.033997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c0776-ae3c-4bfd-855a-eb7d867c7511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:33.034964 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c0776-ae3c-4bfd-855a-eb7d867c7511 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:33.035284 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c0776-ae3c-4bfd-855a-eb7d867c7511 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:33.035601 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c0776-ae3c-4bfd-855a-eb7d867c7511 None admin] PATH_INFO: `/v3/projects/5807939781304363b82c543810994943` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:33.037120 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c0776-ae3c-4bfd-855a-eb7d867c7511 None admin] RBAC: Authorizing `identity:get_project(project_id=5807939781304363b82c543810994943)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:33.038681 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c0776-ae3c-4bfd-855a-eb7d867c7511 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:33.040495 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 568/1145] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:49:32 2022] GET /identity/v3/projects/5807939781304363b82c543810994943 => generated 311 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:33.047628 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8f176-1d15-401f-b4f8-0bf7bd8417ae None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:33.154769 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8f176-1d15-401f-b4f8-0bf7bd8417ae None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:33.191313 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e55247-035f-4c98-95d9-6e54014e20d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:33.192065 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e55247-035f-4c98-95d9-6e54014e20d1 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:33.192395 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e55247-035f-4c98-95d9-6e54014e20d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:33.192718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e55247-035f-4c98-95d9-6e54014e20d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:33.193623 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e55247-035f-4c98-95d9-6e54014e20d1 None admin] RBAC: Adding query filter params (role.id=17e40821fc444dd0b040dcfce3eb222b, scope.project.id=5807939781304363b82c543810994943, user.id=a88bfcc1c4a246558d700c311bea99ad) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:33.193983 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e55247-035f-4c98-95d9-6e54014e20d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:33.195542 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e55247-035f-4c98-95d9-6e54014e20d1 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:33.202754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 578/1146] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:49:33 2022] GET /identity/v3/role_assignments?user.id=a88bfcc1c4a246558d700c311bea99ad&scope.project.id=5807939781304363b82c543810994943&role.id=17e40821fc444dd0b040dcfce3eb222b => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:35.545972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65074829-669b-4000-b821-e71df200a8cb None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:35.546644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65074829-669b-4000-b821-e71df200a8cb None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:35.546644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65074829-669b-4000-b821-e71df200a8cb None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:35.548301 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 569/1147] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:49:35.554076 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1b0ac-dbd7-40c9-927e-b5fda18f1f39 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:35.554563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1b0ac-dbd7-40c9-927e-b5fda18f1f39 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:35.554836 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1b0ac-dbd7-40c9-927e-b5fda18f1f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:35.572925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-6fc1b0ac-dbd7-40c9-927e-b5fda18f1f39 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:35.574366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-6fc1b0ac-dbd7-40c9-927e-b5fda18f1f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:35.644978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 579/1148] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:49:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:49:35.669572 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65074829-669b-4000-b821-e71df200a8cb None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:35.777754 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65074829-669b-4000-b821-e71df200a8cb None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:35.813803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade5a99-9dbe-4f9d-8664-6b24c0282740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:35.814536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade5a99-9dbe-4f9d-8664-6b24c0282740 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:35.814821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade5a99-9dbe-4f9d-8664-6b24c0282740 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:35.815096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade5a99-9dbe-4f9d-8664-6b24c0282740 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:35.825289 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade5a99-9dbe-4f9d-8664-6b24c0282740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:49:35.832972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-1ade5a99-9dbe-4f9d-8664-6b24c0282740 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:49:35.832972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:35.832972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:35.832972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:35.832972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:35.832972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:35.832972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:35.832972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:35.832972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:35.832972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:35.832972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:35.832972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:35.832972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:49:35.832972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:49:35.832972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:49:35.832972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:49:35.834074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:49:35.834074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:49:35.834074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:49:35.834074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:49:35.834074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:35.834074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:35.834074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:35.834074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:35.834074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:35.834074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:35.834074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:35.834074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:49:35.834074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:35.834074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:35.834074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:35.834074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:35.834989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:35.834989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:35.834989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:35.834989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:35.834989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:49:35.834989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:49:35.834989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:49:35.834989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:49:35.834989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:49:35.834989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:49:35.834989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:49:35.834989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:49:35.834989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 570/1149] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:49:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:35.841692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1b0ac-dbd7-40c9-927e-b5fda18f1f39 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:35.943529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1b0ac-dbd7-40c9-927e-b5fda18f1f39 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:35.978152 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08ab20-adcb-41ed-9ea4-df890bdac8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:35.978860 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08ab20-adcb-41ed-9ea4-df890bdac8f6 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:35.979142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08ab20-adcb-41ed-9ea4-df890bdac8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:35.979414 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08ab20-adcb-41ed-9ea4-df890bdac8f6 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:35.980828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08ab20-adcb-41ed-9ea4-df890bdac8f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:35.981128 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08ab20-adcb-41ed-9ea4-df890bdac8f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:35.982532 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08ab20-adcb-41ed-9ea4-df890bdac8f6 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:35.991497 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 580/1150] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:49:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:35.997572 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade5a99-9dbe-4f9d-8664-6b24c0282740 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:36.103497 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade5a99-9dbe-4f9d-8664-6b24c0282740 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:36.138231 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b2824-f459-4237-8b4a-6a3e0a305c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:36.139127 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b2824-f459-4237-8b4a-6a3e0a305c5a None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:36.139405 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b2824-f459-4237-8b4a-6a3e0a305c5a None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:36.139684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b2824-f459-4237-8b4a-6a3e0a305c5a None admin] PATH_INFO: `/v3/users/a88bfcc1c4a246558d700c311bea99ad` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:36.140880 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b2824-f459-4237-8b4a-6a3e0a305c5a None admin] RBAC: Authorizing `identity:get_user(user_id=a88bfcc1c4a246558d700c311bea99ad)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:36.142337 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b2824-f459-4237-8b4a-6a3e0a305c5a None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:36.143981 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 571/1151] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:49:35 2022] GET /identity/v3/users/a88bfcc1c4a246558d700c311bea99ad => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:36.150369 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08ab20-adcb-41ed-9ea4-df890bdac8f6 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:36.265784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08ab20-adcb-41ed-9ea4-df890bdac8f6 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:36.300634 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb285de6-265c-4f1b-8c38-cdea836ac993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:36.301503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb285de6-265c-4f1b-8c38-cdea836ac993 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:36.301787 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb285de6-265c-4f1b-8c38-cdea836ac993 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:36.302068 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb285de6-265c-4f1b-8c38-cdea836ac993 None admin] PATH_INFO: `/v3/projects/5807939781304363b82c543810994943` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:36.303288 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb285de6-265c-4f1b-8c38-cdea836ac993 None admin] RBAC: Authorizing `identity:get_project(project_id=5807939781304363b82c543810994943)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:36.304722 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb285de6-265c-4f1b-8c38-cdea836ac993 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:36.306473 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 581/1152] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:49:36 2022] GET /identity/v3/projects/5807939781304363b82c543810994943 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:36.312580 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b2824-f459-4237-8b4a-6a3e0a305c5a None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:36.416608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b2824-f459-4237-8b4a-6a3e0a305c5a None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:36.450316 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35f6e1-b694-4a20-9656-68b22ba9d133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:36.451216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35f6e1-b694-4a20-9656-68b22ba9d133 None admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:36.451496 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35f6e1-b694-4a20-9656-68b22ba9d133 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:36.451768 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35f6e1-b694-4a20-9656-68b22ba9d133 None admin] PATH_INFO: `/v3/projects/5807939781304363b82c543810994943/users/a88bfcc1c4a246558d700c311bea99ad/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:36.453844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35f6e1-b694-4a20-9656-68b22ba9d133 None admin] RBAC: Authorizing `identity:create_grant(project_id=5807939781304363b82c543810994943, user_id=a88bfcc1c4a246558d700c311bea99ad, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:36.455365 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35f6e1-b694-4a20-9656-68b22ba9d133 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:36.471153 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 572/1153] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:49:36 2022] PUT /identity/v3/projects/5807939781304363b82c543810994943/users/a88bfcc1c4a246558d700c311bea99ad/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:49:38.761512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5377b5d-9031-4c98-9aed-84ed77487678 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:38.762140 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5377b5d-9031-4c98-9aed-84ed77487678 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:38.762140 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5377b5d-9031-4c98-9aed-84ed77487678 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:38.763445 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 582/1154] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:49:38.768586 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f3fc2-78c8-4905-8953-176c6403b98f None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:38.769028 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f3fc2-78c8-4905-8953-176c6403b98f None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:38.769115 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f3fc2-78c8-4905-8953-176c6403b98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:38.785949 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-415f3fc2-78c8-4905-8953-176c6403b98f None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:38.787169 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-415f3fc2-78c8-4905-8953-176c6403b98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:38.850997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 573/1155] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:49:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:49:38.874692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5377b5d-9031-4c98-9aed-84ed77487678 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:38.988017 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5377b5d-9031-4c98-9aed-84ed77487678 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:39.022126 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeceda62-a2e9-4bce-828e-df74575ffb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:39.022873 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeceda62-a2e9-4bce-828e-df74575ffb6b None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:39.023159 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeceda62-a2e9-4bce-828e-df74575ffb6b None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:39.023436 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeceda62-a2e9-4bce-828e-df74575ffb6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:39.035519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeceda62-a2e9-4bce-828e-df74575ffb6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:49:39.043789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-eeceda62-a2e9-4bce-828e-df74575ffb6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:49:39.043789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:39.043789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:39.043789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:39.043789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:39.043789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:39.043789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:39.043789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:39.043789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:39.043789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:39.043789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:39.043789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:39.043789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:49:39.043789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:49:39.043789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:49:39.043789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:49:39.045517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:49:39.045517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:49:39.045517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:49:39.045517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:49:39.045517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:39.045517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:39.045517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:39.045517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:39.045517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:39.045517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:39.045517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:39.045517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:49:39.045517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:39.045517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:39.045517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:39.045517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:39.047240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:39.047240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:39.047240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:39.047240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:39.047240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:49:39.047240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:49:39.047240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:49:39.047240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:49:39.047240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:49:39.047240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:49:39.047240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:49:39.047240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:49:39.047240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 583/1156] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:49:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:39.052825 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f3fc2-78c8-4905-8953-176c6403b98f None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:39.164923 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f3fc2-78c8-4905-8953-176c6403b98f None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:39.203955 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc09b1-a8cd-4092-9400-a335bd0ea56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:39.204629 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc09b1-a8cd-4092-9400-a335bd0ea56f None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:39.204905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc09b1-a8cd-4092-9400-a335bd0ea56f None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:39.205173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc09b1-a8cd-4092-9400-a335bd0ea56f None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:39.205961 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc09b1-a8cd-4092-9400-a335bd0ea56f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:39.206292 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc09b1-a8cd-4092-9400-a335bd0ea56f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:39.207705 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc09b1-a8cd-4092-9400-a335bd0ea56f None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:39.217307 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 574/1157] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:49:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:39.223788 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeceda62-a2e9-4bce-828e-df74575ffb6b None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:39.372501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeceda62-a2e9-4bce-828e-df74575ffb6b None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:39.409769 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5140478-114b-4045-aaf9-5c6b48f52854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:39.410662 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5140478-114b-4045-aaf9-5c6b48f52854 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:39.410935 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5140478-114b-4045-aaf9-5c6b48f52854 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:39.411204 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5140478-114b-4045-aaf9-5c6b48f52854 None admin] PATH_INFO: `/v3/users/a88bfcc1c4a246558d700c311bea99ad` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:39.412389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5140478-114b-4045-aaf9-5c6b48f52854 None admin] RBAC: Authorizing `identity:get_user(user_id=a88bfcc1c4a246558d700c311bea99ad)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:39.413825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5140478-114b-4045-aaf9-5c6b48f52854 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:39.415492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 584/1158] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:49:39 2022] GET /identity/v3/users/a88bfcc1c4a246558d700c311bea99ad => generated 286 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:39.421364 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc09b1-a8cd-4092-9400-a335bd0ea56f None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:39.527877 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc09b1-a8cd-4092-9400-a335bd0ea56f None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:39.562024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9909a-d1be-451c-84f4-a7eea1620039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:39.562708 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9909a-d1be-451c-84f4-a7eea1620039 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:39.562988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9909a-d1be-451c-84f4-a7eea1620039 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:39.563257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9909a-d1be-451c-84f4-a7eea1620039 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:39.632318 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9909a-d1be-451c-84f4-a7eea1620039 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:39.633693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9909a-d1be-451c-84f4-a7eea1620039 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:39.728660 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 575/1159] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:49:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:49:39.735084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5140478-114b-4045-aaf9-5c6b48f52854 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:39.840298 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5140478-114b-4045-aaf9-5c6b48f52854 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:39.877058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510209b-1f1c-48ab-b989-cc32a0ffa40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:39.877915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510209b-1f1c-48ab-b989-cc32a0ffa40e None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:39.878194 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510209b-1f1c-48ab-b989-cc32a0ffa40e None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:39.878518 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510209b-1f1c-48ab-b989-cc32a0ffa40e None admin] PATH_INFO: `/v3/projects/5807939781304363b82c543810994943` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:39.879700 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510209b-1f1c-48ab-b989-cc32a0ffa40e None admin] RBAC: Authorizing `identity:get_project(project_id=5807939781304363b82c543810994943)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:39.881152 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510209b-1f1c-48ab-b989-cc32a0ffa40e None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:39.882976 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 585/1160] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:49:39 2022] GET /identity/v3/projects/5807939781304363b82c543810994943 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:39.889572 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9909a-d1be-451c-84f4-a7eea1620039 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:39.991844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9909a-d1be-451c-84f4-a7eea1620039 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:40.024403 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67a08e-7218-48d8-9550-771ed8f627f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:40.025046 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67a08e-7218-48d8-9550-771ed8f627f0 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:40.025323 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67a08e-7218-48d8-9550-771ed8f627f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:40.025591 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67a08e-7218-48d8-9550-771ed8f627f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:40.026614 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67a08e-7218-48d8-9550-771ed8f627f0 None admin] RBAC: Adding query filter params (role.id=17e40821fc444dd0b040dcfce3eb222b, scope.project.id=5807939781304363b82c543810994943, user.id=a88bfcc1c4a246558d700c311bea99ad) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:40.026614 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67a08e-7218-48d8-9550-771ed8f627f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:40.028475 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67a08e-7218-48d8-9550-771ed8f627f0 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:40.034435 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 576/1161] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:49:39 2022] GET /identity/v3/role_assignments?user.id=a88bfcc1c4a246558d700c311bea99ad&scope.project.id=5807939781304363b82c543810994943&role.id=17e40821fc444dd0b040dcfce3eb222b => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:42.434053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455502c-a1bc-43cb-b682-35521d4d0991 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:42.434620 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455502c-a1bc-43cb-b682-35521d4d0991 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:42.434620 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455502c-a1bc-43cb-b682-35521d4d0991 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:42.435999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 586/1162] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:49:42.451952 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0b75f-e83e-45fc-88da-2968e06c3d7b None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:42.452501 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0b75f-e83e-45fc-88da-2968e06c3d7b None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:42.452501 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0b75f-e83e-45fc-88da-2968e06c3d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:42.469449 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-b7b0b75f-e83e-45fc-88da-2968e06c3d7b None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:42.470690 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b7b0b75f-e83e-45fc-88da-2968e06c3d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:42.538992 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 577/1163] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:49:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:49:42.561611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455502c-a1bc-43cb-b682-35521d4d0991 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:42.662396 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455502c-a1bc-43cb-b682-35521d4d0991 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:42.695617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a96f7-d717-4cb3-99e4-18655ee4cc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:42.696175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a96f7-d717-4cb3-99e4-18655ee4cc76 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:42.696452 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a96f7-d717-4cb3-99e4-18655ee4cc76 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:42.696723 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a96f7-d717-4cb3-99e4-18655ee4cc76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:42.767320 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a96f7-d717-4cb3-99e4-18655ee4cc76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:42.768767 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a96f7-d717-4cb3-99e4-18655ee4cc76 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:42.880729 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 587/1164] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:49:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:49:42.890644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0b75f-e83e-45fc-88da-2968e06c3d7b None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:42.993836 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0b75f-e83e-45fc-88da-2968e06c3d7b None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:43.032423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c7cda-f723-4d47-9b92-488db6305462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:43.033230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c7cda-f723-4d47-9b92-488db6305462 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:43.033505 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c7cda-f723-4d47-9b92-488db6305462 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:43.033774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c7cda-f723-4d47-9b92-488db6305462 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:43.041454 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c7cda-f723-4d47-9b92-488db6305462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:43.043046 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c7cda-f723-4d47-9b92-488db6305462 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:43.057774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-9f8c7cda-f723-4d47-9b92-488db6305462 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 13:49:43.057774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:43.057774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 10 13:49:43.057774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 10 13:49:43.057774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:49:43.057774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:49:43.057774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:49:43.057774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:49:43.057774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 10 13:49:43.057774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:49:43.057774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:49:43.057774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:49:43.057774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:43.057774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:43.057774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:43.057774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:43.057774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:43.059189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:43.059189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:43.059189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:43.059189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:43.059189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:43.059189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:43.059189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:49:43.059189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:49:43.059189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:49:43.059189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:49:43.059189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:43.059189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:43.059189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:43.059189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:43.059189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:43.059189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:43.060041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:43.060041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:49:43.060041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:43.060041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:43.060041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:43.060041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:43.060041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:43.060041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:43.060041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:43.060041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:43.060041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 10 13:49:43.060041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:49:43.060041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 13:49:43.060041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:49:43.060041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 578/1165] 10.222.0.32 () {56 vars in 1117 bytes} [Tue May 10 13:49:42 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:43.067614 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a96f7-d717-4cb3-99e4-18655ee4cc76 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:43.188199 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a96f7-d717-4cb3-99e4-18655ee4cc76 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:43.226701 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a069b0-7610-4558-80e6-b49d9bf75b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:43.227114 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a069b0-7610-4558-80e6-b49d9bf75b9e None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:43.227395 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a069b0-7610-4558-80e6-b49d9bf75b9e None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:43.227999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a069b0-7610-4558-80e6-b49d9bf75b9e None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:43.228379 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a069b0-7610-4558-80e6-b49d9bf75b9e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:43.228691 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a069b0-7610-4558-80e6-b49d9bf75b9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:43.230127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a069b0-7610-4558-80e6-b49d9bf75b9e None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:43.238228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 588/1166] 10.222.0.32 () {56 vars in 1115 bytes} [Tue May 10 13:49:43 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:45.606702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98e816-5f47-45bb-9c79-668fe168e94a None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:45.607262 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98e816-5f47-45bb-9c79-668fe168e94a None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:45.607262 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98e816-5f47-45bb-9c79-668fe168e94a None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:45.608880 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 579/1167] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:49:45.614597 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bd15c-6c99-4648-b8d2-5de064ba54e2 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:45.615050 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bd15c-6c99-4648-b8d2-5de064ba54e2 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:45.615142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bd15c-6c99-4648-b8d2-5de064ba54e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:45.633644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-374bd15c-6c99-4648-b8d2-5de064ba54e2 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:45.635043 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-374bd15c-6c99-4648-b8d2-5de064ba54e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:45.709897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 589/1168] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:49:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:49:45.732586 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98e816-5f47-45bb-9c79-668fe168e94a None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:45.846262 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98e816-5f47-45bb-9c79-668fe168e94a None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:45.883406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55858a7f-9dc8-4440-948a-02755a779a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:45.883949 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55858a7f-9dc8-4440-948a-02755a779a05 None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:45.884232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55858a7f-9dc8-4440-948a-02755a779a05 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:45.884505 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55858a7f-9dc8-4440-948a-02755a779a05 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:45.885254 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55858a7f-9dc8-4440-948a-02755a779a05 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:45.887225 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55858a7f-9dc8-4440-948a-02755a779a05 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:45.903349 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 580/1169] 10.222.0.32 () {60 vars in 1138 bytes} [Tue May 10 13:49:45 2022] POST /identity/v3/domains => generated 267 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:49:48.239972 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3e51d-affa-4874-b139-f40a8eb2665c None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:48.240539 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3e51d-affa-4874-b139-f40a8eb2665c None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:48.240539 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3e51d-affa-4874-b139-f40a8eb2665c None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:48.241800 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 590/1170] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:49:48.248008 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afde655-9a19-41b7-b018-37e8bab9b432 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:48.248465 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afde655-9a19-41b7-b018-37e8bab9b432 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:48.248561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afde655-9a19-41b7-b018-37e8bab9b432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:48.265393 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-9afde655-9a19-41b7-b018-37e8bab9b432 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:48.266632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-9afde655-9a19-41b7-b018-37e8bab9b432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:48.338389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 581/1171] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:49:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:49:48.364135 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3e51d-affa-4874-b139-f40a8eb2665c None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:48.477018 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3e51d-affa-4874-b139-f40a8eb2665c None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:48.514540 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00b332-8d91-4ef7-8e7e-3b62b47b4cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:48.515317 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00b332-8d91-4ef7-8e7e-3b62b47b4cc9 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:48.515600 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00b332-8d91-4ef7-8e7e-3b62b47b4cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:48.515875 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00b332-8d91-4ef7-8e7e-3b62b47b4cc9 None admin] PATH_INFO: `/v3/domains/9e25ff084beb44908d19209f1c85f4d8` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:48.527498 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00b332-8d91-4ef7-8e7e-3b62b47b4cc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9e25ff084beb44908d19209f1c85f4d8)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:48.529594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00b332-8d91-4ef7-8e7e-3b62b47b4cc9 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:48.531397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 591/1172] 10.222.0.32 () {56 vars in 1183 bytes} [Tue May 10 13:49:48 2022] GET /identity/v3/domains/9e25ff084beb44908d19209f1c85f4d8 => generated 267 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:48.537298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afde655-9a19-41b7-b018-37e8bab9b432 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:48.634125 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afde655-9a19-41b7-b018-37e8bab9b432 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:48.673356 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcbb0c-b053-4159-9071-5baef97809a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:48.674017 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcbb0c-b053-4159-9071-5baef97809a0 None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:48.674326 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcbb0c-b053-4159-9071-5baef97809a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:48.674598 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcbb0c-b053-4159-9071-5baef97809a0 None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:48.675336 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcbb0c-b053-4159-9071-5baef97809a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:48.676810 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcbb0c-b053-4159-9071-5baef97809a0 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:48.704345 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 582/1173] 10.222.0.32 () {60 vars in 1141 bytes} [Tue May 10 13:49:48 2022] POST /identity/v3/projects => generated 361 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:49:51.121400 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a077c-c94a-4a18-ac5a-2406cfaec453 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:51.121929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a077c-c94a-4a18-ac5a-2406cfaec453 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:51.121929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a077c-c94a-4a18-ac5a-2406cfaec453 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:51.123321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 592/1174] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:49:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:49:51.129115 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354e340-953e-4f9f-b62a-34466ff49e6a None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:51.129626 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354e340-953e-4f9f-b62a-34466ff49e6a None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:51.129738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354e340-953e-4f9f-b62a-34466ff49e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:51.151359 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-5354e340-953e-4f9f-b62a-34466ff49e6a None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:51.152568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-5354e340-953e-4f9f-b62a-34466ff49e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:51.237317 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 583/1175] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:49:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:49:51.262433 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a077c-c94a-4a18-ac5a-2406cfaec453 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:51.364469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a077c-c94a-4a18-ac5a-2406cfaec453 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:51.399093 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced61d8e-eac0-4617-b918-38733c4d50f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:51.399880 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced61d8e-eac0-4617-b918-38733c4d50f3 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:51.400162 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced61d8e-eac0-4617-b918-38733c4d50f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:51.400442 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced61d8e-eac0-4617-b918-38733c4d50f3 None admin] PATH_INFO: `/v3/domains/9e25ff084beb44908d19209f1c85f4d8` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:51.401735 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced61d8e-eac0-4617-b918-38733c4d50f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9e25ff084beb44908d19209f1c85f4d8)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:51.403413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced61d8e-eac0-4617-b918-38733c4d50f3 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:51.405176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 593/1176] 10.222.0.32 () {56 vars in 1183 bytes} [Tue May 10 13:49:51 2022] GET /identity/v3/domains/9e25ff084beb44908d19209f1c85f4d8 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:51.411125 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354e340-953e-4f9f-b62a-34466ff49e6a None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:51.522754 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354e340-953e-4f9f-b62a-34466ff49e6a None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:51.560075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73851d14-4739-47c2-93ee-23a61588c60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:51.560751 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73851d14-4739-47c2-93ee-23a61588c60e None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:51.561025 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73851d14-4739-47c2-93ee-23a61588c60e None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:51.561290 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73851d14-4739-47c2-93ee-23a61588c60e None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:51.562005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73851d14-4739-47c2-93ee-23a61588c60e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:51.563474 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73851d14-4739-47c2-93ee-23a61588c60e None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:51.583392 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 584/1177] 10.222.0.32 () {60 vars in 1132 bytes} [Tue May 10 13:49:51 2022] POST /identity/v3/users => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:49:53.898916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb050d06-10f7-476a-b02b-b738cd36aa2d None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:53.899482 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb050d06-10f7-476a-b02b-b738cd36aa2d None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:53.899914 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb050d06-10f7-476a-b02b-b738cd36aa2d None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:53.902753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 594/1178] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:49:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:49:53.908848 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5f58f-f074-400c-9c17-06601793ada5 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:53.909320 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5f58f-f074-400c-9c17-06601793ada5 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:53.909420 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5f58f-f074-400c-9c17-06601793ada5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:53.928049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-d7d5f58f-f074-400c-9c17-06601793ada5 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:53.929375 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-d7d5f58f-f074-400c-9c17-06601793ada5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:53.998153 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 585/1179] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:49:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:49:54.022731 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb050d06-10f7-476a-b02b-b738cd36aa2d None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:54.129364 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb050d06-10f7-476a-b02b-b738cd36aa2d None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:54.166078 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19392c7e-89ba-48c1-8a98-fc4176acc66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:54.167442 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19392c7e-89ba-48c1-8a98-fc4176acc66a None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:54.167724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19392c7e-89ba-48c1-8a98-fc4176acc66a None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:54.168005 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19392c7e-89ba-48c1-8a98-fc4176acc66a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:54.179742 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19392c7e-89ba-48c1-8a98-fc4176acc66a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:49:54.193718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-19392c7e-89ba-48c1-8a98-fc4176acc66a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:49:54.193718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:54.193718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:54.193718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:54.193718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:54.193718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:54.193718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:54.193718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:54.193718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:54.193718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:54.193718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:54.193718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:54.193718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:49:54.193718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:49:54.193718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:49:54.193718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:49:54.195871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:49:54.195871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:49:54.195871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:49:54.195871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:49:54.195871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:54.195871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:54.195871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:54.195871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:54.195871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:54.195871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:54.195871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:54.195871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:49:54.195871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:54.195871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:54.195871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:54.195871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:54.197545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:54.197545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:54.197545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:54.197545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:54.197545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:49:54.197545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:49:54.197545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:49:54.197545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:49:54.197545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:49:54.197545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:49:54.197545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:49:54.197545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:49:54.197545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 595/1180] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:49:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:54.205564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5f58f-f074-400c-9c17-06601793ada5 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:54.381184 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5f58f-f074-400c-9c17-06601793ada5 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:54.417761 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fe534-13e8-4a75-ad61-1c72b5d86bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:54.418521 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fe534-13e8-4a75-ad61-1c72b5d86bc0 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:54.418840 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fe534-13e8-4a75-ad61-1c72b5d86bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:54.419127 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fe534-13e8-4a75-ad61-1c72b5d86bc0 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:54.419931 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fe534-13e8-4a75-ad61-1c72b5d86bc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:54.420242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fe534-13e8-4a75-ad61-1c72b5d86bc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:54.421661 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fe534-13e8-4a75-ad61-1c72b5d86bc0 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:54.430909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 586/1181] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:49:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:54.438063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19392c7e-89ba-48c1-8a98-fc4176acc66a None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:54.544581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19392c7e-89ba-48c1-8a98-fc4176acc66a None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:54.582747 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc016c-05b2-4e57-a4ae-43eb01c6b013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:54.583625 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc016c-05b2-4e57-a4ae-43eb01c6b013 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:54.583905 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc016c-05b2-4e57-a4ae-43eb01c6b013 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:54.584176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc016c-05b2-4e57-a4ae-43eb01c6b013 None admin] PATH_INFO: `/v3/users/7a165675ea4640d0a265933fc4c7eab4` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:54.598752 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc016c-05b2-4e57-a4ae-43eb01c6b013 None admin] RBAC: Authorizing `identity:get_user(user_id=7a165675ea4640d0a265933fc4c7eab4)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:54.600212 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc016c-05b2-4e57-a4ae-43eb01c6b013 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:54.601957 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 596/1182] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:49:54 2022] GET /identity/v3/users/7a165675ea4640d0a265933fc4c7eab4 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:54.607995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fe534-13e8-4a75-ad61-1c72b5d86bc0 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:54.712304 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fe534-13e8-4a75-ad61-1c72b5d86bc0 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:54.747362 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651f92f-1731-43e4-b466-e9aa1ce3b575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:54.748035 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f92f-1731-43e4-b466-e9aa1ce3b575 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:54.748319 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f92f-1731-43e4-b466-e9aa1ce3b575 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:54.748593 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f92f-1731-43e4-b466-e9aa1ce3b575 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:54.819879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651f92f-1731-43e4-b466-e9aa1ce3b575 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:54.821400 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651f92f-1731-43e4-b466-e9aa1ce3b575 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:54.970225 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 587/1183] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:49:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:49:54.976214 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc016c-05b2-4e57-a4ae-43eb01c6b013 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:55.081172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc016c-05b2-4e57-a4ae-43eb01c6b013 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:55.118146 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bcdec-0f03-4cd9-9d76-d1bcd20d260c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:55.119061 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bcdec-0f03-4cd9-9d76-d1bcd20d260c None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:55.119344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bcdec-0f03-4cd9-9d76-d1bcd20d260c None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:55.119616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bcdec-0f03-4cd9-9d76-d1bcd20d260c None admin] PATH_INFO: `/v3/projects/72c2113c7862438a9763dfd48a2b2553` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:55.121670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bcdec-0f03-4cd9-9d76-d1bcd20d260c None admin] RBAC: Authorizing `identity:get_project(project_id=72c2113c7862438a9763dfd48a2b2553)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:55.123147 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bcdec-0f03-4cd9-9d76-d1bcd20d260c None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:55.124909 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 597/1184] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:49:54 2022] GET /identity/v3/projects/72c2113c7862438a9763dfd48a2b2553 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:55.134677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651f92f-1731-43e4-b466-e9aa1ce3b575 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:55.240455 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651f92f-1731-43e4-b466-e9aa1ce3b575 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:55.278714 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65cd9f-68f3-4f44-851e-1ca0be825585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:55.279393 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65cd9f-68f3-4f44-851e-1ca0be825585 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:55.279672 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65cd9f-68f3-4f44-851e-1ca0be825585 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:55.279988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65cd9f-68f3-4f44-851e-1ca0be825585 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:55.280875 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65cd9f-68f3-4f44-851e-1ca0be825585 None admin] RBAC: Adding query filter params (role.id=17e40821fc444dd0b040dcfce3eb222b, scope.project.id=72c2113c7862438a9763dfd48a2b2553, user.id=7a165675ea4640d0a265933fc4c7eab4) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:55.281184 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65cd9f-68f3-4f44-851e-1ca0be825585 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:55.282753 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65cd9f-68f3-4f44-851e-1ca0be825585 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:55.289736 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 588/1185] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:49:55 2022] GET /identity/v3/role_assignments?user.id=7a165675ea4640d0a265933fc4c7eab4&scope.project.id=72c2113c7862438a9763dfd48a2b2553&role.id=17e40821fc444dd0b040dcfce3eb222b => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:57.599101 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c88f58-b98a-478f-bc3e-3cd02e614130 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:57.599989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c88f58-b98a-478f-bc3e-3cd02e614130 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:57.599989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c88f58-b98a-478f-bc3e-3cd02e614130 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:57.601047 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 598/1186] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:49:57.608476 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b223-5f08-4ebf-a83c-8671a73af6b4 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:57.609042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b223-5f08-4ebf-a83c-8671a73af6b4 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:57.609423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b223-5f08-4ebf-a83c-8671a73af6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:57.638556 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-06c8b223-5f08-4ebf-a83c-8671a73af6b4 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:57.640667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-06c8b223-5f08-4ebf-a83c-8671a73af6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:57.727857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 589/1187] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:49:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:49:57.751341 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c88f58-b98a-478f-bc3e-3cd02e614130 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:57.863052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c88f58-b98a-478f-bc3e-3cd02e614130 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:57.898412 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d73f2-bd79-46ae-9284-bff9bfb89a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:57.899218 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d73f2-bd79-46ae-9284-bff9bfb89a2c None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:57.899497 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d73f2-bd79-46ae-9284-bff9bfb89a2c None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:57.899767 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d73f2-bd79-46ae-9284-bff9bfb89a2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:57.911724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d73f2-bd79-46ae-9284-bff9bfb89a2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:49:57.920179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-a77d73f2-bd79-46ae-9284-bff9bfb89a2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:49:57.920179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:57.920179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:57.920179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:57.920179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:57.920179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:57.920179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:57.920179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:57.920179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:57.920179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:57.920179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:57.920179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:57.920179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:49:57.920179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:49:57.920179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:49:57.920179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:49:57.922351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:49:57.922351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:49:57.922351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:49:57.922351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:49:57.922351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:57.922351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:57.922351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:57.922351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:57.922351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:57.922351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:57.922351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:57.922351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:49:57.922351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:57.922351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:57.922351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:57.922351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:57.924188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:57.924188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:57.924188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:57.924188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:57.924188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:49:57.924188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:49:57.924188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:49:57.924188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:49:57.924188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:49:57.924188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:49:57.924188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:49:57.924188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:49:57.924188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 599/1188] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:49:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:57.927966 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8b223-5f08-4ebf-a83c-8671a73af6b4 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:58.031242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8b223-5f08-4ebf-a83c-8671a73af6b4 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:58.066027 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42180260-df93-48d7-be7f-fb8241c636fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:58.066739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42180260-df93-48d7-be7f-fb8241c636fd None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:58.067015 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42180260-df93-48d7-be7f-fb8241c636fd None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:58.067282 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42180260-df93-48d7-be7f-fb8241c636fd None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:58.068041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42180260-df93-48d7-be7f-fb8241c636fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:58.068342 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42180260-df93-48d7-be7f-fb8241c636fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:58.069775 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42180260-df93-48d7-be7f-fb8241c636fd None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:58.079553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 590/1189] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:49:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:58.088834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d73f2-bd79-46ae-9284-bff9bfb89a2c None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:58.192772 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d73f2-bd79-46ae-9284-bff9bfb89a2c None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:58.228281 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e694c-664e-4780-8c8a-86ea6a672ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:58.229700 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e694c-664e-4780-8c8a-86ea6a672ff6 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:58.230012 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e694c-664e-4780-8c8a-86ea6a672ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:58.230337 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e694c-664e-4780-8c8a-86ea6a672ff6 None admin] PATH_INFO: `/v3/users/7a165675ea4640d0a265933fc4c7eab4` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:58.231764 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e694c-664e-4780-8c8a-86ea6a672ff6 None admin] RBAC: Authorizing `identity:get_user(user_id=7a165675ea4640d0a265933fc4c7eab4)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:58.233474 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e694c-664e-4780-8c8a-86ea6a672ff6 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:58.235235 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 600/1190] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:49:58 2022] GET /identity/v3/users/7a165675ea4640d0a265933fc4c7eab4 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:58.241234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42180260-df93-48d7-be7f-fb8241c636fd None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:58.346334 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42180260-df93-48d7-be7f-fb8241c636fd None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:58.385638 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d9b22-6dac-4c0b-801e-e7d8415032e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:58.386802 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d9b22-6dac-4c0b-801e-e7d8415032e6 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:58.387124 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d9b22-6dac-4c0b-801e-e7d8415032e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:58.387441 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d9b22-6dac-4c0b-801e-e7d8415032e6 None admin] PATH_INFO: `/v3/projects/72c2113c7862438a9763dfd48a2b2553` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:58.388974 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d9b22-6dac-4c0b-801e-e7d8415032e6 None admin] RBAC: Authorizing `identity:get_project(project_id=72c2113c7862438a9763dfd48a2b2553)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:58.390518 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d9b22-6dac-4c0b-801e-e7d8415032e6 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:58.392341 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 591/1191] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:49:58 2022] GET /identity/v3/projects/72c2113c7862438a9763dfd48a2b2553 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:58.398737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e694c-664e-4780-8c8a-86ea6a672ff6 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:58.507743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e694c-664e-4780-8c8a-86ea6a672ff6 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:58.544255 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b5992-e9de-4621-9720-adc9a97e7acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:58.545168 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b5992-e9de-4621-9720-adc9a97e7acf None admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:58.545451 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b5992-e9de-4621-9720-adc9a97e7acf None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:58.545728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b5992-e9de-4621-9720-adc9a97e7acf None admin] PATH_INFO: `/v3/projects/72c2113c7862438a9763dfd48a2b2553/users/7a165675ea4640d0a265933fc4c7eab4/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:58.547875 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b5992-e9de-4621-9720-adc9a97e7acf None admin] RBAC: Authorizing `identity:create_grant(project_id=72c2113c7862438a9763dfd48a2b2553, user_id=7a165675ea4640d0a265933fc4c7eab4, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:58.549334 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b5992-e9de-4621-9720-adc9a97e7acf None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:58.563598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 601/1192] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:49:58 2022] PUT /identity/v3/projects/72c2113c7862438a9763dfd48a2b2553/users/7a165675ea4640d0a265933fc4c7eab4/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 13:50:00.978976 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967ebfc-7878-4eae-99ed-278327452c9d None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:00.980072 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967ebfc-7878-4eae-99ed-278327452c9d None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:00.980203 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967ebfc-7878-4eae-99ed-278327452c9d None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:00.981647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 592/1193] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:50:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:50:00.988158 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e33f6d-d30a-4d52-b9f5-c2344c00d671 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:00.988692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e33f6d-d30a-4d52-b9f5-c2344c00d671 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:00.988692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e33f6d-d30a-4d52-b9f5-c2344c00d671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:01.006564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-e3e33f6d-d30a-4d52-b9f5-c2344c00d671 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:50:01.007821 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-e3e33f6d-d30a-4d52-b9f5-c2344c00d671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:50:01.078574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 602/1194] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:50:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:50:01.103129 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967ebfc-7878-4eae-99ed-278327452c9d None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:01.207259 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967ebfc-7878-4eae-99ed-278327452c9d None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:01.240355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798101c-79e1-4399-87f5-99904ef055f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:01.241152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798101c-79e1-4399-87f5-99904ef055f1 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:01.241431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798101c-79e1-4399-87f5-99904ef055f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:01.241762 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798101c-79e1-4399-87f5-99904ef055f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:01.253734 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798101c-79e1-4399-87f5-99904ef055f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:50:01.262092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-d798101c-79e1-4399-87f5-99904ef055f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:50:01.262092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:01.262092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:50:01.262092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:50:01.262092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:50:01.262092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:50:01.262092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:50:01.262092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:50:01.262092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:50:01.262092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:50:01.262092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:50:01.262092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:50:01.262092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:50:01.262092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:50:01.262092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:50:01.262092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:50:01.263244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:50:01.263244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:50:01.263244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:50:01.263244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:50:01.263244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:50:01.263244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:50:01.263244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:50:01.263244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:50:01.263244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:50:01.263244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:50:01.263244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:50:01.263244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:50:01.263244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:50:01.263244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:50:01.263244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:50:01.263244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:50:01.264453 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:50:01.264453 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:50:01.264453 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:50:01.264453 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:50:01.264453 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:50:01.264453 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:50:01.264453 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:50:01.264453 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:50:01.264453 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:50:01.264453 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:50:01.264453 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:50:01.264453 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:50:01.264453 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 593/1195] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:50:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:50:01.269549 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e33f6d-d30a-4d52-b9f5-c2344c00d671 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:01.380794 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e33f6d-d30a-4d52-b9f5-c2344c00d671 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:01.414355 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86579e-266b-4bd9-8a42-ded5a25a2aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:01.415025 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86579e-266b-4bd9-8a42-ded5a25a2aa9 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:01.415302 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86579e-266b-4bd9-8a42-ded5a25a2aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:01.415572 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86579e-266b-4bd9-8a42-ded5a25a2aa9 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:01.416331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86579e-266b-4bd9-8a42-ded5a25a2aa9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:01.416665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86579e-266b-4bd9-8a42-ded5a25a2aa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:01.418083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86579e-266b-4bd9-8a42-ded5a25a2aa9 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:01.426529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 603/1196] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:50:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:50:01.432914 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798101c-79e1-4399-87f5-99904ef055f1 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:01.539775 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798101c-79e1-4399-87f5-99904ef055f1 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:01.580066 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35e42f-fcac-4c0e-b7de-ee94843c903c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:01.580945 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35e42f-fcac-4c0e-b7de-ee94843c903c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:01.581220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35e42f-fcac-4c0e-b7de-ee94843c903c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:01.581486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35e42f-fcac-4c0e-b7de-ee94843c903c None admin] PATH_INFO: `/v3/users/7a165675ea4640d0a265933fc4c7eab4` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:01.582733 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35e42f-fcac-4c0e-b7de-ee94843c903c None admin] RBAC: Authorizing `identity:get_user(user_id=7a165675ea4640d0a265933fc4c7eab4)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:01.584205 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35e42f-fcac-4c0e-b7de-ee94843c903c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:01.585873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 594/1197] 10.222.0.32 () {56 vars in 1177 bytes} [Tue May 10 13:50:01 2022] GET /identity/v3/users/7a165675ea4640d0a265933fc4c7eab4 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:50:01.592183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86579e-266b-4bd9-8a42-ded5a25a2aa9 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:01.699794 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86579e-266b-4bd9-8a42-ded5a25a2aa9 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:01.737655 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dea32c-88c4-47ce-a7cc-910f559262f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:01.738763 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dea32c-88c4-47ce-a7cc-910f559262f5 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:01.739255 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dea32c-88c4-47ce-a7cc-910f559262f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:01.739755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dea32c-88c4-47ce-a7cc-910f559262f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:01.850664 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dea32c-88c4-47ce-a7cc-910f559262f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:01.852172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dea32c-88c4-47ce-a7cc-910f559262f5 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:01.959342 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 604/1198] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:50:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:50:01.965509 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35e42f-fcac-4c0e-b7de-ee94843c903c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:02.073202 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35e42f-fcac-4c0e-b7de-ee94843c903c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:02.108870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79759430-55fe-4c93-93f9-62bf131386cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:02.109648 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79759430-55fe-4c93-93f9-62bf131386cb None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:02.109927 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79759430-55fe-4c93-93f9-62bf131386cb None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:02.110232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79759430-55fe-4c93-93f9-62bf131386cb None admin] PATH_INFO: `/v3/projects/72c2113c7862438a9763dfd48a2b2553` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:02.111531 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79759430-55fe-4c93-93f9-62bf131386cb None admin] RBAC: Authorizing `identity:get_project(project_id=72c2113c7862438a9763dfd48a2b2553)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:02.112967 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79759430-55fe-4c93-93f9-62bf131386cb None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:02.114772 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 595/1199] 10.222.0.32 () {56 vars in 1186 bytes} [Tue May 10 13:50:01 2022] GET /identity/v3/projects/72c2113c7862438a9763dfd48a2b2553 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:50:02.121926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dea32c-88c4-47ce-a7cc-910f559262f5 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:02.229309 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dea32c-88c4-47ce-a7cc-910f559262f5 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:02.265030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfed7f-f4ca-41b0-9378-de37c3d6652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:02.265697 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfed7f-f4ca-41b0-9378-de37c3d6652c None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:02.265980 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfed7f-f4ca-41b0-9378-de37c3d6652c None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:02.266285 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfed7f-f4ca-41b0-9378-de37c3d6652c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:02.267147 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfed7f-f4ca-41b0-9378-de37c3d6652c None admin] RBAC: Adding query filter params (role.id=17e40821fc444dd0b040dcfce3eb222b, scope.project.id=72c2113c7862438a9763dfd48a2b2553, user.id=7a165675ea4640d0a265933fc4c7eab4) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:02.267463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfed7f-f4ca-41b0-9378-de37c3d6652c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:02.268904 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfed7f-f4ca-41b0-9378-de37c3d6652c None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:02.275637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 605/1200] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:50:02 2022] GET /identity/v3/role_assignments?user.id=7a165675ea4640d0a265933fc4c7eab4&scope.project.id=72c2113c7862438a9763dfd48a2b2553&role.id=17e40821fc444dd0b040dcfce3eb222b => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:07.694678 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1f724-4753-4207-913b-5b296ccdd03f None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:07.695548 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1f724-4753-4207-913b-5b296ccdd03f None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:07.695548 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1f724-4753-4207-913b-5b296ccdd03f None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:07.697579 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 596/1201] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:51:07.703245 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217386db-04e5-42de-baee-6fe8ae758aeb None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:07.703820 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217386db-04e5-42de-baee-6fe8ae758aeb None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:07.703820 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217386db-04e5-42de-baee-6fe8ae758aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:07.734008 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-217386db-04e5-42de-baee-6fe8ae758aeb None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:07.735535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-217386db-04e5-42de-baee-6fe8ae758aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:07.858906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 606/1202] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:51:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:51:07.891921 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1f724-4753-4207-913b-5b296ccdd03f None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:08.079385 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1f724-4753-4207-913b-5b296ccdd03f None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:08.145052 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d742d-a5eb-4560-b578-04bc7fffbc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:08.146619 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d742d-a5eb-4560-b578-04bc7fffbc79 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:08.147081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d742d-a5eb-4560-b578-04bc7fffbc79 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:08.147560 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d742d-a5eb-4560-b578-04bc7fffbc79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:08.169110 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d742d-a5eb-4560-b578-04bc7fffbc79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:08.171339 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d742d-a5eb-4560-b578-04bc7fffbc79 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:08.209257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-0f3d742d-a5eb-4560-b578-04bc7fffbc79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:08.209257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:08.209257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:08.209257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:08.209257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:08.209257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:08.209257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:08.209257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:08.209257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:08.209257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:08.209257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:08.209257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:08.209257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:51:08.209257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:51:08.209257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:51:08.211410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:51:08.211410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:08.211410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:08.211410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:08.211410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:08.211410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:08.211410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:08.211410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:08.211410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:51:08.211410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:08.211410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:08.211410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:08.211410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:08.211410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:08.211410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:08.211410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:08.211410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:08.218399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:51:08.218399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:51:08.218399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:08.218399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:51:08.218399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 597/1203] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:08.218921 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217386db-04e5-42de-baee-6fe8ae758aeb None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:08.405097 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217386db-04e5-42de-baee-6fe8ae758aeb None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:08.458314 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d5ab3-d18b-49b1-94fa-6b3821e4bc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:08.459436 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d5ab3-d18b-49b1-94fa-6b3821e4bc83 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:08.459826 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d5ab3-d18b-49b1-94fa-6b3821e4bc83 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:08.460114 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d5ab3-d18b-49b1-94fa-6b3821e4bc83 None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:08.460962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d5ab3-d18b-49b1-94fa-6b3821e4bc83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:08.461256 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d5ab3-d18b-49b1-94fa-6b3821e4bc83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:08.463534 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d5ab3-d18b-49b1-94fa-6b3821e4bc83 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:08.493082 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 607/1204] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:08.496165 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d742d-a5eb-4560-b578-04bc7fffbc79 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:08.689846 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d742d-a5eb-4560-b578-04bc7fffbc79 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:08.761780 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c20c4-a53a-4bef-88a3-6d7bb5023dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:08.763394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c20c4-a53a-4bef-88a3-6d7bb5023dfb None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:08.763909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c20c4-a53a-4bef-88a3-6d7bb5023dfb None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:08.764182 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c20c4-a53a-4bef-88a3-6d7bb5023dfb None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:08.764911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c20c4-a53a-4bef-88a3-6d7bb5023dfb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:08.766467 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c20c4-a53a-4bef-88a3-6d7bb5023dfb None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:08.806722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 598/1205] 10.222.0.32 () {60 vars in 1132 bytes} [Tue May 10 13:51:08 2022] POST /identity/v3/users => generated 251 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:51:12.143682 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c714d4-7e51-4f73-b52e-d724b6eff6e2 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:12.144543 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c714d4-7e51-4f73-b52e-d724b6eff6e2 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:12.144543 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c714d4-7e51-4f73-b52e-d724b6eff6e2 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:12.145786 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 608/1206] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:51:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:51:12.154815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190c33a-9e16-43ea-a373-c6b0e7bc49ef None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:12.155636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190c33a-9e16-43ea-a373-c6b0e7bc49ef None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:12.155636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190c33a-9e16-43ea-a373-c6b0e7bc49ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:12.190476 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-3190c33a-9e16-43ea-a373-c6b0e7bc49ef None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:12.193017 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-3190c33a-9e16-43ea-a373-c6b0e7bc49ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:12.332311 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 599/1207] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:51:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:51:12.379408 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c714d4-7e51-4f73-b52e-d724b6eff6e2 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:12.582157 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c714d4-7e51-4f73-b52e-d724b6eff6e2 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:12.643470 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494eea07-3f19-46f8-9da4-f4f6eca1f4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:12.645089 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494eea07-3f19-46f8-9da4-f4f6eca1f4a3 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:12.645725 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494eea07-3f19-46f8-9da4-f4f6eca1f4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:12.646101 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494eea07-3f19-46f8-9da4-f4f6eca1f4a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:12.674282 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494eea07-3f19-46f8-9da4-f4f6eca1f4a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:51:12.689134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-494eea07-3f19-46f8-9da4-f4f6eca1f4a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:51:12.689134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:12.689134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:12.689134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:12.689134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:12.689134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:12.689134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:12.689134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:12.689134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:12.689134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:12.689134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:12.689134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:12.689134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:51:12.689134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:51:12.689134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:51:12.689134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:51:12.691806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:51:12.691806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:51:12.691806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:51:12.691806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:51:12.691806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:12.691806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:12.691806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:12.691806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:12.691806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:12.691806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:12.691806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:12.691806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:51:12.691806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:12.691806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:12.691806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:12.691806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:12.693069 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:12.693069 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:12.693069 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:12.693069 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:12.693069 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:51:12.693069 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:51:12.693069 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:51:12.693069 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:51:12.693069 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:51:12.693069 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:51:12.693069 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:51:12.693069 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:12.693069 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 609/1208] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:51:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:12.704811 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190c33a-9e16-43ea-a373-c6b0e7bc49ef None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:12.857486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190c33a-9e16-43ea-a373-c6b0e7bc49ef None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:12.928610 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cfef5-49bf-4836-a39e-b70ba34a1940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:12.929786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cfef5-49bf-4836-a39e-b70ba34a1940 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:12.930329 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cfef5-49bf-4836-a39e-b70ba34a1940 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:12.930709 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cfef5-49bf-4836-a39e-b70ba34a1940 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:12.932211 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cfef5-49bf-4836-a39e-b70ba34a1940 None admin] RBAC: Adding query filter params (name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:12.932844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cfef5-49bf-4836-a39e-b70ba34a1940 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:12.935144 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cfef5-49bf-4836-a39e-b70ba34a1940 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:12.949838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 600/1209] 10.222.0.32 () {56 vars in 1103 bytes} [Tue May 10 13:51:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:51:12.956319 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494eea07-3f19-46f8-9da4-f4f6eca1f4a3 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:13.112848 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494eea07-3f19-46f8-9da4-f4f6eca1f4a3 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:13.161193 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa9bbb-3d09-4e08-ab74-9a85424175b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:13.162489 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa9bbb-3d09-4e08-ab74-9a85424175b8 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:13.162489 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa9bbb-3d09-4e08-ab74-9a85424175b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:13.162805 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa9bbb-3d09-4e08-ab74-9a85424175b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:13.179118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa9bbb-3d09-4e08-ab74-9a85424175b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:13.183764 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa9bbb-3d09-4e08-ab74-9a85424175b8 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:13.223376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-8ffa9bbb-3d09-4e08-ab74-9a85424175b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:13.223376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:13.223376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:13.223376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:13.223376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:13.223376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:13.223376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:13.223376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:13.223376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:13.223376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:13.223376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:13.223376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:13.223376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:51:13.223376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:51:13.223376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:51:13.225388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:51:13.225388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:13.225388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:13.225388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:13.225388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:13.225388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:13.225388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:13.225388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:13.225388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:51:13.225388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:13.225388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:13.225388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:13.225388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:13.225388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:13.225388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:13.225388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:13.225388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:13.227432 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:51:13.227432 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:51:13.227432 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:13.227432 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:13.227432 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 610/1210] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:51:13.235886 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cfef5-49bf-4836-a39e-b70ba34a1940 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:13.403947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cfef5-49bf-4836-a39e-b70ba34a1940 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:13.475263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a22c4-4f12-4b1d-8c8c-f52a17b8bec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:13.476689 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a22c4-4f12-4b1d-8c8c-f52a17b8bec3 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:13.477379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a22c4-4f12-4b1d-8c8c-f52a17b8bec3 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:13.478414 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a22c4-4f12-4b1d-8c8c-f52a17b8bec3 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:13.480677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a22c4-4f12-4b1d-8c8c-f52a17b8bec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:13.481252 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a22c4-4f12-4b1d-8c8c-f52a17b8bec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:13.484521 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a22c4-4f12-4b1d-8c8c-f52a17b8bec3 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:13.518226 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 601/1211] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:13.530535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa9bbb-3d09-4e08-ab74-9a85424175b8 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:13.744099 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa9bbb-3d09-4e08-ab74-9a85424175b8 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:13.796567 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a50fe-2323-45e0-9b41-46c98185dafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:13.797434 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a50fe-2323-45e0-9b41-46c98185dafb None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:13.797724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a50fe-2323-45e0-9b41-46c98185dafb None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:13.798036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a50fe-2323-45e0-9b41-46c98185dafb None admin] PATH_INFO: `/v3/users/placement` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:13.809881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a50fe-2323-45e0-9b41-46c98185dafb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:13.811614 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a50fe-2323-45e0-9b41-46c98185dafb None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:13.832599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-e44a50fe-2323-45e0-9b41-46c98185dafb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 13:51:13.832599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:13.832599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:13.832599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:13.832599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:13.832599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:13.832599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:13.832599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:13.832599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:13.832599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:13.832599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:13.832599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:13.832599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:51:13.832599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:51:13.832599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:51:13.832599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:51:13.841345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:13.841345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:13.841345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:51:13.841345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:51:13.841345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:51:13.841345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:51:13.841345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:13.841345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:13.841345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:13.841345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:13.841345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:13.841345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:51:13.841345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:13.841345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:13.841345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:13.841345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:13.841345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:13.841345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:13.842606 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:13.842606 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:13.842606 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:51:13.842606 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:51:13.842606 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:51:13.842606 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:51:13.842606 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:51:13.842606 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:51:13.842606 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 13:51:13.842606 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:13.842606 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 611/1212] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:51:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:13.843351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a22c4-4f12-4b1d-8c8c-f52a17b8bec3 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:14.023434 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a22c4-4f12-4b1d-8c8c-f52a17b8bec3 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:14.084243 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0df83-f18e-484e-ab7d-e94eba38ce94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:14.086098 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0df83-f18e-484e-ab7d-e94eba38ce94 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:14.086794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0df83-f18e-484e-ab7d-e94eba38ce94 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:14.088142 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0df83-f18e-484e-ab7d-e94eba38ce94 None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:14.090094 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0df83-f18e-484e-ab7d-e94eba38ce94 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:14.090715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0df83-f18e-484e-ab7d-e94eba38ce94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:14.093686 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0df83-f18e-484e-ab7d-e94eba38ce94 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:14.138135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 602/1213] 10.222.0.32 () {56 vars in 1143 bytes} [Tue May 10 13:51:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:51:14.139867 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a50fe-2323-45e0-9b41-46c98185dafb None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:14.281544 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a50fe-2323-45e0-9b41-46c98185dafb None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:14.333305 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dd5ae-e250-406e-9bb3-8e385a0f5f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:14.334479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dd5ae-e250-406e-9bb3-8e385a0f5f4f None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:14.334967 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dd5ae-e250-406e-9bb3-8e385a0f5f4f None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:14.335391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dd5ae-e250-406e-9bb3-8e385a0f5f4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:14.450432 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dd5ae-e250-406e-9bb3-8e385a0f5f4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:14.452365 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dd5ae-e250-406e-9bb3-8e385a0f5f4f None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:14.575080 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 612/1214] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:51:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 13:51:14.580956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0df83-f18e-484e-ab7d-e94eba38ce94 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:14.752970 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0df83-f18e-484e-ab7d-e94eba38ce94 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:14.816295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4061b-3bda-41a3-85b4-44959dd30665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:14.817183 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4061b-3bda-41a3-85b4-44959dd30665 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:14.817675 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4061b-3bda-41a3-85b4-44959dd30665 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:14.818039 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4061b-3bda-41a3-85b4-44959dd30665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:14.834592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4061b-3bda-41a3-85b4-44959dd30665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:14.835999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4061b-3bda-41a3-85b4-44959dd30665 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:14.862444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-47d4061b-3bda-41a3-85b4-44959dd30665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:14.862444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:14.862444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:14.862444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:14.862444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:14.862444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:14.862444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:14.862444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:14.862444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:14.862444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:14.862444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:14.862444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:14.862444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:51:14.862444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:51:14.862444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:51:14.863426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:51:14.863426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:14.863426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:14.863426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:14.863426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:14.863426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:14.863426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:14.863426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:14.863426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:51:14.863426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:14.863426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:14.863426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:14.863426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:14.863426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:14.863426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:14.863426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:14.863426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:14.864309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:51:14.864309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:51:14.864309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:14.864309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:51:14.864309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 603/1215] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:51:14.871633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dd5ae-e250-406e-9bb3-8e385a0f5f4f None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:15.001597 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dd5ae-e250-406e-9bb3-8e385a0f5f4f None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:15.045539 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf98b6b-2c36-4694-bc7f-eb44be9a5fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:15.046500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf98b6b-2c36-4694-bc7f-eb44be9a5fe9 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:15.046866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf98b6b-2c36-4694-bc7f-eb44be9a5fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:15.047286 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf98b6b-2c36-4694-bc7f-eb44be9a5fe9 None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:15.048192 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf98b6b-2c36-4694-bc7f-eb44be9a5fe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:15.048581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf98b6b-2c36-4694-bc7f-eb44be9a5fe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:15.050141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf98b6b-2c36-4694-bc7f-eb44be9a5fe9 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:15.064852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 613/1216] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:51:15.071057 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4061b-3bda-41a3-85b4-44959dd30665 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:15.198383 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4061b-3bda-41a3-85b4-44959dd30665 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:15.252525 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cb60d-a7d0-4c35-8070-9a5a58ed6501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:15.253549 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cb60d-a7d0-4c35-8070-9a5a58ed6501 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:15.253822 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cb60d-a7d0-4c35-8070-9a5a58ed6501 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:15.254113 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cb60d-a7d0-4c35-8070-9a5a58ed6501 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:15.263374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31cb60d-a7d0-4c35-8070-9a5a58ed6501 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:15.264901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31cb60d-a7d0-4c35-8070-9a5a58ed6501 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:15.288351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-d31cb60d-a7d0-4c35-8070-9a5a58ed6501 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:51:15.288351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:15.288351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:15.288351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:15.288351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:15.288351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:15.288351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:15.288351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:15.288351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:15.288351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:15.288351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:15.288351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:15.288351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:51:15.288351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:51:15.288351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:51:15.290996 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:51:15.290996 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:15.290996 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:15.290996 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:15.290996 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:15.290996 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:15.290996 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:15.290996 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:15.290996 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:51:15.290996 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:15.290996 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:15.290996 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:15.290996 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:15.290996 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:15.290996 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:15.290996 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:15.290996 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:15.292249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:51:15.292249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:51:15.292249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:51:15.292249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:51:15.292249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:51:15.292249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:51:15.292249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:51:15.292249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:51:15.292249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 604/1217] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:51:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:15.298753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf98b6b-2c36-4694-bc7f-eb44be9a5fe9 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:15.449889 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf98b6b-2c36-4694-bc7f-eb44be9a5fe9 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:15.495415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744322ea-42c5-4f17-b14a-96ad4a9dc8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:15.496202 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744322ea-42c5-4f17-b14a-96ad4a9dc8bc None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:15.496635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744322ea-42c5-4f17-b14a-96ad4a9dc8bc None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:15.496980 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744322ea-42c5-4f17-b14a-96ad4a9dc8bc None admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:15.497968 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744322ea-42c5-4f17-b14a-96ad4a9dc8bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:15.498941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744322ea-42c5-4f17-b14a-96ad4a9dc8bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:15.501196 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744322ea-42c5-4f17-b14a-96ad4a9dc8bc None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:15.521260 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 614/1218] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:51:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:15.529851 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cb60d-a7d0-4c35-8070-9a5a58ed6501 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:15.657265 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cb60d-a7d0-4c35-8070-9a5a58ed6501 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:15.701052 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c5bae-6418-48a2-9f27-5f279d7621bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:15.701052 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c5bae-6418-48a2-9f27-5f279d7621bc None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:15.701052 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c5bae-6418-48a2-9f27-5f279d7621bc None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:15.701433 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c5bae-6418-48a2-9f27-5f279d7621bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:15.701957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c5bae-6418-48a2-9f27-5f279d7621bc None admin] RBAC: Adding query filter params (role.id=567077e602b043f8b81abc208831228a, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=4859a69a988a4b10b67187553d829b4f) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:15.702264 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c5bae-6418-48a2-9f27-5f279d7621bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:15.703691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c5bae-6418-48a2-9f27-5f279d7621bc None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:15.709878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 605/1219] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:51:15 2022] GET /identity/v3/role_assignments?user.id=4859a69a988a4b10b67187553d829b4f&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=567077e602b043f8b81abc208831228a => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:18.287618 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7186a-cbaf-44ec-92a5-880c00c99939 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:18.288179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7186a-cbaf-44ec-92a5-880c00c99939 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:18.288179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7186a-cbaf-44ec-92a5-880c00c99939 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:18.289572 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 615/1220] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:51:18.296887 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7684305-9ac8-4703-989e-aaa6d3fb6536 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:18.297364 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7684305-9ac8-4703-989e-aaa6d3fb6536 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:18.297465 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7684305-9ac8-4703-989e-aaa6d3fb6536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:18.316757 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-f7684305-9ac8-4703-989e-aaa6d3fb6536 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:18.317949 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-f7684305-9ac8-4703-989e-aaa6d3fb6536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:18.423387 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 606/1221] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:51:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:51:18.450585 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7186a-cbaf-44ec-92a5-880c00c99939 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:18.570417 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7186a-cbaf-44ec-92a5-880c00c99939 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:18.608365 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93251ea9-ce15-4241-9d0b-c6a69d56705d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:18.609248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93251ea9-ce15-4241-9d0b-c6a69d56705d None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:18.609801 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93251ea9-ce15-4241-9d0b-c6a69d56705d None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:18.610094 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93251ea9-ce15-4241-9d0b-c6a69d56705d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:18.621320 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93251ea9-ce15-4241-9d0b-c6a69d56705d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:51:18.629251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-93251ea9-ce15-4241-9d0b-c6a69d56705d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:51:18.629251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:18.629251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:18.629251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:18.629251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:18.629251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:18.629251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:18.629251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:18.629251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:18.629251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:18.629251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:18.629251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:18.629251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:51:18.629251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:51:18.629251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:51:18.629251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:51:18.630938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:51:18.630938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:51:18.630938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:51:18.630938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:51:18.630938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:18.630938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:18.630938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:18.630938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:18.630938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:18.630938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:18.630938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:18.630938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:51:18.630938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:18.630938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:18.630938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:18.630938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:18.632083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:18.632083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:18.632083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:18.632083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:18.632083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:51:18.632083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:51:18.632083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:51:18.632083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:51:18.632083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:51:18.632083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:51:18.632083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:51:18.632083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:18.632083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 616/1222] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:51:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:18.636845 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7684305-9ac8-4703-989e-aaa6d3fb6536 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:18.745994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7684305-9ac8-4703-989e-aaa6d3fb6536 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:18.792195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cff08-e6c8-4f79-b5d7-cff6763a8f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:18.792973 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cff08-e6c8-4f79-b5d7-cff6763a8f35 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:18.793258 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cff08-e6c8-4f79-b5d7-cff6763a8f35 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:18.793591 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cff08-e6c8-4f79-b5d7-cff6763a8f35 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:18.794407 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cff08-e6c8-4f79-b5d7-cff6763a8f35 None admin] RBAC: Adding query filter params (name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:18.794693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cff08-e6c8-4f79-b5d7-cff6763a8f35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:18.796105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cff08-e6c8-4f79-b5d7-cff6763a8f35 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:18.805397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 607/1223] 10.222.0.32 () {56 vars in 1103 bytes} [Tue May 10 13:51:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:18.811448 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93251ea9-ce15-4241-9d0b-c6a69d56705d None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:18.934375 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93251ea9-ce15-4241-9d0b-c6a69d56705d None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:18.973172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96789a6a-6d10-4c34-b45f-03ee1fb1d567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:18.974159 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96789a6a-6d10-4c34-b45f-03ee1fb1d567 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:18.974478 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96789a6a-6d10-4c34-b45f-03ee1fb1d567 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:18.974759 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96789a6a-6d10-4c34-b45f-03ee1fb1d567 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:18.989217 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96789a6a-6d10-4c34-b45f-03ee1fb1d567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:18.990754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96789a6a-6d10-4c34-b45f-03ee1fb1d567 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:19.011173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-96789a6a-6d10-4c34-b45f-03ee1fb1d567 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:19.011173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:19.011173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:19.011173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:19.011173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:19.011173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:19.011173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:19.011173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:19.011173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:19.011173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:19.011173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:19.011173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:19.011173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:51:19.011173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:51:19.011173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:51:19.012403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:51:19.012403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:19.012403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:19.012403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:19.012403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:19.012403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:19.012403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:19.012403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:19.012403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:51:19.012403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:19.012403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:19.012403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:19.012403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:19.012403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:19.012403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:19.012403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:19.012403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:19.013362 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:51:19.013362 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:51:19.013362 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:19.013362 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:19.013362 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 617/1224] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:19.018619 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cff08-e6c8-4f79-b5d7-cff6763a8f35 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:19.157605 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cff08-e6c8-4f79-b5d7-cff6763a8f35 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:19.208207 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e92f6-17f3-4471-a110-ce82f378b728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:19.209393 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e92f6-17f3-4471-a110-ce82f378b728 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:19.209887 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e92f6-17f3-4471-a110-ce82f378b728 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:19.212090 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e92f6-17f3-4471-a110-ce82f378b728 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:19.214319 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e92f6-17f3-4471-a110-ce82f378b728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:19.214896 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e92f6-17f3-4471-a110-ce82f378b728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:19.217577 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e92f6-17f3-4471-a110-ce82f378b728 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:19.235682 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 608/1225] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:19.241366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96789a6a-6d10-4c34-b45f-03ee1fb1d567 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:19.366612 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96789a6a-6d10-4c34-b45f-03ee1fb1d567 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:19.407193 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b0e6e-0c2f-47bf-9aa0-e1f251687c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:19.408140 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b0e6e-0c2f-47bf-9aa0-e1f251687c65 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:19.408331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b0e6e-0c2f-47bf-9aa0-e1f251687c65 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:19.408638 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b0e6e-0c2f-47bf-9aa0-e1f251687c65 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:19.418886 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b0e6e-0c2f-47bf-9aa0-e1f251687c65 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:19.420489 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b0e6e-0c2f-47bf-9aa0-e1f251687c65 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:19.440912 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-5b7b0e6e-0c2f-47bf-9aa0-e1f251687c65 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 13:51:19.440912 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:19.440912 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:19.440912 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:19.440912 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:19.440912 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:19.440912 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:19.440912 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:19.440912 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:19.440912 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:19.440912 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:19.440912 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:19.440912 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:51:19.440912 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:51:19.440912 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:51:19.440912 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:51:19.443460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:19.443460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:19.443460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:51:19.443460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:51:19.443460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:51:19.443460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:51:19.443460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:19.443460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:19.443460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:19.443460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:19.443460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:19.443460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:51:19.443460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:19.443460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:19.443460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:19.443460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:19.443460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:19.443460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:19.445444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:19.445444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:19.445444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:51:19.445444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:51:19.445444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:51:19.445444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:51:19.445444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:51:19.445444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:51:19.445444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 13:51:19.445444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:19.445444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 618/1226] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:51:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:19.449613 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e92f6-17f3-4471-a110-ce82f378b728 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:19.589508 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e92f6-17f3-4471-a110-ce82f378b728 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:19.628410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b6255-533e-4635-9ad3-6268ef2eba9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:19.628674 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b6255-533e-4635-9ad3-6268ef2eba9c None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:19.629025 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b6255-533e-4635-9ad3-6268ef2eba9c None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:19.629122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b6255-533e-4635-9ad3-6268ef2eba9c None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:19.629963 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b6255-533e-4635-9ad3-6268ef2eba9c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:19.630265 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b6255-533e-4635-9ad3-6268ef2eba9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:19.631701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b6255-533e-4635-9ad3-6268ef2eba9c None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:19.653100 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 609/1227] 10.222.0.32 () {56 vars in 1143 bytes} [Tue May 10 13:51:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:19.659623 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b0e6e-0c2f-47bf-9aa0-e1f251687c65 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:19.784836 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b0e6e-0c2f-47bf-9aa0-e1f251687c65 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:19.821209 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617ca83-f28e-4650-865a-e111f7bd39ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:19.822243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617ca83-f28e-4650-865a-e111f7bd39ce None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:19.822604 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617ca83-f28e-4650-865a-e111f7bd39ce None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:19.822966 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617ca83-f28e-4650-865a-e111f7bd39ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:19.843010 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617ca83-f28e-4650-865a-e111f7bd39ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:19.844801 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617ca83-f28e-4650-865a-e111f7bd39ce None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:19.871779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-6617ca83-f28e-4650-865a-e111f7bd39ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:19.871779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:19.871779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:19.871779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:19.871779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:19.871779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:19.871779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:19.871779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:19.871779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:19.871779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:19.871779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:19.871779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:19.871779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:51:19.871779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:51:19.871779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:51:19.872881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:51:19.872881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:19.872881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:19.872881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:19.872881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:19.872881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:19.872881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:19.872881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:19.872881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:51:19.872881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:19.872881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:19.872881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:19.872881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:19.872881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:19.872881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:19.872881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:19.872881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:19.873928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:51:19.873928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:51:19.873928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:19.873928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:19.873928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 619/1228] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:51:19.881942 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b6255-533e-4635-9ad3-6268ef2eba9c None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:20.010072 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b6255-533e-4635-9ad3-6268ef2eba9c None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:20.058768 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0357c0e-7756-469b-abf6-07d94270c091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:20.059632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0357c0e-7756-469b-abf6-07d94270c091 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:20.059955 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0357c0e-7756-469b-abf6-07d94270c091 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:20.060436 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0357c0e-7756-469b-abf6-07d94270c091 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:20.061599 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0357c0e-7756-469b-abf6-07d94270c091 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:20.061953 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0357c0e-7756-469b-abf6-07d94270c091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:20.064278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0357c0e-7756-469b-abf6-07d94270c091 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:20.077512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 610/1229] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:20.083150 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617ca83-f28e-4650-865a-e111f7bd39ce None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:20.199393 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617ca83-f28e-4650-865a-e111f7bd39ce None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:20.244065 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85784e3-ff0b-4cce-a585-6d4a9ecf1ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:20.244969 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85784e3-ff0b-4cce-a585-6d4a9ecf1ca1 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:20.245350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85784e3-ff0b-4cce-a585-6d4a9ecf1ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:20.245557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85784e3-ff0b-4cce-a585-6d4a9ecf1ca1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:20.253881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85784e3-ff0b-4cce-a585-6d4a9ecf1ca1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:20.255596 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85784e3-ff0b-4cce-a585-6d4a9ecf1ca1 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:20.272598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-a85784e3-ff0b-4cce-a585-6d4a9ecf1ca1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:51:20.272598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:20.272598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:20.272598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:20.272598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:20.272598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:20.272598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:20.272598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:20.272598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:20.272598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:20.272598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:20.272598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:20.272598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:51:20.272598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:51:20.272598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:51:20.274057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:51:20.274057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:20.274057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:20.274057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:20.274057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:20.274057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:20.274057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:20.274057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:20.274057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:51:20.274057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:20.274057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:20.274057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:20.274057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:20.274057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:20.274057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:20.274057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:20.274057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:20.275929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:51:20.275929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:51:20.275929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:51:20.275929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:51:20.275929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:51:20.275929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:51:20.275929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:51:20.275929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:20.275929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 620/1230] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:51:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:20.280682 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0357c0e-7756-469b-abf6-07d94270c091 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:20.407823 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0357c0e-7756-469b-abf6-07d94270c091 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:20.447945 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c1f64-d803-498b-83d7-51c3705970f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:20.448614 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c1f64-d803-498b-83d7-51c3705970f1 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:20.448899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c1f64-d803-498b-83d7-51c3705970f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:20.449175 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c1f64-d803-498b-83d7-51c3705970f1 None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:20.449972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c1f64-d803-498b-83d7-51c3705970f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:20.450543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c1f64-d803-498b-83d7-51c3705970f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:20.451985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c1f64-d803-498b-83d7-51c3705970f1 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:20.472908 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 611/1231] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:51:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:20.474140 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85784e3-ff0b-4cce-a585-6d4a9ecf1ca1 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:20.600244 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85784e3-ff0b-4cce-a585-6d4a9ecf1ca1 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:20.644367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d532ad1-236a-4ae9-bf03-e2b89129cc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:20.645304 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d532ad1-236a-4ae9-bf03-e2b89129cc30 None admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:20.645552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d532ad1-236a-4ae9-bf03-e2b89129cc30 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:20.645826 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d532ad1-236a-4ae9-bf03-e2b89129cc30 None admin] PATH_INFO: `/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/4859a69a988a4b10b67187553d829b4f/roles/567077e602b043f8b81abc208831228a` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:20.670872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d532ad1-236a-4ae9-bf03-e2b89129cc30 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1cda14bca5c497dba2d18685dfe6cc2, user_id=4859a69a988a4b10b67187553d829b4f, role_id=567077e602b043f8b81abc208831228a)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:20.672382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d532ad1-236a-4ae9-bf03-e2b89129cc30 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:20.702522 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 621/1232] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:51:20 2022] PUT /identity/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/4859a69a988a4b10b67187553d829b4f/roles/567077e602b043f8b81abc208831228a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:51:23.089598 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0bb4d-630b-41c4-a476-8bd246dfa566 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:23.090272 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0bb4d-630b-41c4-a476-8bd246dfa566 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:23.090272 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0bb4d-630b-41c4-a476-8bd246dfa566 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:23.091552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 612/1233] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:51:23.099032 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41045d6-a966-4175-be5e-c6ddad589001 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:23.099869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41045d6-a966-4175-be5e-c6ddad589001 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:23.100053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41045d6-a966-4175-be5e-c6ddad589001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:23.124346 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-c41045d6-a966-4175-be5e-c6ddad589001 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:23.125918 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c41045d6-a966-4175-be5e-c6ddad589001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:23.223722 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 622/1234] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:51:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:51:23.251855 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0bb4d-630b-41c4-a476-8bd246dfa566 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:23.381189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0bb4d-630b-41c4-a476-8bd246dfa566 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:23.424169 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40f61a-9364-41d8-8e59-46fc9c037363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:23.425426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40f61a-9364-41d8-8e59-46fc9c037363 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:23.425995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40f61a-9364-41d8-8e59-46fc9c037363 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:23.426476 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40f61a-9364-41d8-8e59-46fc9c037363 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:23.439063 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40f61a-9364-41d8-8e59-46fc9c037363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:51:23.449379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-fc40f61a-9364-41d8-8e59-46fc9c037363 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:51:23.449379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:23.449379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:23.449379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:23.449379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:23.449379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:23.449379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:23.449379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:23.449379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:23.449379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:23.449379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:23.449379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:23.449379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:51:23.449379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:51:23.449379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:51:23.449379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:51:23.451141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:51:23.451141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:51:23.451141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:51:23.451141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:51:23.451141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:23.451141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:23.451141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:23.451141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:23.451141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:23.451141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:23.451141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:23.451141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:51:23.451141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:23.451141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:23.451141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:23.451141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:23.452827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:23.452827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:23.452827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:23.452827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:23.452827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:51:23.452827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:51:23.452827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:51:23.452827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:51:23.452827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:51:23.452827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:51:23.452827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:51:23.452827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:51:23.452827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 613/1235] 10.222.0.32 () {56 vars in 1102 bytes} [Tue May 10 13:51:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:51:23.459015 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41045d6-a966-4175-be5e-c6ddad589001 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:23.590165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41045d6-a966-4175-be5e-c6ddad589001 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:23.633281 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bd34c-2d4f-48be-bf62-b5c65e1dd8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:23.633881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bd34c-2d4f-48be-bf62-b5c65e1dd8d3 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:23.634776 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bd34c-2d4f-48be-bf62-b5c65e1dd8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:23.635273 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bd34c-2d4f-48be-bf62-b5c65e1dd8d3 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:23.636085 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bd34c-2d4f-48be-bf62-b5c65e1dd8d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:23.636392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bd34c-2d4f-48be-bf62-b5c65e1dd8d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:23.637892 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bd34c-2d4f-48be-bf62-b5c65e1dd8d3 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:23.648182 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 623/1236] 10.222.0.32 () {56 vars in 1103 bytes} [Tue May 10 13:51:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:23.655165 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40f61a-9364-41d8-8e59-46fc9c037363 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:23.769302 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40f61a-9364-41d8-8e59-46fc9c037363 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:23.818533 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4ed54-4e4a-45b8-83b0-8d128ec42493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:23.819412 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4ed54-4e4a-45b8-83b0-8d128ec42493 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:23.819842 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4ed54-4e4a-45b8-83b0-8d128ec42493 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:23.820544 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4ed54-4e4a-45b8-83b0-8d128ec42493 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:23.834147 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4ed54-4e4a-45b8-83b0-8d128ec42493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:23.835940 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4ed54-4e4a-45b8-83b0-8d128ec42493 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:23.858012 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-34d4ed54-4e4a-45b8-83b0-8d128ec42493 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:23.858012 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:23.858012 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:23.858012 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:23.858012 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:23.858012 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:23.858012 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:23.858012 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:23.858012 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:23.858012 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:23.858012 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:23.858012 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:23.858012 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:51:23.858012 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:51:23.858012 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:51:23.859045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:51:23.859045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:23.859045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:23.859045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:23.859045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:23.859045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:23.859045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:23.859045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:23.859045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:51:23.859045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:23.859045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:23.859045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:23.859045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:23.859045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:23.859045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:23.859045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:23.859045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:23.860442 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:51:23.860442 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:51:23.860442 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:23.860442 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:51:23.860442 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 614/1237] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:23.867640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bd34c-2d4f-48be-bf62-b5c65e1dd8d3 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:23.989064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bd34c-2d4f-48be-bf62-b5c65e1dd8d3 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:24.026315 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0def7d1-496c-41df-9092-beaa77166582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:24.026984 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0def7d1-496c-41df-9092-beaa77166582 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:24.027265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0def7d1-496c-41df-9092-beaa77166582 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:24.027535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0def7d1-496c-41df-9092-beaa77166582 None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:24.028250 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0def7d1-496c-41df-9092-beaa77166582 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:24.028553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0def7d1-496c-41df-9092-beaa77166582 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:24.029943 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0def7d1-496c-41df-9092-beaa77166582 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:24.041275 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 624/1238] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:24.047050 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4ed54-4e4a-45b8-83b0-8d128ec42493 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:24.175389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4ed54-4e4a-45b8-83b0-8d128ec42493 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:24.217717 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb60f83-e112-45a2-9d0e-21818bb9b6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:24.218715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb60f83-e112-45a2-9d0e-21818bb9b6db None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:24.219046 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb60f83-e112-45a2-9d0e-21818bb9b6db None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:24.219408 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb60f83-e112-45a2-9d0e-21818bb9b6db None admin] PATH_INFO: `/v3/users/placement` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:24.231328 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb60f83-e112-45a2-9d0e-21818bb9b6db None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:24.232981 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb60f83-e112-45a2-9d0e-21818bb9b6db None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:24.250152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-afb60f83-e112-45a2-9d0e-21818bb9b6db None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 13:51:24.250152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:24.250152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:24.250152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:24.250152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:24.250152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:24.250152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:24.250152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:24.250152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:24.250152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:24.250152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:24.250152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:24.250152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:51:24.250152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:51:24.250152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:51:24.250152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:51:24.253161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:24.253161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:24.253161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:51:24.253161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:51:24.253161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:51:24.253161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:51:24.253161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:24.253161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:24.253161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:24.253161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:24.253161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:24.253161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:51:24.253161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:24.253161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:24.253161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:24.253161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:24.253161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:24.253161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:24.254402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:24.254402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:24.254402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:51:24.254402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:51:24.254402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:51:24.254402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:51:24.254402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:51:24.254402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:51:24.254402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 13:51:24.254402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:51:24.254402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 615/1239] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:51:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:51:24.257136 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0def7d1-496c-41df-9092-beaa77166582 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:24.366988 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0def7d1-496c-41df-9092-beaa77166582 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:24.411529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e716b-3c32-41df-a399-486790384204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:24.412404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e716b-3c32-41df-a399-486790384204 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:24.412729 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e716b-3c32-41df-a399-486790384204 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:24.413031 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e716b-3c32-41df-a399-486790384204 None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:24.414056 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e716b-3c32-41df-a399-486790384204 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:24.414497 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e716b-3c32-41df-a399-486790384204 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:24.416683 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e716b-3c32-41df-a399-486790384204 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:24.443174 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 625/1240] 10.222.0.32 () {56 vars in 1143 bytes} [Tue May 10 13:51:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:51:24.444468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb60f83-e112-45a2-9d0e-21818bb9b6db None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:24.563228 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb60f83-e112-45a2-9d0e-21818bb9b6db None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:24.600962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568726d-5ea2-44b7-81b3-e13a5ac98d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:24.601687 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568726d-5ea2-44b7-81b3-e13a5ac98d95 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:24.602020 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568726d-5ea2-44b7-81b3-e13a5ac98d95 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:24.602398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568726d-5ea2-44b7-81b3-e13a5ac98d95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:24.690358 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568726d-5ea2-44b7-81b3-e13a5ac98d95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:24.692236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568726d-5ea2-44b7-81b3-e13a5ac98d95 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:24.823980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 616/1241] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:51:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:51:24.825382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e716b-3c32-41df-a399-486790384204 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:24.949414 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e716b-3c32-41df-a399-486790384204 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:24.990438 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade9315-2af0-437c-afb3-0bbfc8969de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:24.991432 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade9315-2af0-437c-afb3-0bbfc8969de0 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:24.991682 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade9315-2af0-437c-afb3-0bbfc8969de0 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:24.991810 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade9315-2af0-437c-afb3-0bbfc8969de0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:25.003543 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade9315-2af0-437c-afb3-0bbfc8969de0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:25.005002 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade9315-2af0-437c-afb3-0bbfc8969de0 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:25.027373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-1ade9315-2af0-437c-afb3-0bbfc8969de0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:25.027373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:25.027373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:25.027373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:25.027373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:25.027373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:25.027373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:25.027373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:25.027373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:25.027373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:25.027373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:25.027373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:25.027373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:51:25.027373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:51:25.027373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:51:25.029030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:51:25.029030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:25.029030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:25.029030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:25.029030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:25.029030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:25.029030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:25.029030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:25.029030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:51:25.029030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:25.029030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:25.029030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:25.029030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:25.029030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:25.029030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:25.029030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:25.029030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:25.030691 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:51:25.030691 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:51:25.030691 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:25.030691 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:25.031642 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 626/1242] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:25.038881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568726d-5ea2-44b7-81b3-e13a5ac98d95 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:25.147764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568726d-5ea2-44b7-81b3-e13a5ac98d95 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:25.185368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97892d-7ebc-4f51-8794-6d7bfa704911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:25.186089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97892d-7ebc-4f51-8794-6d7bfa704911 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:25.186371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97892d-7ebc-4f51-8794-6d7bfa704911 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:25.186646 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97892d-7ebc-4f51-8794-6d7bfa704911 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:25.187378 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97892d-7ebc-4f51-8794-6d7bfa704911 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:25.188049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97892d-7ebc-4f51-8794-6d7bfa704911 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:25.190551 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97892d-7ebc-4f51-8794-6d7bfa704911 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:25.211818 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 617/1243] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:25.218901 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade9315-2af0-437c-afb3-0bbfc8969de0 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:25.353558 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade9315-2af0-437c-afb3-0bbfc8969de0 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:25.403576 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d50028-d63d-4cb1-ab78-c75abe54417e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:25.404310 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d50028-d63d-4cb1-ab78-c75abe54417e None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:25.404747 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d50028-d63d-4cb1-ab78-c75abe54417e None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:25.405212 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d50028-d63d-4cb1-ab78-c75abe54417e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:25.414806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d50028-d63d-4cb1-ab78-c75abe54417e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:25.416541 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d50028-d63d-4cb1-ab78-c75abe54417e None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:25.438941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-d7d50028-d63d-4cb1-ab78-c75abe54417e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:51:25.438941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:25.438941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:25.438941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:25.438941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:25.438941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:25.438941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:25.438941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:25.438941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:25.438941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:25.438941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:25.438941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:25.438941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:51:25.438941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:51:25.438941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:51:25.449384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:51:25.449384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:25.449384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:25.449384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:25.449384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:25.449384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:25.449384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:25.449384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:25.449384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:51:25.449384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:25.449384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:25.449384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:25.449384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:25.449384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:25.449384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:25.449384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:25.449384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:25.450866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:51:25.450866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:51:25.450866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:51:25.450866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:51:25.450866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:51:25.450866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:51:25.450866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:51:25.450866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:25.450866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 627/1244] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:51:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:51:25.452109 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97892d-7ebc-4f51-8794-6d7bfa704911 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:25.581043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97892d-7ebc-4f51-8794-6d7bfa704911 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:25.626819 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58aa60-8315-463c-96d7-0b5bf52fa723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:25.627794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58aa60-8315-463c-96d7-0b5bf52fa723 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:25.628502 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58aa60-8315-463c-96d7-0b5bf52fa723 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:25.628803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58aa60-8315-463c-96d7-0b5bf52fa723 None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:25.629706 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58aa60-8315-463c-96d7-0b5bf52fa723 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:25.630050 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58aa60-8315-463c-96d7-0b5bf52fa723 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:25.631903 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58aa60-8315-463c-96d7-0b5bf52fa723 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:25.646989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 618/1245] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:51:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:25.653517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d50028-d63d-4cb1-ab78-c75abe54417e None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:25.776966 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d50028-d63d-4cb1-ab78-c75abe54417e None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:25.819062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997253e-ef63-4a78-8b07-5adb13cc7220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:25.819832 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997253e-ef63-4a78-8b07-5adb13cc7220 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:25.820548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997253e-ef63-4a78-8b07-5adb13cc7220 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:25.820878 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997253e-ef63-4a78-8b07-5adb13cc7220 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:25.822027 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5997253e-ef63-4a78-8b07-5adb13cc7220 None admin] RBAC: Adding query filter params (role.id=567077e602b043f8b81abc208831228a, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=4859a69a988a4b10b67187553d829b4f) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:25.822498 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5997253e-ef63-4a78-8b07-5adb13cc7220 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:25.824349 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5997253e-ef63-4a78-8b07-5adb13cc7220 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:25.835271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 628/1246] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:51:25 2022] GET /identity/v3/role_assignments?user.id=4859a69a988a4b10b67187553d829b4f&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=567077e602b043f8b81abc208831228a => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:51:28.566732 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05e61b-4c00-4fb6-8ecc-0e67ae421a92 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:28.567389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05e61b-4c00-4fb6-8ecc-0e67ae421a92 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:28.567389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05e61b-4c00-4fb6-8ecc-0e67ae421a92 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:28.568859 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 619/1247] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:51:28.574996 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d508-bc1d-4506-a1de-7e43742e21d4 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:28.575559 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d508-bc1d-4506-a1de-7e43742e21d4 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:28.575559 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d508-bc1d-4506-a1de-7e43742e21d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:28.594982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-c9a0d508-bc1d-4506-a1de-7e43742e21d4 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:28.596194 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c9a0d508-bc1d-4506-a1de-7e43742e21d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:28.684821 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 629/1248] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:51:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:51:28.714943 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05e61b-4c00-4fb6-8ecc-0e67ae421a92 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:28.846596 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05e61b-4c00-4fb6-8ecc-0e67ae421a92 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:28.886095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb050b-4057-4736-85d9-782a87c2a540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:28.886910 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb050b-4057-4736-85d9-782a87c2a540 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:28.887202 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb050b-4057-4736-85d9-782a87c2a540 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:28.887457 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb050b-4057-4736-85d9-782a87c2a540 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:28.898705 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb050b-4057-4736-85d9-782a87c2a540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:51:28.908086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-dbcb050b-4057-4736-85d9-782a87c2a540 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:51:28.908086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:28.908086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:28.908086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:28.908086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:28.908086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:28.908086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:28.908086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:28.908086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:28.908086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:28.908086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:28.908086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:28.908086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:51:28.908086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:51:28.908086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:51:28.908086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:51:28.909988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:51:28.909988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:51:28.909988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:51:28.909988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:51:28.909988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:28.909988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:28.909988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:28.909988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:28.909988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:28.909988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:28.909988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:28.909988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:51:28.909988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:28.909988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:28.909988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:28.909988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:28.911729 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:28.911729 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:28.911729 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:28.911729 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:28.911729 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:51:28.911729 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:51:28.911729 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:51:28.911729 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:51:28.911729 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:51:28.911729 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:51:28.911729 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:51:28.911729 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:51:28.911729 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 620/1249] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:51:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:28.915635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0d508-bc1d-4506-a1de-7e43742e21d4 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:29.057891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0d508-bc1d-4506-a1de-7e43742e21d4 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:29.097290 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30feaf72-2280-43bf-bf7f-286f157830e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:29.097896 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30feaf72-2280-43bf-bf7f-286f157830e8 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:29.098183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30feaf72-2280-43bf-bf7f-286f157830e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:29.098488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30feaf72-2280-43bf-bf7f-286f157830e8 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:29.099250 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30feaf72-2280-43bf-bf7f-286f157830e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:29.099602 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30feaf72-2280-43bf-bf7f-286f157830e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:29.100938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30feaf72-2280-43bf-bf7f-286f157830e8 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:29.110272 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 630/1250] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:51:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:51:29.116221 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb050b-4057-4736-85d9-782a87c2a540 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:29.247638 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb050b-4057-4736-85d9-782a87c2a540 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:29.284854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33676461-bb16-47ea-b5c8-f0c7f5b7e392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:29.285645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33676461-bb16-47ea-b5c8-f0c7f5b7e392 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:29.285927 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33676461-bb16-47ea-b5c8-f0c7f5b7e392 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:29.286220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33676461-bb16-47ea-b5c8-f0c7f5b7e392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:29.303947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33676461-bb16-47ea-b5c8-f0c7f5b7e392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:29.305457 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33676461-bb16-47ea-b5c8-f0c7f5b7e392 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:29.334188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-33676461-bb16-47ea-b5c8-f0c7f5b7e392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:29.334188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:29.334188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:29.334188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:29.334188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:29.334188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:29.334188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:29.334188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:29.334188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:29.334188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:29.334188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:29.334188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:29.334188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:51:29.334188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:51:29.334188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:51:29.336296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:51:29.336296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:29.336296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:29.336296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:29.336296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:29.336296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:29.336296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:29.336296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:29.336296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:51:29.336296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:29.336296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:29.336296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:29.336296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:29.336296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:29.336296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:29.336296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:29.336296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:29.338540 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:51:29.338540 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:51:29.338540 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:29.338540 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:51:29.338540 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 621/1251] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:29.347122 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30feaf72-2280-43bf-bf7f-286f157830e8 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:29.471731 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30feaf72-2280-43bf-bf7f-286f157830e8 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:29.507592 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c6eb8-1be4-40ac-98ed-22918d23b3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:29.508283 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c6eb8-1be4-40ac-98ed-22918d23b3b0 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:29.508549 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c6eb8-1be4-40ac-98ed-22918d23b3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:29.508815 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c6eb8-1be4-40ac-98ed-22918d23b3b0 None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:29.509564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c6eb8-1be4-40ac-98ed-22918d23b3b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:29.509900 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c6eb8-1be4-40ac-98ed-22918d23b3b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:29.511286 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c6eb8-1be4-40ac-98ed-22918d23b3b0 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:29.523592 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 631/1252] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:29.529656 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33676461-bb16-47ea-b5c8-f0c7f5b7e392 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:29.641814 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33676461-bb16-47ea-b5c8-f0c7f5b7e392 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:29.678872 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97047d70-2d39-4966-83dc-dacccdaadd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:29.679840 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97047d70-2d39-4966-83dc-dacccdaadd8d None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:29.680133 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97047d70-2d39-4966-83dc-dacccdaadd8d None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:29.680438 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97047d70-2d39-4966-83dc-dacccdaadd8d None admin] PATH_INFO: `/v3/users/placement` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:29.689810 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97047d70-2d39-4966-83dc-dacccdaadd8d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:29.691320 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97047d70-2d39-4966-83dc-dacccdaadd8d None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:29.708553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-97047d70-2d39-4966-83dc-dacccdaadd8d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 13:51:29.708553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:29.708553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:29.708553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:29.708553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:29.708553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:29.708553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:29.708553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:29.708553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:29.708553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:29.708553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:29.708553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:29.708553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:51:29.708553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:51:29.708553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:51:29.708553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:51:29.709738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:29.709738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:29.709738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:51:29.709738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:51:29.709738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:51:29.709738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:51:29.709738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:29.709738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:29.709738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:29.709738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:29.709738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:29.709738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:51:29.709738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:29.709738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:29.709738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:29.709738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:29.709738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:29.709738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:29.710904 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:29.710904 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:29.710904 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:51:29.710904 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:51:29.710904 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:51:29.710904 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:51:29.710904 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:51:29.710904 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:51:29.710904 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 13:51:29.710904 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:51:29.710904 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 622/1253] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:51:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:29.716986 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c6eb8-1be4-40ac-98ed-22918d23b3b0 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:29.839926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c6eb8-1be4-40ac-98ed-22918d23b3b0 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:29.887709 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772bbe2-ebd4-4d0e-960a-59267e45cd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:29.888686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772bbe2-ebd4-4d0e-960a-59267e45cd1d None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:29.888972 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772bbe2-ebd4-4d0e-960a-59267e45cd1d None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:29.889249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772bbe2-ebd4-4d0e-960a-59267e45cd1d None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:29.890113 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772bbe2-ebd4-4d0e-960a-59267e45cd1d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:29.890471 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772bbe2-ebd4-4d0e-960a-59267e45cd1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:29.891911 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772bbe2-ebd4-4d0e-960a-59267e45cd1d None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:29.914738 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 632/1254] 10.222.0.32 () {56 vars in 1143 bytes} [Tue May 10 13:51:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:29.924018 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97047d70-2d39-4966-83dc-dacccdaadd8d None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:30.050467 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97047d70-2d39-4966-83dc-dacccdaadd8d None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:30.089253 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c4e2c-e1ed-4d13-9e76-2eb4dcb28778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:30.090001 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c4e2c-e1ed-4d13-9e76-2eb4dcb28778 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:30.090313 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c4e2c-e1ed-4d13-9e76-2eb4dcb28778 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:30.090596 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c4e2c-e1ed-4d13-9e76-2eb4dcb28778 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:30.173642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c4e2c-e1ed-4d13-9e76-2eb4dcb28778 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:30.175316 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c4e2c-e1ed-4d13-9e76-2eb4dcb28778 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:30.284724 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 623/1255] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:51:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:51:30.291867 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772bbe2-ebd4-4d0e-960a-59267e45cd1d None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:30.410850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772bbe2-ebd4-4d0e-960a-59267e45cd1d None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:30.452209 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873f516-96c6-46cc-99dc-7f39ee8bece7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:30.453026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873f516-96c6-46cc-99dc-7f39ee8bece7 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:30.453313 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873f516-96c6-46cc-99dc-7f39ee8bece7 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:30.453588 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873f516-96c6-46cc-99dc-7f39ee8bece7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:30.464851 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873f516-96c6-46cc-99dc-7f39ee8bece7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:30.466350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873f516-96c6-46cc-99dc-7f39ee8bece7 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:30.485771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-c873f516-96c6-46cc-99dc-7f39ee8bece7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:30.485771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:30.485771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:30.485771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:30.485771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:30.485771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:30.485771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:30.485771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:30.485771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:30.485771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:30.485771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:30.485771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:30.485771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:51:30.485771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:51:30.485771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:51:30.486964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:51:30.486964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:30.486964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:30.486964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:30.486964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:30.486964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:30.486964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:30.486964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:30.486964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:51:30.486964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:30.486964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:30.486964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:30.486964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:30.486964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:30.486964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:30.486964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:30.486964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:30.487962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:51:30.487962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:51:30.487962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:30.487962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:30.487962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 633/1256] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:30.493011 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c4e2c-e1ed-4d13-9e76-2eb4dcb28778 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:30.609934 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c4e2c-e1ed-4d13-9e76-2eb4dcb28778 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:30.651809 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd7809-65d5-4d35-995f-3f4ab9687d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:30.652488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd7809-65d5-4d35-995f-3f4ab9687d1a None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:30.652768 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd7809-65d5-4d35-995f-3f4ab9687d1a None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:30.653041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd7809-65d5-4d35-995f-3f4ab9687d1a None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:30.653796 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd7809-65d5-4d35-995f-3f4ab9687d1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:30.654102 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd7809-65d5-4d35-995f-3f4ab9687d1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:30.655729 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd7809-65d5-4d35-995f-3f4ab9687d1a None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:30.671053 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 624/1257] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:30.677535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873f516-96c6-46cc-99dc-7f39ee8bece7 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:30.797264 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873f516-96c6-46cc-99dc-7f39ee8bece7 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:30.834454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8199af-4d5e-4d95-9eba-a7383c2578ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:30.835272 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8199af-4d5e-4d95-9eba-a7383c2578ec None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:30.835554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8199af-4d5e-4d95-9eba-a7383c2578ec None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:30.835827 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8199af-4d5e-4d95-9eba-a7383c2578ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:30.843720 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8199af-4d5e-4d95-9eba-a7383c2578ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:30.845195 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8199af-4d5e-4d95-9eba-a7383c2578ec None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:30.860632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-7f8199af-4d5e-4d95-9eba-a7383c2578ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:51:30.860632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:30.860632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:30.860632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:30.860632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:30.860632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:30.860632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:30.860632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:30.860632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:30.860632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:30.860632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:30.860632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:30.860632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:51:30.860632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:51:30.860632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:51:30.862249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:51:30.862249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:30.862249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:30.862249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:30.862249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:30.862249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:30.862249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:30.862249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:30.862249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:51:30.862249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:30.862249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:30.862249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:30.862249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:30.862249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:30.862249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:30.862249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:30.862249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:30.863905 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:51:30.863905 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:51:30.863905 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:51:30.863905 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:51:30.863905 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:51:30.863905 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:51:30.863905 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:51:30.863905 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:30.863905 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 634/1258] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:51:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:30.869491 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd7809-65d5-4d35-995f-3f4ab9687d1a None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:30.983819 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd7809-65d5-4d35-995f-3f4ab9687d1a None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:31.023724 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b4661-82b9-4880-b86e-1f91813fcc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:31.024401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b4661-82b9-4880-b86e-1f91813fcc70 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:31.025334 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b4661-82b9-4880-b86e-1f91813fcc70 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:31.025807 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b4661-82b9-4880-b86e-1f91813fcc70 None admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:31.026857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b4661-82b9-4880-b86e-1f91813fcc70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:31.027166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b4661-82b9-4880-b86e-1f91813fcc70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:31.028654 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b4661-82b9-4880-b86e-1f91813fcc70 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:31.042373 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 625/1259] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:51:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:31.048577 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8199af-4d5e-4d95-9eba-a7383c2578ec None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:31.156342 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8199af-4d5e-4d95-9eba-a7383c2578ec None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:31.191758 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab909f8-1ad8-401b-9d74-7469c7825801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:31.192557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab909f8-1ad8-401b-9d74-7469c7825801 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:31.192892 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab909f8-1ad8-401b-9d74-7469c7825801 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:31.193189 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab909f8-1ad8-401b-9d74-7469c7825801 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:31.194172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab909f8-1ad8-401b-9d74-7469c7825801 None admin] RBAC: Adding query filter params (role.id=17e40821fc444dd0b040dcfce3eb222b, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=4859a69a988a4b10b67187553d829b4f) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:31.194521 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab909f8-1ad8-401b-9d74-7469c7825801 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:31.195969 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab909f8-1ad8-401b-9d74-7469c7825801 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:31.202633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 635/1260] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:51:31 2022] GET /identity/v3/role_assignments?user.id=4859a69a988a4b10b67187553d829b4f&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=17e40821fc444dd0b040dcfce3eb222b => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:51:33.537200 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5a116-d0b5-4be0-bd86-9b049acbbfe6 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:33.537780 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5a116-d0b5-4be0-bd86-9b049acbbfe6 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:33.537780 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5a116-d0b5-4be0-bd86-9b049acbbfe6 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:33.539284 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 626/1261] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:51:33.545995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c045c-b554-41c3-a9c2-7678af15b2c3 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:33.546614 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c045c-b554-41c3-a9c2-7678af15b2c3 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:33.546614 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c045c-b554-41c3-a9c2-7678af15b2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:33.563821 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-bb5c045c-b554-41c3-a9c2-7678af15b2c3 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:33.565006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-bb5c045c-b554-41c3-a9c2-7678af15b2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:33.635566 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 636/1262] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:51:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:51:33.659662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5a116-d0b5-4be0-bd86-9b049acbbfe6 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:33.769322 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5a116-d0b5-4be0-bd86-9b049acbbfe6 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:33.804209 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6774237-a5c1-4a47-930e-c3459a846361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:33.804916 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6774237-a5c1-4a47-930e-c3459a846361 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:33.805194 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6774237-a5c1-4a47-930e-c3459a846361 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:33.805465 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6774237-a5c1-4a47-930e-c3459a846361 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:33.815836 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6774237-a5c1-4a47-930e-c3459a846361 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:51:33.823494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-a6774237-a5c1-4a47-930e-c3459a846361 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:51:33.823494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:33.823494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:33.823494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:33.823494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:33.823494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:33.823494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:33.823494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:33.823494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:33.823494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:33.823494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:33.823494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:33.823494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:51:33.823494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:51:33.823494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:51:33.823494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:51:33.824658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:51:33.824658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:51:33.824658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:51:33.824658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:51:33.824658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:33.824658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:33.824658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:33.824658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:33.824658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:33.824658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:33.824658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:33.824658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:51:33.824658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:33.824658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:33.824658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:33.824658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:33.825702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:33.825702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:33.825702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:33.825702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:33.825702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:51:33.825702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:51:33.825702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:51:33.825702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:51:33.825702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:51:33.825702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:51:33.825702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:51:33.825702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:51:33.825702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 627/1263] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:51:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:33.830769 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c045c-b554-41c3-a9c2-7678af15b2c3 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:33.932031 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c045c-b554-41c3-a9c2-7678af15b2c3 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:33.970847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de21a2-102f-4378-bb99-4f74181875b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:33.971540 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de21a2-102f-4378-bb99-4f74181875b1 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:33.971826 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de21a2-102f-4378-bb99-4f74181875b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:33.972107 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de21a2-102f-4378-bb99-4f74181875b1 None admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:33.972867 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de21a2-102f-4378-bb99-4f74181875b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:33.973178 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de21a2-102f-4378-bb99-4f74181875b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:33.974587 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de21a2-102f-4378-bb99-4f74181875b1 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:33.983580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 637/1264] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:51:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:33.989900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6774237-a5c1-4a47-930e-c3459a846361 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:34.093037 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6774237-a5c1-4a47-930e-c3459a846361 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:34.129970 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adec35c-4e8e-44b2-929e-d9d35fa146bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:34.130799 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adec35c-4e8e-44b2-929e-d9d35fa146bc None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:34.131079 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adec35c-4e8e-44b2-929e-d9d35fa146bc None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:34.131351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adec35c-4e8e-44b2-929e-d9d35fa146bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:34.143817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adec35c-4e8e-44b2-929e-d9d35fa146bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:34.145283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adec35c-4e8e-44b2-929e-d9d35fa146bc None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:34.163477 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-8adec35c-4e8e-44b2-929e-d9d35fa146bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:34.163477 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:34.163477 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:34.163477 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:34.163477 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:34.163477 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:34.163477 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:34.163477 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:34.163477 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:34.163477 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:34.163477 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:34.163477 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:34.163477 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:51:34.163477 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:51:34.163477 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:51:34.164562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:51:34.164562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:34.164562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:34.164562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:34.164562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:34.164562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:34.164562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:34.164562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:34.164562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:51:34.164562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:34.164562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:34.164562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:34.164562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:34.164562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:34.164562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:34.164562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:34.164562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:34.166340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:51:34.166340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:51:34.166340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:34.166340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:51:34.166340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 628/1265] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:51:34.171059 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de21a2-102f-4378-bb99-4f74181875b1 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:34.276898 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de21a2-102f-4378-bb99-4f74181875b1 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:34.313439 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319372dd-4eee-46d5-bb28-328477412d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:34.314110 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319372dd-4eee-46d5-bb28-328477412d9d None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:34.314429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319372dd-4eee-46d5-bb28-328477412d9d None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:34.314707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319372dd-4eee-46d5-bb28-328477412d9d None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:34.315437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319372dd-4eee-46d5-bb28-328477412d9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:34.315738 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319372dd-4eee-46d5-bb28-328477412d9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:34.317119 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319372dd-4eee-46d5-bb28-328477412d9d None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:34.338265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 638/1266] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:34.340027 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adec35c-4e8e-44b2-929e-d9d35fa146bc None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:34.451356 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adec35c-4e8e-44b2-929e-d9d35fa146bc None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:34.484373 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56797035-9852-4bcf-96a7-6dc2972176cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:34.485455 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56797035-9852-4bcf-96a7-6dc2972176cc None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:34.485735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56797035-9852-4bcf-96a7-6dc2972176cc None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:34.486008 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56797035-9852-4bcf-96a7-6dc2972176cc None admin] PATH_INFO: `/v3/users/placement` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:34.494097 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56797035-9852-4bcf-96a7-6dc2972176cc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:34.495608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56797035-9852-4bcf-96a7-6dc2972176cc None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:34.511122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-56797035-9852-4bcf-96a7-6dc2972176cc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 13:51:34.511122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:34.511122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:34.511122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:34.511122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:34.511122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:34.511122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:34.511122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:34.511122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:34.511122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:34.511122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:34.511122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:34.511122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:51:34.511122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:51:34.511122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:51:34.511122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:51:34.512925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:34.512925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:34.512925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:51:34.512925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:51:34.512925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:51:34.512925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:51:34.512925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:34.512925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:34.512925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:34.512925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:34.512925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:34.512925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:51:34.512925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:34.512925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:34.512925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:34.512925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:34.512925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:34.512925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:34.514834 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:34.514834 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:34.514834 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:51:34.514834 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:51:34.514834 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:51:34.514834 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:51:34.514834 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:51:34.514834 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:51:34.514834 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 13:51:34.514834 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:51:34.514834 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 629/1267] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:51:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:34.520682 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319372dd-4eee-46d5-bb28-328477412d9d None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:34.620795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319372dd-4eee-46d5-bb28-328477412d9d None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:34.655151 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c0e66-852a-439f-bff8-7457cd085d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:34.655818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c0e66-852a-439f-bff8-7457cd085d7e None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:34.656102 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c0e66-852a-439f-bff8-7457cd085d7e None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:34.656378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c0e66-852a-439f-bff8-7457cd085d7e None admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:34.657223 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c0e66-852a-439f-bff8-7457cd085d7e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:34.657530 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c0e66-852a-439f-bff8-7457cd085d7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:34.658990 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c0e66-852a-439f-bff8-7457cd085d7e None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:34.677277 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 639/1268] 10.222.0.32 () {56 vars in 1143 bytes} [Tue May 10 13:51:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:34.683528 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56797035-9852-4bcf-96a7-6dc2972176cc None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:34.787144 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56797035-9852-4bcf-96a7-6dc2972176cc None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:34.820412 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94293ae1-b072-4d6d-8db3-049706c228cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:34.821207 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94293ae1-b072-4d6d-8db3-049706c228cb None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:34.821606 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94293ae1-b072-4d6d-8db3-049706c228cb None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:34.821774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94293ae1-b072-4d6d-8db3-049706c228cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:34.832723 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94293ae1-b072-4d6d-8db3-049706c228cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:34.834187 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94293ae1-b072-4d6d-8db3-049706c228cb None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:34.851220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-94293ae1-b072-4d6d-8db3-049706c228cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:34.851220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:34.851220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:34.851220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:34.851220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:34.851220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:34.851220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:34.851220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:34.851220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:34.851220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:34.851220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:34.851220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:34.851220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:51:34.851220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:51:34.851220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:51:34.852330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:51:34.852330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:34.852330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:34.852330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:34.852330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:34.852330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:34.852330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:34.852330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:34.852330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:51:34.852330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:34.852330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:34.852330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:34.852330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:34.852330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:34.852330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:34.852330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:34.852330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:34.854099 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:51:34.854099 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:51:34.854099 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:34.854099 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:51:34.854099 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 630/1269] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:34.859138 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c0e66-852a-439f-bff8-7457cd085d7e None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:34.957264 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c0e66-852a-439f-bff8-7457cd085d7e None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:34.990534 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052a32f-1a23-401d-82f2-f90d70c62565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:34.991200 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052a32f-1a23-401d-82f2-f90d70c62565 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:34.991483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052a32f-1a23-401d-82f2-f90d70c62565 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:34.991757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052a32f-1a23-401d-82f2-f90d70c62565 None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:34.992482 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052a32f-1a23-401d-82f2-f90d70c62565 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:34.992788 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052a32f-1a23-401d-82f2-f90d70c62565 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:34.994786 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052a32f-1a23-401d-82f2-f90d70c62565 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:35.006277 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 640/1270] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:35.011864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94293ae1-b072-4d6d-8db3-049706c228cb None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:35.116077 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94293ae1-b072-4d6d-8db3-049706c228cb None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:35.152976 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f7b82-b2a9-44fe-948d-6bb7274aa863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:35.153786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f7b82-b2a9-44fe-948d-6bb7274aa863 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:35.154070 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f7b82-b2a9-44fe-948d-6bb7274aa863 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:35.154377 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f7b82-b2a9-44fe-948d-6bb7274aa863 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:35.161771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f7b82-b2a9-44fe-948d-6bb7274aa863 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:35.163264 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f7b82-b2a9-44fe-948d-6bb7274aa863 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:35.178371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-dc9f7b82-b2a9-44fe-948d-6bb7274aa863 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:51:35.178371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:35.178371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:35.178371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:35.178371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:35.178371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:35.178371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:35.178371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:35.178371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:35.178371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:35.178371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:35.178371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:35.178371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:51:35.178371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:51:35.178371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:51:35.180173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:51:35.180173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:35.180173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:35.180173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:35.180173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:35.180173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:35.180173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:35.180173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:35.180173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:51:35.180173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:35.180173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:35.180173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:35.180173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:35.180173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:35.180173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:35.180173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:35.180173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:35.182328 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:51:35.182328 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:51:35.182328 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:51:35.182328 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:51:35.182328 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:51:35.182328 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:51:35.182328 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:51:35.182328 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:51:35.182328 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 631/1271] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:51:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:35.187118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052a32f-1a23-401d-82f2-f90d70c62565 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:35.292448 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052a32f-1a23-401d-82f2-f90d70c62565 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:35.326262 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99a762-0d90-4aab-95c0-c9c1d2537075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:35.326927 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99a762-0d90-4aab-95c0-c9c1d2537075 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:35.327209 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99a762-0d90-4aab-95c0-c9c1d2537075 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:35.327486 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99a762-0d90-4aab-95c0-c9c1d2537075 None admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:35.328350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99a762-0d90-4aab-95c0-c9c1d2537075 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:35.328662 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99a762-0d90-4aab-95c0-c9c1d2537075 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:35.330121 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99a762-0d90-4aab-95c0-c9c1d2537075 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:35.344142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 641/1272] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:51:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:35.350011 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f7b82-b2a9-44fe-948d-6bb7274aa863 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:35.453562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f7b82-b2a9-44fe-948d-6bb7274aa863 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:35.489583 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54932f0d-34ec-496c-87a1-783381202b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:35.490501 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54932f0d-34ec-496c-87a1-783381202b22 None admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:35.490785 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54932f0d-34ec-496c-87a1-783381202b22 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:35.491063 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54932f0d-34ec-496c-87a1-783381202b22 None admin] PATH_INFO: `/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/4859a69a988a4b10b67187553d829b4f/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:35.493061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54932f0d-34ec-496c-87a1-783381202b22 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1cda14bca5c497dba2d18685dfe6cc2, user_id=4859a69a988a4b10b67187553d829b4f, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:35.495428 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54932f0d-34ec-496c-87a1-783381202b22 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:35.510346 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 632/1273] 10.222.0.32 () {58 vars in 1439 bytes} [Tue May 10 13:51:35 2022] PUT /identity/v3/projects/d1cda14bca5c497dba2d18685dfe6cc2/users/4859a69a988a4b10b67187553d829b4f/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:51:37.763529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a66841-7445-42a2-91aa-440075a12499 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:37.764067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a66841-7445-42a2-91aa-440075a12499 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:37.764067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a66841-7445-42a2-91aa-440075a12499 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:37.765423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 642/1274] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:51:37.770788 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d2d0d-9efc-4819-90f6-0c083fe2d14f None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:37.771217 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d2d0d-9efc-4819-90f6-0c083fe2d14f None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:37.771331 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d2d0d-9efc-4819-90f6-0c083fe2d14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:37.788157 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-481d2d0d-9efc-4819-90f6-0c083fe2d14f None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:37.789342 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-481d2d0d-9efc-4819-90f6-0c083fe2d14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:37.860638 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 633/1275] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:51:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:51:37.884238 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a66841-7445-42a2-91aa-440075a12499 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:37.981914 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a66841-7445-42a2-91aa-440075a12499 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:38.015153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25213ca0-c760-4d7b-aea4-2f3e693f0522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:38.015869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25213ca0-c760-4d7b-aea4-2f3e693f0522 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:38.016147 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25213ca0-c760-4d7b-aea4-2f3e693f0522 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:38.016418 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25213ca0-c760-4d7b-aea4-2f3e693f0522 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:38.026945 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25213ca0-c760-4d7b-aea4-2f3e693f0522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:51:38.034392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-25213ca0-c760-4d7b-aea4-2f3e693f0522 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:51:38.034392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:38.034392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:38.034392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:38.034392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:38.034392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:38.034392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:38.034392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:38.034392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:38.034392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:38.034392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:38.034392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:38.034392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:51:38.034392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:51:38.034392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:51:38.034392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:51:38.035447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:51:38.035447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:51:38.035447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:51:38.035447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:51:38.035447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:38.035447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:38.035447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:38.035447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:38.035447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:38.035447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:38.035447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:38.035447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:51:38.035447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:38.035447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:38.035447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:38.035447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:38.036506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:38.036506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:38.036506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:38.036506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:38.036506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:51:38.036506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:51:38.036506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:51:38.036506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:51:38.036506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:51:38.036506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:51:38.036506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:51:38.036506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:38.036506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 643/1276] 10.222.0.32 () {56 vars in 1096 bytes} [Tue May 10 13:51:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:38.042746 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d2d0d-9efc-4819-90f6-0c083fe2d14f None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:38.142298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d2d0d-9efc-4819-90f6-0c083fe2d14f None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:38.175815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabada1f-c46f-4d70-a721-198404e03eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:38.176488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabada1f-c46f-4d70-a721-198404e03eb7 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:38.176771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabada1f-c46f-4d70-a721-198404e03eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:38.177045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabada1f-c46f-4d70-a721-198404e03eb7 None admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:38.177800 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabada1f-c46f-4d70-a721-198404e03eb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:38.178105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabada1f-c46f-4d70-a721-198404e03eb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:38.179546 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabada1f-c46f-4d70-a721-198404e03eb7 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:38.188682 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 634/1277] 10.222.0.32 () {56 vars in 1099 bytes} [Tue May 10 13:51:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:38.194436 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25213ca0-c760-4d7b-aea4-2f3e693f0522 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:38.298586 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25213ca0-c760-4d7b-aea4-2f3e693f0522 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:38.337658 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd72566-b8ce-4635-9217-bfce0bce6342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:38.338793 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd72566-b8ce-4635-9217-bfce0bce6342 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:38.339074 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd72566-b8ce-4635-9217-bfce0bce6342 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:38.339487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd72566-b8ce-4635-9217-bfce0bce6342 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:38.357021 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd72566-b8ce-4635-9217-bfce0bce6342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:38.359255 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd72566-b8ce-4635-9217-bfce0bce6342 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:38.382127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-4cd72566-b8ce-4635-9217-bfce0bce6342 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:38.382127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:38.382127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:38.382127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:38.382127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:38.382127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:38.382127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:38.382127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:38.382127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:38.382127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:38.382127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:38.382127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:38.382127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:51:38.382127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:51:38.382127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:51:38.383295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:51:38.383295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:38.383295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:38.383295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:38.383295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:38.383295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:38.383295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:38.383295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:38.383295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:51:38.383295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:38.383295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:38.383295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:38.383295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:38.383295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:38.383295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:38.383295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:38.383295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:38.384376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:51:38.384376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:51:38.384376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:38.384376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:38.384376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 644/1278] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:38.390800 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabada1f-c46f-4d70-a721-198404e03eb7 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:38.500470 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabada1f-c46f-4d70-a721-198404e03eb7 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:38.534298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbdcf3-160d-40df-9f81-d76804d73cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:38.534958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbdcf3-160d-40df-9f81-d76804d73cf1 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:38.535239 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbdcf3-160d-40df-9f81-d76804d73cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:38.535511 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbdcf3-160d-40df-9f81-d76804d73cf1 None admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:38.536235 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbdcf3-160d-40df-9f81-d76804d73cf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:38.536533 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbdcf3-160d-40df-9f81-d76804d73cf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:38.537897 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbdcf3-160d-40df-9f81-d76804d73cf1 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:38.549617 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 635/1279] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:38.555352 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd72566-b8ce-4635-9217-bfce0bce6342 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:38.652625 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd72566-b8ce-4635-9217-bfce0bce6342 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:38.685815 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f6261-5974-4fef-9342-76e0102d3cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:38.686813 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f6261-5974-4fef-9342-76e0102d3cc2 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:38.686954 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f6261-5974-4fef-9342-76e0102d3cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:38.687198 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f6261-5974-4fef-9342-76e0102d3cc2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:38.695567 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f6261-5974-4fef-9342-76e0102d3cc2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:38.697546 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f6261-5974-4fef-9342-76e0102d3cc2 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:38.713633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-004f6261-5974-4fef-9342-76e0102d3cc2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 13:51:38.713633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:38.713633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:38.713633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:38.713633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:38.713633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:38.713633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:38.713633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:38.713633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:38.713633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:38.713633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:38.713633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:38.713633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:51:38.713633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:51:38.713633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:51:38.713633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:51:38.715526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:38.715526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:38.715526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:51:38.715526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:51:38.715526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:51:38.715526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:51:38.715526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:38.715526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:38.715526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:38.715526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:38.715526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:38.715526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:51:38.715526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:38.715526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:38.715526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:38.715526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:38.715526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:38.715526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:38.717328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:38.717328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:38.717328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:51:38.717328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:51:38.717328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:51:38.717328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:51:38.717328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:51:38.717328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:51:38.717328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 13:51:38.717328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:38.717328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 645/1280] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:51:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:38.721000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbdcf3-160d-40df-9f81-d76804d73cf1 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:38.842477 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbdcf3-160d-40df-9f81-d76804d73cf1 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:38.878516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712574b-6b28-45eb-9f37-211ea2d2513f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:38.879196 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712574b-6b28-45eb-9f37-211ea2d2513f None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:38.879476 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712574b-6b28-45eb-9f37-211ea2d2513f None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:38.879748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712574b-6b28-45eb-9f37-211ea2d2513f None admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:38.880649 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712574b-6b28-45eb-9f37-211ea2d2513f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:38.881087 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712574b-6b28-45eb-9f37-211ea2d2513f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:38.882851 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712574b-6b28-45eb-9f37-211ea2d2513f None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:38.901569 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 636/1281] 10.222.0.32 () {56 vars in 1143 bytes} [Tue May 10 13:51:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:38.907633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f6261-5974-4fef-9342-76e0102d3cc2 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:39.010805 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f6261-5974-4fef-9342-76e0102d3cc2 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:39.042694 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677e116-bdd9-4cdc-a2af-46c7addd4ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:39.043341 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677e116-bdd9-4cdc-a2af-46c7addd4ea0 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:39.043625 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677e116-bdd9-4cdc-a2af-46c7addd4ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:39.043902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677e116-bdd9-4cdc-a2af-46c7addd4ea0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:39.110251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677e116-bdd9-4cdc-a2af-46c7addd4ea0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:39.111632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677e116-bdd9-4cdc-a2af-46c7addd4ea0 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:39.208954 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 646/1282] 10.222.0.32 () {58 vars in 1282 bytes} [Tue May 10 13:51:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:51:39.214851 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712574b-6b28-45eb-9f37-211ea2d2513f None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:39.311628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712574b-6b28-45eb-9f37-211ea2d2513f None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:39.353786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81f88c-8216-46d0-877f-ced9c2089e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:39.354589 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81f88c-8216-46d0-877f-ced9c2089e47 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:39.354865 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81f88c-8216-46d0-877f-ced9c2089e47 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:39.355190 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81f88c-8216-46d0-877f-ced9c2089e47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:39.365285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81f88c-8216-46d0-877f-ced9c2089e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:39.366786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81f88c-8216-46d0-877f-ced9c2089e47 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:39.384138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-aa81f88c-8216-46d0-877f-ced9c2089e47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:39.384138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:39.384138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:39.384138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:39.384138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:39.384138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:39.384138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:39.384138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:39.384138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:39.384138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:39.384138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:39.384138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:39.384138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:51:39.384138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:51:39.384138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:51:39.385283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:51:39.385283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:39.385283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:39.385283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:39.385283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:39.385283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:39.385283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:39.385283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:39.385283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:51:39.385283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:39.385283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:39.385283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:39.385283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:39.385283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:39.385283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:39.385283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:39.385283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:39.386258 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:51:39.386258 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:51:39.386258 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:51:39.386258 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:51:39.386258 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 637/1283] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:39.391139 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677e116-bdd9-4cdc-a2af-46c7addd4ea0 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:39.485649 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677e116-bdd9-4cdc-a2af-46c7addd4ea0 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:39.518878 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc9ff2-12a1-4e3a-a503-98580eb2cc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:39.519548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc9ff2-12a1-4e3a-a503-98580eb2cc79 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:39.519825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc9ff2-12a1-4e3a-a503-98580eb2cc79 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:39.520095 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc9ff2-12a1-4e3a-a503-98580eb2cc79 None admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:39.520822 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc9ff2-12a1-4e3a-a503-98580eb2cc79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:39.521139 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc9ff2-12a1-4e3a-a503-98580eb2cc79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:39.522530 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc9ff2-12a1-4e3a-a503-98580eb2cc79 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:39.534754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 647/1284] 10.222.0.32 () {56 vars in 1109 bytes} [Tue May 10 13:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:39.541145 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81f88c-8216-46d0-877f-ced9c2089e47 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:39.636336 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81f88c-8216-46d0-877f-ced9c2089e47 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:39.678248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1d358-41f5-42dc-9a08-9f403225ab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:39.679253 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1d358-41f5-42dc-9a08-9f403225ab04 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:39.679623 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1d358-41f5-42dc-9a08-9f403225ab04 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:39.679953 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1d358-41f5-42dc-9a08-9f403225ab04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:39.688239 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1d358-41f5-42dc-9a08-9f403225ab04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:39.689710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1d358-41f5-42dc-9a08-9f403225ab04 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:39.703644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application [None req-ecf1d358-41f5-42dc-9a08-9f403225ab04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:51:39.703644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:39.703644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:39.703644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:39.703644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:39.703644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:39.703644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:39.703644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:39.703644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:39.703644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:39.703644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:39.703644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:39.703644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:51:39.703644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:51:39.703644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:51:39.704813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:51:39.704813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:39.704813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:39.704813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:39.704813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:39.704813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:39.704813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:39.704813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:39.704813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application with Lock( May 10 13:51:39.704813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:39.704813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:39.704813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:39.704813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:39.704813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:39.704813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:39.704813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:39.704813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:39.705911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:51:39.705911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:51:39.705911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:51:39.705911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:51:39.705911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:51:39.705911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:51:39.705911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:51:39.705911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: ERROR keystone.server.flask.application May 10 13:51:39.705911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 638/1285] 10.222.0.32 () {56 vars in 1111 bytes} [Tue May 10 13:51:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:39.710803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc9ff2-12a1-4e3a-a503-98580eb2cc79 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:39.819163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc9ff2-12a1-4e3a-a503-98580eb2cc79 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:39.856207 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9758299-6400-4de0-9255-b33cbf3f29f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:39.856893 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9758299-6400-4de0-9255-b33cbf3f29f5 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:39.857173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9758299-6400-4de0-9255-b33cbf3f29f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:39.857447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9758299-6400-4de0-9255-b33cbf3f29f5 None admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:39.858280 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9758299-6400-4de0-9255-b33cbf3f29f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:39.859064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9758299-6400-4de0-9255-b33cbf3f29f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:39.860282 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9758299-6400-4de0-9255-b33cbf3f29f5 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:39.873884 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 648/1286] 10.222.0.32 () {56 vars in 1148 bytes} [Tue May 10 13:51:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:39.880280 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1d358-41f5-42dc-9a08-9f403225ab04 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:39.985001 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1d358-41f5-42dc-9a08-9f403225ab04 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:40.020190 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95234611-aea9-409e-8d9c-b7fa5c8fff40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:40.020857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95234611-aea9-409e-8d9c-b7fa5c8fff40 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:40.021140 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95234611-aea9-409e-8d9c-b7fa5c8fff40 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:40.021408 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95234611-aea9-409e-8d9c-b7fa5c8fff40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:40.022264 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95234611-aea9-409e-8d9c-b7fa5c8fff40 None admin] RBAC: Adding query filter params (role.id=17e40821fc444dd0b040dcfce3eb222b, scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2, user.id=4859a69a988a4b10b67187553d829b4f) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:40.022574 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95234611-aea9-409e-8d9c-b7fa5c8fff40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:40.024009 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95234611-aea9-409e-8d9c-b7fa5c8fff40 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:40.030614 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 639/1287] 10.222.0.32 () {56 vars in 1374 bytes} [Tue May 10 13:51:39 2022] GET /identity/v3/role_assignments?user.id=4859a69a988a4b10b67187553d829b4f&scope.project.id=d1cda14bca5c497dba2d18685dfe6cc2&role.id=17e40821fc444dd0b040dcfce3eb222b => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:42.338650 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1502066-1427-471a-8497-eda23f5b47ed None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:42.339156 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1502066-1427-471a-8497-eda23f5b47ed None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:42.339156 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1502066-1427-471a-8497-eda23f5b47ed None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:42.340592 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 649/1288] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:51:42.346319 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5d3c4-6f4e-4d5d-9fa1-e61f01e4070d None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:42.346885 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5d3c4-6f4e-4d5d-9fa1-e61f01e4070d None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:42.346885 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5d3c4-6f4e-4d5d-9fa1-e61f01e4070d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:42.365903 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-5ba5d3c4-6f4e-4d5d-9fa1-e61f01e4070d None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:42.367367 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-5ba5d3c4-6f4e-4d5d-9fa1-e61f01e4070d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:42.449802 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 640/1289] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:51:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:51:42.483651 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1502066-1427-471a-8497-eda23f5b47ed None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:42.591579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1502066-1427-471a-8497-eda23f5b47ed None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:42.629011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2966be-124a-4a1b-ae4c-5f7a3bf27d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:42.629811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2966be-124a-4a1b-ae4c-5f7a3bf27d17 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:42.630095 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2966be-124a-4a1b-ae4c-5f7a3bf27d17 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:42.630403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2966be-124a-4a1b-ae4c-5f7a3bf27d17 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:42.631064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2966be-124a-4a1b-ae4c-5f7a3bf27d17 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:42.632439 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2966be-124a-4a1b-ae4c-5f7a3bf27d17 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:42.645100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-bc2966be-124a-4a1b-ae4c-5f7a3bf27d17 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 13:51:42.645100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:42.645100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:51:42.645100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:51:42.645100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:51:42.645100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:51:42.645100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:51:42.645100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:51:42.645100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 13:51:42.645100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:42.645100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:51:42.645100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:42.645100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:42.645100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:42.645100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:42.645100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:42.645100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:42.646488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:42.646488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:42.646488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:42.646488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:42.646488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:42.646488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:42.646488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:51:42.646488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:51:42.646488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:51:42.646488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:51:42.646488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:42.646488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:42.646488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:42.646488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:42.646488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:42.646488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:42.647626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:42.647626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:51:42.647626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:42.647626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:42.647626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:42.647626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:42.647626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:42.647626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:42.647626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:42.647626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:42.647626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:51:42.647626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:51:42.647626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 13:51:42.647626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:42.647626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 650/1290] 10.222.0.32 () {56 vars in 1117 bytes} [Tue May 10 13:51:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:42.654869 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5d3c4-6f4e-4d5d-9fa1-e61f01e4070d None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:42.758432 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5d3c4-6f4e-4d5d-9fa1-e61f01e4070d None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:42.806826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26744be0-82f4-4d6a-9c45-14ac417cd424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:42.807522 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26744be0-82f4-4d6a-9c45-14ac417cd424 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:42.807805 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26744be0-82f4-4d6a-9c45-14ac417cd424 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:42.808079 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26744be0-82f4-4d6a-9c45-14ac417cd424 None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:42.808819 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26744be0-82f4-4d6a-9c45-14ac417cd424 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:42.809123 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26744be0-82f4-4d6a-9c45-14ac417cd424 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:42.810571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26744be0-82f4-4d6a-9c45-14ac417cd424 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:42.816823 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 641/1291] 10.222.0.32 () {56 vars in 1116 bytes} [Tue May 10 13:51:42 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:42.826998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2966be-124a-4a1b-ae4c-5f7a3bf27d17 None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:42.955124 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2966be-124a-4a1b-ae4c-5f7a3bf27d17 None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:42.989481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65576da4-1610-4727-ae97-b99695e10907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:42.990156 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65576da4-1610-4727-ae97-b99695e10907 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:42.990462 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65576da4-1610-4727-ae97-b99695e10907 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:42.990734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65576da4-1610-4727-ae97-b99695e10907 None admin] PATH_INFO: `/v3/services` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:42.991443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65576da4-1610-4727-ae97-b99695e10907 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:42.991746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65576da4-1610-4727-ae97-b99695e10907 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:42.993195 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65576da4-1610-4727-ae97-b99695e10907 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:42.998754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 651/1292] 10.222.0.32 () {56 vars in 1116 bytes} [Tue May 10 13:51:42 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:45.321162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5bcec-e04f-4744-878a-6ef9951a7666 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:45.322270 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5bcec-e04f-4744-878a-6ef9951a7666 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:45.322270 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5bcec-e04f-4744-878a-6ef9951a7666 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:45.323165 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 642/1293] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:51:45.331008 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cb8c6-e1a2-442d-a174-9dfc337e0964 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:45.331904 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cb8c6-e1a2-442d-a174-9dfc337e0964 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:45.331904 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cb8c6-e1a2-442d-a174-9dfc337e0964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:45.352127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-b98cb8c6-e1a2-442d-a174-9dfc337e0964 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:45.354096 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-b98cb8c6-e1a2-442d-a174-9dfc337e0964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:45.442421 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 652/1294] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:51:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:51:45.465209 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5bcec-e04f-4744-878a-6ef9951a7666 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:45.604575 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5bcec-e04f-4744-878a-6ef9951a7666 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:45.660008 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae6a41-2807-403e-ab8f-b056d0161f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:45.664774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae6a41-2807-403e-ab8f-b056d0161f7b None admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:45.667173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae6a41-2807-403e-ab8f-b056d0161f7b None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:45.667665 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae6a41-2807-403e-ab8f-b056d0161f7b None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:45.669029 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae6a41-2807-403e-ab8f-b056d0161f7b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:45.671419 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae6a41-2807-403e-ab8f-b056d0161f7b None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:45.687538 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 643/1295] 10.222.0.32 () {60 vars in 1141 bytes} [Tue May 10 13:51:45 2022] POST /identity/v3/services => generated 246 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:51:48.046727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d559ed-9c78-4e77-bad6-434a2ed4a5c4 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:48.047308 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d559ed-9c78-4e77-bad6-434a2ed4a5c4 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:48.047308 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d559ed-9c78-4e77-bad6-434a2ed4a5c4 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:48.048626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 653/1296] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:51:48.054224 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c617b-17b4-4264-8e3e-da1c456950f3 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:48.054671 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c617b-17b4-4264-8e3e-da1c456950f3 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:48.054856 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c617b-17b4-4264-8e3e-da1c456950f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:48.072103 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-558c617b-17b4-4264-8e3e-da1c456950f3 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:48.073309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-558c617b-17b4-4264-8e3e-da1c456950f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:48.167033 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 644/1297] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:51:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:51:48.191211 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d559ed-9c78-4e77-bad6-434a2ed4a5c4 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:48.317929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d559ed-9c78-4e77-bad6-434a2ed4a5c4 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:48.357700 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a6ef1-c118-4f01-a98a-bc79b40ed81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:48.358525 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a6ef1-c118-4f01-a98a-bc79b40ed81a None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:48.358810 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a6ef1-c118-4f01-a98a-bc79b40ed81a None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:48.359081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a6ef1-c118-4f01-a98a-bc79b40ed81a None admin] PATH_INFO: `/v3/services/placement` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:48.359736 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a6ef1-c118-4f01-a98a-bc79b40ed81a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:48.361361 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a6ef1-c118-4f01-a98a-bc79b40ed81a None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:48.373825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-a76a6ef1-c118-4f01-a98a-bc79b40ed81a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 13:51:48.373825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:48.373825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:51:48.373825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:51:48.373825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:51:48.373825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:51:48.373825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:51:48.373825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:51:48.373825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 13:51:48.373825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:48.373825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:51:48.373825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:48.373825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:48.373825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:48.373825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:48.373825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:48.373825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:48.375579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:48.375579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:48.375579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:48.375579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:48.375579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:48.375579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:48.375579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:51:48.375579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:51:48.375579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:51:48.375579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:51:48.375579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:48.375579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:48.375579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:48.375579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:48.375579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:48.375579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:48.376666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:48.376666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:51:48.376666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:48.376666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:48.376666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:48.376666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:48.376666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:48.376666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:48.376666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:48.376666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:48.376666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:51:48.376666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:51:48.376666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 13:51:48.376666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:48.376666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 654/1298] 10.222.0.32 () {56 vars in 1117 bytes} [Tue May 10 13:51:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:48.381485 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c617b-17b4-4264-8e3e-da1c456950f3 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:48.490180 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c617b-17b4-4264-8e3e-da1c456950f3 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:48.525540 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284d81a-2185-46e7-aebf-adb4bb56a3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:48.526253 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284d81a-2185-46e7-aebf-adb4bb56a3a4 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:48.526543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284d81a-2185-46e7-aebf-adb4bb56a3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:48.526816 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284d81a-2185-46e7-aebf-adb4bb56a3a4 None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:48.527544 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284d81a-2185-46e7-aebf-adb4bb56a3a4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:48.527847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284d81a-2185-46e7-aebf-adb4bb56a3a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:48.529239 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284d81a-2185-46e7-aebf-adb4bb56a3a4 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:48.535021 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 645/1299] 10.222.0.32 () {56 vars in 1116 bytes} [Tue May 10 13:51:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:48.540989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a6ef1-c118-4f01-a98a-bc79b40ed81a None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:48.652752 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a6ef1-c118-4f01-a98a-bc79b40ed81a None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:48.684770 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac019ba-0b26-443e-ba13-f202c807c617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:48.685418 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac019ba-0b26-443e-ba13-f202c807c617 None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:48.685693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac019ba-0b26-443e-ba13-f202c807c617 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:48.685959 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac019ba-0b26-443e-ba13-f202c807c617 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:48.686771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac019ba-0b26-443e-ba13-f202c807c617 None admin] RBAC: Adding query filter params (interface=public, service_id=2144e7e7a16e4798806dd0a023365a3a, region_id=RegionOne) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:48.687079 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac019ba-0b26-443e-ba13-f202c807c617 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:48.688437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac019ba-0b26-443e-ba13-f202c807c617 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:48.693200 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 655/1300] 10.222.0.32 () {56 vars in 1251 bytes} [Tue May 10 13:51:48 2022] GET /identity/v3/endpoints?service_id=2144e7e7a16e4798806dd0a023365a3a&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:48.699450 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284d81a-2185-46e7-aebf-adb4bb56a3a4 None admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:48.797506 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284d81a-2185-46e7-aebf-adb4bb56a3a4 None admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:48.830694 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69267d77-f3a7-4c4b-b24e-380d7804c7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:48.831364 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69267d77-f3a7-4c4b-b24e-380d7804c7ed None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:48.831648 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69267d77-f3a7-4c4b-b24e-380d7804c7ed None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:48.831922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69267d77-f3a7-4c4b-b24e-380d7804c7ed None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:48.832613 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69267d77-f3a7-4c4b-b24e-380d7804c7ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:48.833992 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69267d77-f3a7-4c4b-b24e-380d7804c7ed None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:48.842283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 646/1301] 10.222.0.32 () {56 vars in 1087 bytes} [Tue May 10 13:51:48 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:51:51.070675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bef2b2-2040-4b8a-9f7a-d97e978a6cfe None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:51.071299 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bef2b2-2040-4b8a-9f7a-d97e978a6cfe None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:51.071299 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bef2b2-2040-4b8a-9f7a-d97e978a6cfe None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:51.072597 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 656/1302] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:51:51.078097 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc923570-c584-4eb5-8cd7-8f43b69e0e26 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:51.078613 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc923570-c584-4eb5-8cd7-8f43b69e0e26 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:51.078711 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc923570-c584-4eb5-8cd7-8f43b69e0e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:51.095592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-dc923570-c584-4eb5-8cd7-8f43b69e0e26 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:51.096768 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-dc923570-c584-4eb5-8cd7-8f43b69e0e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:51.161086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 647/1303] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:51:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:51:51.184135 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bef2b2-2040-4b8a-9f7a-d97e978a6cfe None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:51.285452 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bef2b2-2040-4b8a-9f7a-d97e978a6cfe None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:51.317820 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17d383-7f2a-43dd-9527-059b4fe0e46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:51.318646 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17d383-7f2a-43dd-9527-059b4fe0e46c None admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:51.318928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17d383-7f2a-43dd-9527-059b4fe0e46c None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:51.319202 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17d383-7f2a-43dd-9527-059b4fe0e46c None admin] PATH_INFO: `/v3/services/placement` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:51.319892 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17d383-7f2a-43dd-9527-059b4fe0e46c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:51.321719 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17d383-7f2a-43dd-9527-059b4fe0e46c None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:51.333495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application [None req-cf17d383-7f2a-43dd-9527-059b4fe0e46c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 13:51:51.333495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:51.333495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:51:51.333495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:51:51.333495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:51:51.333495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:51:51.333495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:51:51.333495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:51:51.333495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 13:51:51.333495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:51.333495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:51:51.333495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:51.333495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:51:51.333495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:51:51.333495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:51:51.333495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:51:51.333495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:51:51.334578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:51:51.334578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:51:51.334578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:51:51.334578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:51:51.334578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:51:51.334578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:51:51.334578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:51:51.334578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:51:51.334578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:51:51.334578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:51:51.334578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:51:51.334578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:51:51.334578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:51:51.334578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:51:51.334578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:51:51.334578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:51:51.335676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:51:51.335676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application with Lock( May 10 13:51:51.335676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:51:51.335676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self._enter() May 10 13:51:51.335676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:51:51.335676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:51:51.335676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:51:51.335676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application return self.creator() May 10 13:51:51.335676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:51:51.335676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application created_value = creator( May 10 13:51:51.335676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:51:51.335676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:51:51.335676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 13:51:51.335676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: ERROR keystone.server.flask.application May 10 13:51:51.335676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 657/1304] 10.222.0.32 () {56 vars in 1117 bytes} [Tue May 10 13:51:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:51:51.341486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc923570-c584-4eb5-8cd7-8f43b69e0e26 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:51.436570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc923570-c584-4eb5-8cd7-8f43b69e0e26 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:51.469457 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702101e7-69f0-44bc-8a8d-ce2c79a88105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:51.470120 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702101e7-69f0-44bc-8a8d-ce2c79a88105 None admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:51.470429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702101e7-69f0-44bc-8a8d-ce2c79a88105 None admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:51.470703 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702101e7-69f0-44bc-8a8d-ce2c79a88105 None admin] PATH_INFO: `/v3/services` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:51.471411 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702101e7-69f0-44bc-8a8d-ce2c79a88105 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:51:51.471713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702101e7-69f0-44bc-8a8d-ce2c79a88105 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:51.473087 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702101e7-69f0-44bc-8a8d-ce2c79a88105 None admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:51.478607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 648/1305] 10.222.0.32 () {56 vars in 1116 bytes} [Tue May 10 13:51:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:51:51.484551 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17d383-7f2a-43dd-9527-059b4fe0e46c None admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:51.582394 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17d383-7f2a-43dd-9527-059b4fe0e46c None admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:51.616754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750376a5-ccf9-47b1-ae98-f0fc03f6e352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:51.617419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750376a5-ccf9-47b1-ae98-f0fc03f6e352 None admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:51.617705 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750376a5-ccf9-47b1-ae98-f0fc03f6e352 None admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:51.618602 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750376a5-ccf9-47b1-ae98-f0fc03f6e352 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:51.619927 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750376a5-ccf9-47b1-ae98-f0fc03f6e352 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:51.621297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750376a5-ccf9-47b1-ae98-f0fc03f6e352 None admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:51.640850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 658/1306] 10.222.0.32 () {60 vars in 1144 bytes} [Tue May 10 13:51:51 2022] POST /identity/v3/endpoints => generated 331 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:52:57.024837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbc083-f15c-4a0d-87a5-cb0369773f39 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:57.025826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbc083-f15c-4a0d-87a5-cb0369773f39 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:57.026355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbc083-f15c-4a0d-87a5-cb0369773f39 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:57.032171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 649/1307] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:52:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:57.033704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005cce5-7468-4505-80e4-3ba11b859251 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:57.034148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005cce5-7468-4505-80e4-3ba11b859251 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:57.034332 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005cce5-7468-4505-80e4-3ba11b859251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:57.108192 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-d005cce5-7468-4505-80e4-3ba11b859251 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:57.109669 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-d005cce5-7468-4505-80e4-3ba11b859251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:57.219686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 659/1308] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:52:57.270684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715fdd6-d812-4235-b74b-d6ca6c7df828 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:57.271267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715fdd6-d812-4235-b74b-d6ca6c7df828 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:57.271731 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715fdd6-d812-4235-b74b-d6ca6c7df828 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:57.273667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 650/1309] 10.222.0.32 () {54 vars in 964 bytes} [Tue May 10 13:52:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:57.280079 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5375b-8079-4e1a-8c12-e0a018518441 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:57.280645 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5375b-8079-4e1a-8c12-e0a018518441 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:57.281111 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5375b-8079-4e1a-8c12-e0a018518441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:57.381069 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-91b5375b-8079-4e1a-8c12-e0a018518441 None None] MFA Rules not processed for user `12eb1c001b5e44d8b5b5bc658ed464f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:57.382322 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-91b5375b-8079-4e1a-8c12-e0a018518441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:57.479144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 660/1310] 10.222.0.32 () {58 vars in 1061 bytes} [Tue May 10 13:52:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:57.480061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715fdd6-d812-4235-b74b-d6ca6c7df828 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:52:57.481960 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-9715fdd6-d812-4235-b74b-d6ca6c7df828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:57.615397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715fdd6-d812-4235-b74b-d6ca6c7df828 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:52:57.700413 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2023d8-8868-43bd-be59-a894e3157d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:52:57.701440 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2023d8-8868-43bd-be59-a894e3157d2e service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:57.701929 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2023d8-8868-43bd-be59-a894e3157d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:57.708014 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2023d8-8868-43bd-be59-a894e3157d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:57.713343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-eb2023d8-8868-43bd-be59-a894e3157d2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:57.842543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2023d8-8868-43bd-be59-a894e3157d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:52:57.844185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2023d8-8868-43bd-be59-a894e3157d2e service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:52:57.866597 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 651/1311] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:52:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 13:53:00.494304 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3be4a-1391-401a-8814-e97ebdb08375 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:00.494811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3be4a-1391-401a-8814-e97ebdb08375 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:00.494811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3be4a-1391-401a-8814-e97ebdb08375 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:00.496248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 661/1312] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:53:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:00.501749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64f20f-d951-41c5-92dc-a26314590b29 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:00.502226 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64f20f-d951-41c5-92dc-a26314590b29 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:00.502342 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64f20f-d951-41c5-92dc-a26314590b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:00.587068 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-bf64f20f-d951-41c5-92dc-a26314590b29 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:00.588278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-bf64f20f-d951-41c5-92dc-a26314590b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:00.682967 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 652/1313] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:00.720534 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3be4a-1391-401a-8814-e97ebdb08375 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:00.722114 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-a1a3be4a-1391-401a-8814-e97ebdb08375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:00.845972 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3be4a-1391-401a-8814-e97ebdb08375 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:00.924207 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b3f9d-acac-45d2-982d-45f0445a98d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:00.924865 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b3f9d-acac-45d2-982d-45f0445a98d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:00.925148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b3f9d-acac-45d2-982d-45f0445a98d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:00.925422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b3f9d-acac-45d2-982d-45f0445a98d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:00.927110 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c84b3f9d-acac-45d2-982d-45f0445a98d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:01.040651 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b3f9d-acac-45d2-982d-45f0445a98d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:01.042099 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b3f9d-acac-45d2-982d-45f0445a98d8 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:01.060408 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 662/1314] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:53:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 13:53:03.645155 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b4b97-4bd5-441c-88c4-7f4ca4120e76 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:03.645702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b4b97-4bd5-441c-88c4-7f4ca4120e76 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:03.645702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b4b97-4bd5-441c-88c4-7f4ca4120e76 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:03.647109 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 653/1315] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:03.653270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7897795-b551-42f1-9f08-5432167475c0 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:03.653760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7897795-b551-42f1-9f08-5432167475c0 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:03.653872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7897795-b551-42f1-9f08-5432167475c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:03.718240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-a7897795-b551-42f1-9f08-5432167475c0 None None] MFA Rules not processed for user `a1d7a40db9484e8d8f3167ff53fb5b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:03.719417 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-a7897795-b551-42f1-9f08-5432167475c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:03.819014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 663/1316] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:53:03 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:03.858967 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b4b97-4bd5-441c-88c4-7f4ca4120e76 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:03.860533 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-199b4b97-4bd5-441c-88c4-7f4ca4120e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:03.966151 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b4b97-4bd5-441c-88c4-7f4ca4120e76 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:04.038910 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1fe6a-98ab-4c0a-996f-e6bc2a7455a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:04.039384 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1fe6a-98ab-4c0a-996f-e6bc2a7455a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:04.039850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1fe6a-98ab-4c0a-996f-e6bc2a7455a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:04.040128 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1fe6a-98ab-4c0a-996f-e6bc2a7455a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:04.041826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-fcc1fe6a-98ab-4c0a-996f-e6bc2a7455a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:04.165342 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1fe6a-98ab-4c0a-996f-e6bc2a7455a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:04.166837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1fe6a-98ab-4c0a-996f-e6bc2a7455a9 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:04.184807 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 654/1317] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:53:03 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 13:53:07.049624 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028fc46-8c25-477a-8492-2468201e56bc None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:07.050245 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028fc46-8c25-477a-8492-2468201e56bc None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:07.050245 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028fc46-8c25-477a-8492-2468201e56bc None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:07.051572 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 664/1318] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:07.057472 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140dad08-5ceb-4226-a930-3b9992f45ab2 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:07.057932 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140dad08-5ceb-4226-a930-3b9992f45ab2 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:07.058032 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140dad08-5ceb-4226-a930-3b9992f45ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:07.121101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-140dad08-5ceb-4226-a930-3b9992f45ab2 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:07.122192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-140dad08-5ceb-4226-a930-3b9992f45ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:07.214226 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 655/1319] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:53:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:07.253178 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028fc46-8c25-477a-8492-2468201e56bc None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:07.254732 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-1028fc46-8c25-477a-8492-2468201e56bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:07.360676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028fc46-8c25-477a-8492-2468201e56bc None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:07.434727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d813d5-eca0-4762-a181-55bf86353f26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:07.435299 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d813d5-eca0-4762-a181-55bf86353f26 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:07.435585 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d813d5-eca0-4762-a181-55bf86353f26 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:07.435861 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d813d5-eca0-4762-a181-55bf86353f26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:07.437496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f1d813d5-eca0-4762-a181-55bf86353f26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:07.546584 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d813d5-eca0-4762-a181-55bf86353f26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:07.548021 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d813d5-eca0-4762-a181-55bf86353f26 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:07.565882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 665/1320] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:53:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:10.490429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4bbc6-21b0-4b43-879e-1541f0af81e0 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:10.491004 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4bbc6-21b0-4b43-879e-1541f0af81e0 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:10.491004 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4bbc6-21b0-4b43-879e-1541f0af81e0 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:10.493044 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 656/1321] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:10.498624 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d42ebe-b799-4939-a26c-a0191e93c735 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:10.499079 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d42ebe-b799-4939-a26c-a0191e93c735 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:10.499309 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d42ebe-b799-4939-a26c-a0191e93c735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:10.562521 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-b3d42ebe-b799-4939-a26c-a0191e93c735 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:10.563725 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-b3d42ebe-b799-4939-a26c-a0191e93c735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:10.657419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 666/1322] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:10.712441 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f9d2c-568a-472b-9c1a-120da52ddf7d None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:10.712843 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f9d2c-568a-472b-9c1a-120da52ddf7d None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:10.713195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f9d2c-568a-472b-9c1a-120da52ddf7d None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:10.714613 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 657/1323] 10.222.0.32 () {54 vars in 964 bytes} [Tue May 10 13:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:10.720975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a495ed3-56e5-4cea-8541-3ab31896e825 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:10.721276 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a495ed3-56e5-4cea-8541-3ab31896e825 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:10.721679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a495ed3-56e5-4cea-8541-3ab31896e825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:10.807513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-1a495ed3-56e5-4cea-8541-3ab31896e825 None None] MFA Rules not processed for user `12eb1c001b5e44d8b5b5bc658ed464f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:10.808666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-1a495ed3-56e5-4cea-8541-3ab31896e825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:10.885942 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 667/1324] 10.222.0.32 () {58 vars in 1061 bytes} [Tue May 10 13:53:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:10.894989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f9d2c-568a-472b-9c1a-120da52ddf7d None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:10.896549 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-790f9d2c-568a-472b-9c1a-120da52ddf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:11.007105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f9d2c-568a-472b-9c1a-120da52ddf7d None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:11.089870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4977e5-f918-4158-8d25-fff41168d44c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:11.090477 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4977e5-f918-4158-8d25-fff41168d44c service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:11.090765 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4977e5-f918-4158-8d25-fff41168d44c service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:11.091043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4977e5-f918-4158-8d25-fff41168d44c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:11.092703 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-dc4977e5-f918-4158-8d25-fff41168d44c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:11.204519 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4977e5-f918-4158-8d25-fff41168d44c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:11.205959 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4977e5-f918-4158-8d25-fff41168d44c service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:11.225499 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 658/1325] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:53:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:13.769546 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37275a21-124b-4a13-9869-3c2c5c56328a None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:13.770122 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37275a21-124b-4a13-9869-3c2c5c56328a None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:13.770122 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37275a21-124b-4a13-9869-3c2c5c56328a None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:13.771534 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 668/1326] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:13.777539 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab04acf-9104-47db-afe9-cc9aa861cd23 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:13.777991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab04acf-9104-47db-afe9-cc9aa861cd23 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:13.778088 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab04acf-9104-47db-afe9-cc9aa861cd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:13.843693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-5ab04acf-9104-47db-afe9-cc9aa861cd23 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:13.844888 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-5ab04acf-9104-47db-afe9-cc9aa861cd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:13.942673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 659/1327] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:13.980359 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37275a21-124b-4a13-9869-3c2c5c56328a None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:13.982023 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-37275a21-124b-4a13-9869-3c2c5c56328a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:14.089487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37275a21-124b-4a13-9869-3c2c5c56328a None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:14.163856 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd244a0-f549-444f-86b0-9dee57f32fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:14.164616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd244a0-f549-444f-86b0-9dee57f32fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:14.164898 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd244a0-f549-444f-86b0-9dee57f32fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:14.165178 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd244a0-f549-444f-86b0-9dee57f32fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:14.166912 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-3fd244a0-f549-444f-86b0-9dee57f32fa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:14.288450 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd244a0-f549-444f-86b0-9dee57f32fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:14.290543 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd244a0-f549-444f-86b0-9dee57f32fa0 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:14.308621 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 669/1328] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:53:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:16.641010 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fe149-a68f-45b5-8c61-8f6163195938 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:16.641577 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fe149-a68f-45b5-8c61-8f6163195938 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:16.641577 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fe149-a68f-45b5-8c61-8f6163195938 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:16.643043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 660/1329] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:16.648762 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25801388-ce70-434e-a9e1-d35f130c18c4 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:16.649211 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25801388-ce70-434e-a9e1-d35f130c18c4 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:16.649369 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25801388-ce70-434e-a9e1-d35f130c18c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:16.717579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-25801388-ce70-434e-a9e1-d35f130c18c4 None None] MFA Rules not processed for user `a1d7a40db9484e8d8f3167ff53fb5b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:16.718835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-25801388-ce70-434e-a9e1-d35f130c18c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:16.821166 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 670/1330] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:53:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:16.858866 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fe149-a68f-45b5-8c61-8f6163195938 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:16.860414 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-414fe149-a68f-45b5-8c61-8f6163195938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:16.962107 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fe149-a68f-45b5-8c61-8f6163195938 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:17.033216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94547e1a-5949-42b3-bd97-eb403b2db57c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:17.033869 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94547e1a-5949-42b3-bd97-eb403b2db57c service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:17.034147 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94547e1a-5949-42b3-bd97-eb403b2db57c service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:17.034444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94547e1a-5949-42b3-bd97-eb403b2db57c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:17.036056 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-94547e1a-5949-42b3-bd97-eb403b2db57c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:17.145683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94547e1a-5949-42b3-bd97-eb403b2db57c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:17.147152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94547e1a-5949-42b3-bd97-eb403b2db57c service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:17.165819 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 661/1331] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:53:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:19.864757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37647161-5442-4af3-a586-37270bc5db8c None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:19.865266 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37647161-5442-4af3-a586-37270bc5db8c None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:19.865356 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37647161-5442-4af3-a586-37270bc5db8c None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:19.866792 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 671/1332] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:19.873423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e8165-2a82-4f93-bd7b-8c5b87bafab4 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:19.873917 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e8165-2a82-4f93-bd7b-8c5b87bafab4 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:19.874041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e8165-2a82-4f93-bd7b-8c5b87bafab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:19.944873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-d77e8165-2a82-4f93-bd7b-8c5b87bafab4 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:19.946077 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-d77e8165-2a82-4f93-bd7b-8c5b87bafab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:20.046073 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 662/1333] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:20.080928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37647161-5442-4af3-a586-37270bc5db8c None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:20.082644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-37647161-5442-4af3-a586-37270bc5db8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:20.187787 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37647161-5442-4af3-a586-37270bc5db8c None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:20.261319 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920d086-7fde-4d6c-a441-ebba4316a6f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:20.261972 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920d086-7fde-4d6c-a441-ebba4316a6f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:20.262279 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920d086-7fde-4d6c-a441-ebba4316a6f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:20.262551 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920d086-7fde-4d6c-a441-ebba4316a6f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:20.264171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f920d086-7fde-4d6c-a441-ebba4316a6f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:20.372772 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920d086-7fde-4d6c-a441-ebba4316a6f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:20.374264 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920d086-7fde-4d6c-a441-ebba4316a6f5 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:20.392592 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 672/1334] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:53:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:22.664324 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bb36c-73a8-4cd3-8f40-9cde579c99e3 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:22.664943 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bb36c-73a8-4cd3-8f40-9cde579c99e3 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:22.665034 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bb36c-73a8-4cd3-8f40-9cde579c99e3 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:22.666418 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 663/1335] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:22.671685 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd411bfc-7062-4cc5-a83c-36b02fd0d262 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:22.672119 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd411bfc-7062-4cc5-a83c-36b02fd0d262 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:22.672227 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd411bfc-7062-4cc5-a83c-36b02fd0d262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:22.735045 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-fd411bfc-7062-4cc5-a83c-36b02fd0d262 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:22.736480 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-fd411bfc-7062-4cc5-a83c-36b02fd0d262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:22.832366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 673/1336] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:53:22.873435 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bb36c-73a8-4cd3-8f40-9cde579c99e3 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:22.874984 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-f49bb36c-73a8-4cd3-8f40-9cde579c99e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:22.980556 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bb36c-73a8-4cd3-8f40-9cde579c99e3 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:23.057163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a0ae8-655d-4b3f-8d05-bb4f3a23d17a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:23.057818 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a0ae8-655d-4b3f-8d05-bb4f3a23d17a service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:23.058125 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a0ae8-655d-4b3f-8d05-bb4f3a23d17a service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:23.058426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a0ae8-655d-4b3f-8d05-bb4f3a23d17a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:23.060075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-402a0ae8-655d-4b3f-8d05-bb4f3a23d17a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:23.169840 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a0ae8-655d-4b3f-8d05-bb4f3a23d17a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:23.171338 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a0ae8-655d-4b3f-8d05-bb4f3a23d17a service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:23.188746 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 664/1337] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:53:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:25.974399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa42bd-8a60-481a-a6c7-057933772c19 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:25.974950 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa42bd-8a60-481a-a6c7-057933772c19 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:25.974950 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa42bd-8a60-481a-a6c7-057933772c19 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:25.977400 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 674/1338] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:53:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:25.982723 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a03a4-5c00-4e55-bacf-831321d56bae None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:25.983127 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a03a4-5c00-4e55-bacf-831321d56bae None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:25.983275 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a03a4-5c00-4e55-bacf-831321d56bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:26.046885 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-9d7a03a4-5c00-4e55-bacf-831321d56bae None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:26.048094 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-9d7a03a4-5c00-4e55-bacf-831321d56bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:26.143857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 665/1339] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:53:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:26.180724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa42bd-8a60-481a-a6c7-057933772c19 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:26.182278 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-6cfa42bd-8a60-481a-a6c7-057933772c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:26.290434 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa42bd-8a60-481a-a6c7-057933772c19 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:26.387358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac064542-1342-41a1-a9d1-eca4b798c77b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:26.388015 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac064542-1342-41a1-a9d1-eca4b798c77b service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:26.388296 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac064542-1342-41a1-a9d1-eca4b798c77b service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:26.388573 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac064542-1342-41a1-a9d1-eca4b798c77b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:26.390291 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-ac064542-1342-41a1-a9d1-eca4b798c77b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:26.499385 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac064542-1342-41a1-a9d1-eca4b798c77b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:26.500730 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac064542-1342-41a1-a9d1-eca4b798c77b service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:26.518930 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 675/1340] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:53:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:30.931700 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159e2e3-a3a1-4ee8-b189-312aacc99698 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:30.932114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159e2e3-a3a1-4ee8-b189-312aacc99698 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:30.932189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159e2e3-a3a1-4ee8-b189-312aacc99698 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:30.933608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 666/1341] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:30.939282 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecb3ed-ce27-4bf5-8c80-853f64b0792e None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:30.939737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecb3ed-ce27-4bf5-8c80-853f64b0792e None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:30.939834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecb3ed-ce27-4bf5-8c80-853f64b0792e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:31.010416 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-91ecb3ed-ce27-4bf5-8c80-853f64b0792e None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:31.011536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-91ecb3ed-ce27-4bf5-8c80-853f64b0792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:31.114627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 676/1342] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:31.153145 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159e2e3-a3a1-4ee8-b189-312aacc99698 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:31.155288 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-5159e2e3-a3a1-4ee8-b189-312aacc99698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:31.249959 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159e2e3-a3a1-4ee8-b189-312aacc99698 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:31.253574 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8324d0-758c-47ef-b147-237aeab07db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:31.254246 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8324d0-758c-47ef-b147-237aeab07db6 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:31.254535 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8324d0-758c-47ef-b147-237aeab07db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:31.254812 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8324d0-758c-47ef-b147-237aeab07db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:31.264421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8324d0-758c-47ef-b147-237aeab07db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:31.265864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8324d0-758c-47ef-b147-237aeab07db6 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:31.276424 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 667/1343] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:53:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 13:53:34.079939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74705326-a7f1-47c0-ad90-b11f5368908d None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:34.080487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74705326-a7f1-47c0-ad90-b11f5368908d None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:34.080487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74705326-a7f1-47c0-ad90-b11f5368908d None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:34.082091 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 677/1344] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:34.087707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235353b-8593-4edf-81bd-93b520ec1ef0 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:34.088151 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235353b-8593-4edf-81bd-93b520ec1ef0 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:34.088260 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235353b-8593-4edf-81bd-93b520ec1ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:34.117254 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-c235353b-8593-4edf-81bd-93b520ec1ef0 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:34.118452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-c235353b-8593-4edf-81bd-93b520ec1ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:34.193009 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 668/1345] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:53:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:34.231093 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74705326-a7f1-47c0-ad90-b11f5368908d None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:34.242845 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74705326-a7f1-47c0-ad90-b11f5368908d None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:34.246375 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0e00f-9b59-4494-ab79-a141a57cc02d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:34.247014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0e00f-9b59-4494-ab79-a141a57cc02d service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:34.247304 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0e00f-9b59-4494-ab79-a141a57cc02d service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:34.247578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0e00f-9b59-4494-ab79-a141a57cc02d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:34.257598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0e00f-9b59-4494-ab79-a141a57cc02d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:34.259212 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0e00f-9b59-4494-ab79-a141a57cc02d service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:34.268614 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 678/1346] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:53:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:38.708233 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e443e3-edbf-4590-adef-bb438d1f3870 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:38.708741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e443e3-edbf-4590-adef-bb438d1f3870 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:38.708833 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e443e3-edbf-4590-adef-bb438d1f3870 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:38.710219 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 669/1347] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:38.715585 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066905cd-952a-49c5-9dd0-da4f0a820c40 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:38.716038 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066905cd-952a-49c5-9dd0-da4f0a820c40 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:38.716155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066905cd-952a-49c5-9dd0-da4f0a820c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:38.733562 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-066905cd-952a-49c5-9dd0-da4f0a820c40 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:38.734764 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-066905cd-952a-49c5-9dd0-da4f0a820c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:38.743718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 679/1348] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:38.780943 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e443e3-edbf-4590-adef-bb438d1f3870 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:38.791728 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e443e3-edbf-4590-adef-bb438d1f3870 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:38.795174 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44963a7b-61c0-4bd3-8952-0410e44c4e76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:38.795808 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44963a7b-61c0-4bd3-8952-0410e44c4e76 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:38.796112 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44963a7b-61c0-4bd3-8952-0410e44c4e76 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:38.796385 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44963a7b-61c0-4bd3-8952-0410e44c4e76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:38.805931 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44963a7b-61c0-4bd3-8952-0410e44c4e76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:38.807377 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44963a7b-61c0-4bd3-8952-0410e44c4e76 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:38.817126 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 670/1349] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:44.324998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0630a83-bcd0-41ab-9b9b-d52fbc3c483c None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:44.326381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0630a83-bcd0-41ab-9b9b-d52fbc3c483c None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:44.326802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0630a83-bcd0-41ab-9b9b-d52fbc3c483c None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:44.328395 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 680/1350] 10.222.0.32 () {54 vars in 921 bytes} [Tue May 10 13:53:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:44.336613 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c635c1-7127-4f59-843f-6f738aa80183 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:44.337919 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c635c1-7127-4f59-843f-6f738aa80183 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:44.338655 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c635c1-7127-4f59-843f-6f738aa80183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:44.426762 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-80c635c1-7127-4f59-843f-6f738aa80183 None None] MFA Rules not processed for user `4859a69a988a4b10b67187553d829b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:44.428236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-80c635c1-7127-4f59-843f-6f738aa80183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:44.529684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 671/1351] 10.222.0.32 () {58 vars in 1018 bytes} [Tue May 10 13:53:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:49.062640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64704f-5346-40a0-9101-d458f1e6359f None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:49.063653 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64704f-5346-40a0-9101-d458f1e6359f None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:49.064166 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64704f-5346-40a0-9101-d458f1e6359f None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:49.066316 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 681/1352] 10.222.0.32 () {54 vars in 921 bytes} [Tue May 10 13:53:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:49.071792 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7052d79-f80e-4053-9c4a-9f228f249efe None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:49.072370 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7052d79-f80e-4053-9c4a-9f228f249efe None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:49.072370 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7052d79-f80e-4053-9c4a-9f228f249efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:49.092421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-a7052d79-f80e-4053-9c4a-9f228f249efe None None] MFA Rules not processed for user `4859a69a988a4b10b67187553d829b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:49.093624 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a7052d79-f80e-4053-9c4a-9f228f249efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:49.104658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 672/1353] 10.222.0.32 () {58 vars in 1018 bytes} [Tue May 10 13:53:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:50.520098 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ba870-fdc9-4b53-a428-3c24ca6f0670 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:50.520660 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ba870-fdc9-4b53-a428-3c24ca6f0670 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:50.520660 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ba870-fdc9-4b53-a428-3c24ca6f0670 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:50.521998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 682/1354] 10.222.0.32 () {54 vars in 921 bytes} [Tue May 10 13:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:50.527781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52703b-7643-4a5d-874c-84079d52bf0d None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:50.528226 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52703b-7643-4a5d-874c-84079d52bf0d None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:50.528449 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52703b-7643-4a5d-874c-84079d52bf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:50.554727 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-6e52703b-7643-4a5d-874c-84079d52bf0d None None] MFA Rules not processed for user `4859a69a988a4b10b67187553d829b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:50.555763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-6e52703b-7643-4a5d-874c-84079d52bf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:50.568359 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 673/1355] 10.222.0.32 () {58 vars in 1018 bytes} [Tue May 10 13:53:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:53:54.650683 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfafcb4-738f-4813-8f97-d64790c243c5 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:54.651321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfafcb4-738f-4813-8f97-d64790c243c5 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:54.651549 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfafcb4-738f-4813-8f97-d64790c243c5 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:54.653156 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 683/1356] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:54.658331 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd3db4-3b7a-4f7d-a271-9b5d59af6428 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:54.659143 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd3db4-3b7a-4f7d-a271-9b5d59af6428 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:54.659415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd3db4-3b7a-4f7d-a271-9b5d59af6428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:54.677140 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-07bd3db4-3b7a-4f7d-a271-9b5d59af6428 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:54.679240 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-07bd3db4-3b7a-4f7d-a271-9b5d59af6428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:54.701359 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 674/1357] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:54.742658 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4bdc0-8ac9-48a6-b32d-0874b2428de7 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:54.742930 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4bdc0-8ac9-48a6-b32d-0874b2428de7 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:54.743240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4bdc0-8ac9-48a6-b32d-0874b2428de7 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:54.745086 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 684/1358] 10.222.0.32 () {54 vars in 961 bytes} [Tue May 10 13:53:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:54.752731 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede41313-f33a-4338-9fad-f6dbf2db7504 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:54.753332 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede41313-f33a-4338-9fad-f6dbf2db7504 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:54.753902 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede41313-f33a-4338-9fad-f6dbf2db7504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:54.809199 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-ede41313-f33a-4338-9fad-f6dbf2db7504 None None] MFA Rules not processed for user `e5d4fd26c21f4170a6790369344f8334`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:54.815025 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-ede41313-f33a-4338-9fad-f6dbf2db7504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:54.915686 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 675/1359] 10.222.0.32 () {58 vars in 1058 bytes} [Tue May 10 13:53:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:54.924804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4bdc0-8ac9-48a6-b32d-0874b2428de7 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:54.940238 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4bdc0-8ac9-48a6-b32d-0874b2428de7 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:54.945956 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2094548-f700-4d47-b637-e0536c43bc04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:54.946767 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2094548-f700-4d47-b637-e0536c43bc04 service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:54.946944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2094548-f700-4d47-b637-e0536c43bc04 service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:54.947165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2094548-f700-4d47-b637-e0536c43bc04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:54.955927 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2094548-f700-4d47-b637-e0536c43bc04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:54.957504 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2094548-f700-4d47-b637-e0536c43bc04 service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:54.967878 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 685/1360] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 13:53:57.469204 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d13b7-4d75-44b2-9428-cf364303b040 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:57.469708 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d13b7-4d75-44b2-9428-cf364303b040 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:57.469708 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d13b7-4d75-44b2-9428-cf364303b040 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:57.471061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 676/1361] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:57.477300 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a02fc4-1a01-42c0-9f34-59de35aac42e None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:57.477757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a02fc4-1a01-42c0-9f34-59de35aac42e None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:57.477757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a02fc4-1a01-42c0-9f34-59de35aac42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:57.495834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-b4a02fc4-1a01-42c0-9f34-59de35aac42e None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:57.497034 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-b4a02fc4-1a01-42c0-9f34-59de35aac42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:57.505255 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 686/1362] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:53:57.550958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d13b7-4d75-44b2-9428-cf364303b040 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:57.565700 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d13b7-4d75-44b2-9428-cf364303b040 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:57.571397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e6253-a412-44a2-a562-7867e70121b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:57.572047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e6253-a412-44a2-a562-7867e70121b8 service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:57.572322 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e6253-a412-44a2-a562-7867e70121b8 service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:57.572593 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e6253-a412-44a2-a562-7867e70121b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:57.581135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e6253-a412-44a2-a562-7867e70121b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:57.582734 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e6253-a412-44a2-a562-7867e70121b8 service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:57.594379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 677/1363] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:53:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:00.143156 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd45ed0-477c-4da2-87ee-192e82de5f5c None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:00.143660 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd45ed0-477c-4da2-87ee-192e82de5f5c None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:00.143660 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd45ed0-477c-4da2-87ee-192e82de5f5c None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:00.144973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 687/1364] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:00.150644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd1bcc-4ed5-4c86-904b-0991c1665380 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:00.151071 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd1bcc-4ed5-4c86-904b-0991c1665380 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:00.151324 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd1bcc-4ed5-4c86-904b-0991c1665380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:00.169462 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-eadd1bcc-4ed5-4c86-904b-0991c1665380 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:00.170673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-eadd1bcc-4ed5-4c86-904b-0991c1665380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:00.179222 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 678/1365] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:00.223084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83943974-3da1-4328-9d4a-4d6ef9dee829 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:00.223446 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83943974-3da1-4328-9d4a-4d6ef9dee829 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:00.223797 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83943974-3da1-4328-9d4a-4d6ef9dee829 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:00.225745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 688/1366] 10.222.0.32 () {54 vars in 961 bytes} [Tue May 10 13:54:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:00.231592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd832b9-b4be-48d0-8e66-58e510ed79fe None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:00.231886 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd832b9-b4be-48d0-8e66-58e510ed79fe None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:00.232164 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd832b9-b4be-48d0-8e66-58e510ed79fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:00.252515 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-ebd832b9-b4be-48d0-8e66-58e510ed79fe None None] MFA Rules not processed for user `e5d4fd26c21f4170a6790369344f8334`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:00.253941 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-ebd832b9-b4be-48d0-8e66-58e510ed79fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:00.274282 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 679/1367] 10.222.0.32 () {58 vars in 1058 bytes} [Tue May 10 13:54:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:00.292934 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83943974-3da1-4328-9d4a-4d6ef9dee829 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:00.309048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83943974-3da1-4328-9d4a-4d6ef9dee829 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:00.314766 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae3235-8534-40b6-bfb5-1b94046f24b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:00.315616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae3235-8534-40b6-bfb5-1b94046f24b2 service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:00.316045 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae3235-8534-40b6-bfb5-1b94046f24b2 service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:00.316470 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae3235-8534-40b6-bfb5-1b94046f24b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:00.325798 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae3235-8534-40b6-bfb5-1b94046f24b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:00.327410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae3235-8534-40b6-bfb5-1b94046f24b2 service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:00.337583 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 689/1368] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:54:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:02.649833 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d4ad5-28c6-41f9-88db-62fb301033eb None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:02.650435 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d4ad5-28c6-41f9-88db-62fb301033eb None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:02.650435 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d4ad5-28c6-41f9-88db-62fb301033eb None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:02.651772 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 680/1369] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:02.657328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aadb5-3570-4cb6-b4a6-9129a1f2cdae None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:02.658092 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aadb5-3570-4cb6-b4a6-9129a1f2cdae None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:02.658572 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aadb5-3570-4cb6-b4a6-9129a1f2cdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:02.678355 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-722aadb5-3570-4cb6-b4a6-9129a1f2cdae None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:02.679918 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-722aadb5-3570-4cb6-b4a6-9129a1f2cdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:02.697160 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 690/1370] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:54:02.732666 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d4ad5-28c6-41f9-88db-62fb301033eb None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:02.748484 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d4ad5-28c6-41f9-88db-62fb301033eb None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:02.754560 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f56ab3-ad2f-4eb6-9531-ddf8a6e0fa82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:02.755482 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f56ab3-ad2f-4eb6-9531-ddf8a6e0fa82 service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:02.755933 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f56ab3-ad2f-4eb6-9531-ddf8a6e0fa82 service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:02.756461 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f56ab3-ad2f-4eb6-9531-ddf8a6e0fa82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:02.765763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f56ab3-ad2f-4eb6-9531-ddf8a6e0fa82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:02.767518 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f56ab3-ad2f-4eb6-9531-ddf8a6e0fa82 service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:02.778447 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 681/1371] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:54:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:03.126172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be58df7-77e1-4023-821e-64c17e9df725 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:03.126749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be58df7-77e1-4023-821e-64c17e9df725 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:03.127210 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be58df7-77e1-4023-821e-64c17e9df725 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:03.128802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 691/1372] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:54:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:03.135740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbcd76-2094-44d1-a028-792a3500b532 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:03.136304 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbcd76-2094-44d1-a028-792a3500b532 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:03.136746 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbcd76-2094-44d1-a028-792a3500b532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:03.156855 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-02cbcd76-2094-44d1-a028-792a3500b532 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:03.158289 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-02cbcd76-2094-44d1-a028-792a3500b532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:03.166613 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 682/1373] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:03.474727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf754be5-470f-4cdf-b55c-62a55b4e5ba5 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:03.475202 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf754be5-470f-4cdf-b55c-62a55b4e5ba5 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:03.475869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf754be5-470f-4cdf-b55c-62a55b4e5ba5 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:03.477111 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 692/1374] 10.222.0.32 () {54 vars in 963 bytes} [Tue May 10 13:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:03.482147 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11943b94-647d-4136-aa77-a12c5e11d585 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:03.482470 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11943b94-647d-4136-aa77-a12c5e11d585 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:03.482743 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11943b94-647d-4136-aa77-a12c5e11d585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:03.532893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-11943b94-647d-4136-aa77-a12c5e11d585 None None] MFA Rules not processed for user `42629678b7dd40fe8013b9644ac337d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:03.534079 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-11943b94-647d-4136-aa77-a12c5e11d585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:03.597121 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 683/1375] 10.222.0.32 () {58 vars in 1060 bytes} [Tue May 10 13:54:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:03.604826 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf754be5-470f-4cdf-b55c-62a55b4e5ba5 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:03.616071 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf754be5-470f-4cdf-b55c-62a55b4e5ba5 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:03.619678 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745a136-6389-49be-85cc-205449a8e126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:03.620318 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745a136-6389-49be-85cc-205449a8e126 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:03.620781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745a136-6389-49be-85cc-205449a8e126 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:03.621042 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745a136-6389-49be-85cc-205449a8e126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:03.630510 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745a136-6389-49be-85cc-205449a8e126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:03.632920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745a136-6389-49be-85cc-205449a8e126 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:03.642994 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 693/1376] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:54:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:05.088091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba182b25-4455-4622-9e8e-21ee9fc0cc8e None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:05.088672 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba182b25-4455-4622-9e8e-21ee9fc0cc8e None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:05.088876 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba182b25-4455-4622-9e8e-21ee9fc0cc8e None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:05.090345 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 684/1377] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:54:05.095716 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886e478-2f4a-41b8-a19b-4c7e4391246a None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:05.096158 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886e478-2f4a-41b8-a19b-4c7e4391246a None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:05.096271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886e478-2f4a-41b8-a19b-4c7e4391246a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:05.114105 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-4886e478-2f4a-41b8-a19b-4c7e4391246a None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:05.115260 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-4886e478-2f4a-41b8-a19b-4c7e4391246a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:05.124310 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 694/1378] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:05.169864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba182b25-4455-4622-9e8e-21ee9fc0cc8e None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:05.185099 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba182b25-4455-4622-9e8e-21ee9fc0cc8e None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:05.190830 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308120f-a58f-432f-a850-cc2d1f09e0ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:05.191524 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308120f-a58f-432f-a850-cc2d1f09e0ac service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:05.191810 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308120f-a58f-432f-a850-cc2d1f09e0ac service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:05.192087 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308120f-a58f-432f-a850-cc2d1f09e0ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:05.202011 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308120f-a58f-432f-a850-cc2d1f09e0ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:05.203680 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308120f-a58f-432f-a850-cc2d1f09e0ac service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:05.214319 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 685/1379] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:54:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:07.508152 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c4183-d072-4682-8c8e-d1a76f712648 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:07.509197 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c4183-d072-4682-8c8e-d1a76f712648 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:07.509742 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c4183-d072-4682-8c8e-d1a76f712648 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:07.512206 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 695/1380] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:54:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:07.517384 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b256fb-b807-4511-b6a1-41892e784f2a None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:07.517809 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b256fb-b807-4511-b6a1-41892e784f2a None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:07.517921 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b256fb-b807-4511-b6a1-41892e784f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:07.538636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-72b256fb-b807-4511-b6a1-41892e784f2a None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:07.539814 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-72b256fb-b807-4511-b6a1-41892e784f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:07.548110 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 686/1381] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:07.591681 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c4183-d072-4682-8c8e-d1a76f712648 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:07.610511 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c4183-d072-4682-8c8e-d1a76f712648 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:07.617125 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572fcae-8ec0-4c48-9ed0-59e435b6e5d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:07.617845 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572fcae-8ec0-4c48-9ed0-59e435b6e5d9 service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:07.618219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572fcae-8ec0-4c48-9ed0-59e435b6e5d9 service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:07.618585 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572fcae-8ec0-4c48-9ed0-59e435b6e5d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:07.627011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572fcae-8ec0-4c48-9ed0-59e435b6e5d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:07.628691 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572fcae-8ec0-4c48-9ed0-59e435b6e5d9 service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:07.638709 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 696/1382] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:54:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:09.969337 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c2657-3541-4a25-b035-071bed182d18 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:09.970317 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c2657-3541-4a25-b035-071bed182d18 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:09.970704 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c2657-3541-4a25-b035-071bed182d18 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:09.972209 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 687/1383] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:54:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:09.978086 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df344ad6-5562-4b34-ae54-7d076ace0059 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:09.978580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df344ad6-5562-4b34-ae54-7d076ace0059 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:09.978696 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df344ad6-5562-4b34-ae54-7d076ace0059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:09.997293 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-df344ad6-5562-4b34-ae54-7d076ace0059 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:09.998521 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-df344ad6-5562-4b34-ae54-7d076ace0059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:10.010572 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 697/1384] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:10.049733 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c2657-3541-4a25-b035-071bed182d18 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:10.066022 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c2657-3541-4a25-b035-071bed182d18 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:10.075625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb0aaf-f927-446b-9a7e-856581f1869a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:10.076448 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb0aaf-f927-446b-9a7e-856581f1869a service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:10.076825 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb0aaf-f927-446b-9a7e-856581f1869a service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:10.077319 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb0aaf-f927-446b-9a7e-856581f1869a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:10.087244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb0aaf-f927-446b-9a7e-856581f1869a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:10.088960 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb0aaf-f927-446b-9a7e-856581f1869a service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:10.098543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 688/1385] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:54:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:12.556911 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c34c9-118a-4615-bae0-d223313392ce None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:12.557473 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c34c9-118a-4615-bae0-d223313392ce None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:12.557643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c34c9-118a-4615-bae0-d223313392ce None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:12.559392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 698/1386] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:54:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:54:12.566707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5f0cf-4ab0-448c-9881-9439e95aa799 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:12.567177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5f0cf-4ab0-448c-9881-9439e95aa799 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:12.567288 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5f0cf-4ab0-448c-9881-9439e95aa799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:12.590529 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-7db5f0cf-4ab0-448c-9881-9439e95aa799 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:12.592066 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-7db5f0cf-4ab0-448c-9881-9439e95aa799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:12.602190 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 689/1387] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:12.655771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c34c9-118a-4615-bae0-d223313392ce None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:12.672024 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c34c9-118a-4615-bae0-d223313392ce None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:12.678620 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b5536-c900-4b30-90a2-55b57f0d8e97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:12.679510 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b5536-c900-4b30-90a2-55b57f0d8e97 service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:12.679829 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b5536-c900-4b30-90a2-55b57f0d8e97 service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:12.680141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b5536-c900-4b30-90a2-55b57f0d8e97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:12.689525 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b5536-c900-4b30-90a2-55b57f0d8e97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:12.691326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b5536-c900-4b30-90a2-55b57f0d8e97 service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:12.702179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 699/1388] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:54:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:15.593981 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e188b6-cb9b-4f8f-8ade-4ef321b234ee None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:15.594581 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e188b6-cb9b-4f8f-8ade-4ef321b234ee None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:15.594733 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e188b6-cb9b-4f8f-8ade-4ef321b234ee None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:15.596560 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 690/1389] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:54:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:15.602888 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991dc24-20b2-414f-af03-cb7f2ef2bb09 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:15.603452 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991dc24-20b2-414f-af03-cb7f2ef2bb09 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:15.603452 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991dc24-20b2-414f-af03-cb7f2ef2bb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:15.623784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-5991dc24-20b2-414f-af03-cb7f2ef2bb09 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:15.625165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-5991dc24-20b2-414f-af03-cb7f2ef2bb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:15.635040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 700/1390] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:15.681318 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e188b6-cb9b-4f8f-8ade-4ef321b234ee None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:15.697427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e188b6-cb9b-4f8f-8ade-4ef321b234ee None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:15.703119 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6509be-5807-45ff-9cd2-a42ff0b148c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:15.703763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6509be-5807-45ff-9cd2-a42ff0b148c4 service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:15.704058 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6509be-5807-45ff-9cd2-a42ff0b148c4 service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:15.704351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6509be-5807-45ff-9cd2-a42ff0b148c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:15.713728 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6509be-5807-45ff-9cd2-a42ff0b148c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:15.715403 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6509be-5807-45ff-9cd2-a42ff0b148c4 service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:15.725258 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 691/1391] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:18.018268 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b7265-acca-4240-8535-c94500f31f76 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:18.018870 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b7265-acca-4240-8535-c94500f31f76 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:18.018870 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b7265-acca-4240-8535-c94500f31f76 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:18.020191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 701/1392] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:18.027155 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef70932-a602-4fc1-b674-413316d3301c None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:18.027606 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef70932-a602-4fc1-b674-413316d3301c None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:18.027745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef70932-a602-4fc1-b674-413316d3301c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:18.045512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-7ef70932-a602-4fc1-b674-413316d3301c None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:18.046738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-7ef70932-a602-4fc1-b674-413316d3301c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:18.055866 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 692/1393] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:54:18.102028 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b7265-acca-4240-8535-c94500f31f76 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:18.118088 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b7265-acca-4240-8535-c94500f31f76 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:18.124015 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57474d-d257-4de8-aadf-9c59a6e1aa3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:18.124668 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57474d-d257-4de8-aadf-9c59a6e1aa3e service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:18.124952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57474d-d257-4de8-aadf-9c59a6e1aa3e service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:18.125234 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57474d-d257-4de8-aadf-9c59a6e1aa3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:18.134144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57474d-d257-4de8-aadf-9c59a6e1aa3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:18.135750 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57474d-d257-4de8-aadf-9c59a6e1aa3e service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:18.145208 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 702/1394] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:54:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:19.480915 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29e789-592b-4f49-92f5-73449a9a9cae None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:19.481493 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29e789-592b-4f49-92f5-73449a9a9cae None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:19.481493 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29e789-592b-4f49-92f5-73449a9a9cae None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:19.482845 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 693/1395] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:19.488169 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b67ba5-7231-4f0a-ba1b-3d25bb6a584a None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:19.488567 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b67ba5-7231-4f0a-ba1b-3d25bb6a584a None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:19.488700 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b67ba5-7231-4f0a-ba1b-3d25bb6a584a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:19.506784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-29b67ba5-7231-4f0a-ba1b-3d25bb6a584a None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:19.507959 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-29b67ba5-7231-4f0a-ba1b-3d25bb6a584a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:19.515726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 703/1396] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:19.571906 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aaedc8-8d41-4290-8d95-ab1e22f91d84 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:19.572199 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aaedc8-8d41-4290-8d95-ab1e22f91d84 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:19.572482 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aaedc8-8d41-4290-8d95-ab1e22f91d84 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:19.573849 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 694/1397] 10.222.0.32 () {54 vars in 962 bytes} [Tue May 10 13:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:19.579056 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254aa48-9b03-440f-bb4d-a2b905981da7 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:19.579343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254aa48-9b03-440f-bb4d-a2b905981da7 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:19.579618 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254aa48-9b03-440f-bb4d-a2b905981da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:19.628408 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-5254aa48-9b03-440f-bb4d-a2b905981da7 None None] MFA Rules not processed for user `ada4e799ead24839b109377db3c6393b`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:19.629614 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-5254aa48-9b03-440f-bb4d-a2b905981da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:19.690109 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 704/1398] 10.222.0.32 () {58 vars in 1059 bytes} [Tue May 10 13:54:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:19.697794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aaedc8-8d41-4290-8d95-ab1e22f91d84 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:19.708305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aaedc8-8d41-4290-8d95-ab1e22f91d84 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:19.712741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1210eda-9dd5-4e62-86d4-39b6c728a54f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada4e799ead24839b109377db3c6393b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:19.713385 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1210eda-9dd5-4e62-86d4-39b6c728a54f service glance] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:19.713667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1210eda-9dd5-4e62-86d4-39b6c728a54f service glance] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:19.713945 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1210eda-9dd5-4e62-86d4-39b6c728a54f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:19.722902 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1210eda-9dd5-4e62-86d4-39b6c728a54f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:19.724475 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1210eda-9dd5-4e62-86d4-39b6c728a54f service glance] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:19.735029 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 695/1399] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:54:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:20.161598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99355325-0a65-4117-9445-aa6df7dee49f None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:20.162017 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99355325-0a65-4117-9445-aa6df7dee49f None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:20.162915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99355325-0a65-4117-9445-aa6df7dee49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:20.211719 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-99355325-0a65-4117-9445-aa6df7dee49f None None] MFA Rules not processed for user `686c869be43c40a9b63b3647bf689c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:20.212929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-99355325-0a65-4117-9445-aa6df7dee49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:20.283131 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 705/1400] 10.222.0.32 () {58 vars in 1009 bytes} [Tue May 10 13:54:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:20.326788 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1aaf5f-49b9-4376-b7c8-60bf4d480d16 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:20.327259 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1aaf5f-49b9-4376-b7c8-60bf4d480d16 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:20.327676 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1aaf5f-49b9-4376-b7c8-60bf4d480d16 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:20.329453 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 696/1401] 10.222.0.32 () {54 vars in 942 bytes} [Tue May 10 13:54:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:20.337936 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545611d-2b99-4594-9d17-b326ece48d97 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:20.338344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545611d-2b99-4594-9d17-b326ece48d97 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:20.338703 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545611d-2b99-4594-9d17-b326ece48d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:20.390798 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-3545611d-2b99-4594-9d17-b326ece48d97 None None] MFA Rules not processed for user `47bbad5318b6417087d7ce6906f8281f`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:20.391987 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-3545611d-2b99-4594-9d17-b326ece48d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:20.433350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb987b6-86c5-4855-afd0-987352fdc952 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:20.433632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb987b6-86c5-4855-afd0-987352fdc952 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:20.433917 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb987b6-86c5-4855-afd0-987352fdc952 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:20.435322 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 697/1402] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:54:20.440300 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9c3ba-c527-4b9b-afb3-5ba7e80a00a1 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:20.440585 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9c3ba-c527-4b9b-afb3-5ba7e80a00a1 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:20.440861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9c3ba-c527-4b9b-afb3-5ba7e80a00a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:20.458023 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-4fb9c3ba-c527-4b9b-afb3-5ba7e80a00a1 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:20.459819 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-4fb9c3ba-c527-4b9b-afb3-5ba7e80a00a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:20.463675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 706/1403] 10.222.0.32 () {58 vars in 1039 bytes} [Tue May 10 13:54:20 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:20.468878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 698/1404] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:54:20.473184 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545611d-2b99-4594-9d17-b326ece48d97 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:20.483726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545611d-2b99-4594-9d17-b326ece48d97 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:20.489101 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967cc6f-ff9e-4e6b-a4e9-bde219f24af5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bbad5318b6417087d7ce6906f8281f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:20.489779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967cc6f-ff9e-4e6b-a4e9-bde219f24af5 service swift] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:20.490093 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967cc6f-ff9e-4e6b-a4e9-bde219f24af5 service swift] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:20.490391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967cc6f-ff9e-4e6b-a4e9-bde219f24af5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:20.498528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967cc6f-ff9e-4e6b-a4e9-bde219f24af5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:20.500162 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967cc6f-ff9e-4e6b-a4e9-bde219f24af5 service swift] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:20.508527 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 707/1405] 10.222.0.32 () {60 vars in 1384 bytes} [Tue May 10 13:54:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 13:54:20.516097 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9c3ba-c527-4b9b-afb3-5ba7e80a00a1 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:20.529406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9c3ba-c527-4b9b-afb3-5ba7e80a00a1 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:20.534960 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb8bcb-622c-403c-9da2-01c02b1afee9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:20.535635 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb8bcb-622c-403c-9da2-01c02b1afee9 service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:20.536047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb8bcb-622c-403c-9da2-01c02b1afee9 service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:20.536256 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb8bcb-622c-403c-9da2-01c02b1afee9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:20.549722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb8bcb-622c-403c-9da2-01c02b1afee9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:20.551360 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb8bcb-622c-403c-9da2-01c02b1afee9 service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:20.561836 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 699/1406] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:54:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:22.901424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185db5d1-6810-4ebe-a93e-b396804053da None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:22.901996 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185db5d1-6810-4ebe-a93e-b396804053da None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:22.902627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185db5d1-6810-4ebe-a93e-b396804053da None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:22.904488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 708/1407] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:54:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:22.910691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f693b1-66db-4bf7-90dc-adb1c9e12cc4 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:22.912955 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f693b1-66db-4bf7-90dc-adb1c9e12cc4 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:22.913483 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f693b1-66db-4bf7-90dc-adb1c9e12cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:22.934533 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-f9f693b1-66db-4bf7-90dc-adb1c9e12cc4 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:22.936125 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-f9f693b1-66db-4bf7-90dc-adb1c9e12cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:22.945774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 700/1408] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:22.992236 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185db5d1-6810-4ebe-a93e-b396804053da None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:23.020988 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185db5d1-6810-4ebe-a93e-b396804053da None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:23.029967 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edb0d9-00e5-45c0-adb0-9ceb791842be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:23.031116 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edb0d9-00e5-45c0-adb0-9ceb791842be service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:23.031583 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edb0d9-00e5-45c0-adb0-9ceb791842be service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:23.032049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edb0d9-00e5-45c0-adb0-9ceb791842be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:23.048813 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edb0d9-00e5-45c0-adb0-9ceb791842be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:23.051838 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edb0d9-00e5-45c0-adb0-9ceb791842be service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:23.070926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 709/1409] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:54:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:44.329565 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43727ac7-5a88-438f-81c0-484d7fee91c3 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:44.330165 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43727ac7-5a88-438f-81c0-484d7fee91c3 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:44.330165 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43727ac7-5a88-438f-81c0-484d7fee91c3 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:44.331465 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 701/1410] 10.222.0.32 () {54 vars in 918 bytes} [Tue May 10 13:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:44.337101 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48481e3d-58f3-4e2c-9149-27c278691ea9 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:44.337550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48481e3d-58f3-4e2c-9149-27c278691ea9 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:44.337735 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48481e3d-58f3-4e2c-9149-27c278691ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:44.357594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-48481e3d-58f3-4e2c-9149-27c278691ea9 None None] MFA Rules not processed for user `4859a69a988a4b10b67187553d829b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:44.358840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-48481e3d-58f3-4e2c-9149-27c278691ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:44.368628 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 710/1411] 10.222.0.32 () {58 vars in 1015 bytes} [Tue May 10 13:54:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:44.384792 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd124b55-dc93-43e5-8e24-ab6cfb5daecd None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:44.385077 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd124b55-dc93-43e5-8e24-ab6cfb5daecd None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:44.385378 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd124b55-dc93-43e5-8e24-ab6cfb5daecd None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:44.386767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 702/1412] 10.222.0.32 () {54 vars in 918 bytes} [Tue May 10 13:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:44.391902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa181e70-b0a5-4a2c-80e2-6f78134a30aa None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:44.392217 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa181e70-b0a5-4a2c-80e2-6f78134a30aa None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:44.392491 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa181e70-b0a5-4a2c-80e2-6f78134a30aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:44.411493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-fa181e70-b0a5-4a2c-80e2-6f78134a30aa None None] MFA Rules not processed for user `e5d4fd26c21f4170a6790369344f8334`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:44.413156 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-fa181e70-b0a5-4a2c-80e2-6f78134a30aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:44.422429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 711/1413] 10.222.0.32 () {58 vars in 1015 bytes} [Tue May 10 13:54:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:47.147376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38283ad9-af3f-4f5e-bbcc-db35181d0499 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:47.147922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38283ad9-af3f-4f5e-bbcc-db35181d0499 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:47.148131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38283ad9-af3f-4f5e-bbcc-db35181d0499 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:47.149516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:47.154959 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011b143-31d6-47b6-bdca-c0900d5541b2 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:47.155407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011b143-31d6-47b6-bdca-c0900d5541b2 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:47.155556 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011b143-31d6-47b6-bdca-c0900d5541b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:47.173568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-3011b143-31d6-47b6-bdca-c0900d5541b2 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:47.174810 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-3011b143-31d6-47b6-bdca-c0900d5541b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:47.183713 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:47.223950 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38283ad9-af3f-4f5e-bbcc-db35181d0499 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:47.239281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38283ad9-af3f-4f5e-bbcc-db35181d0499 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:47.245698 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c60dd-4782-496c-8927-003b29b8d2fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:47.246367 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c60dd-4782-496c-8927-003b29b8d2fb service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:47.246654 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c60dd-4782-496c-8927-003b29b8d2fb service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:47.246932 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c60dd-4782-496c-8927-003b29b8d2fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:47.255461 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c60dd-4782-496c-8927-003b29b8d2fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:47.257648 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c60dd-4782-496c-8927-003b29b8d2fb service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:47.266979 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 704/1416] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:54:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:48.299462 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accf9db-e1c4-4409-8614-a25ac66bcfb7 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:48.299977 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accf9db-e1c4-4409-8614-a25ac66bcfb7 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:48.299977 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accf9db-e1c4-4409-8614-a25ac66bcfb7 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:48.301778 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:54:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:48.307446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86d9af-6088-4374-995a-20aa7f5f5e52 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:48.307920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86d9af-6088-4374-995a-20aa7f5f5e52 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:48.308027 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86d9af-6088-4374-995a-20aa7f5f5e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:48.326188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-7a86d9af-6088-4374-995a-20aa7f5f5e52 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:48.327396 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-7a86d9af-6088-4374-995a-20aa7f5f5e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:48.335839 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:48.495696 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accf9db-e1c4-4409-8614-a25ac66bcfb7 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:48.510359 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accf9db-e1c4-4409-8614-a25ac66bcfb7 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:48.515689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd87eaf-f210-48ce-889b-8b87f7d3ee74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:48.516332 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd87eaf-f210-48ce-889b-8b87f7d3ee74 service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:48.516616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd87eaf-f210-48ce-889b-8b87f7d3ee74 service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:48.516893 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd87eaf-f210-48ce-889b-8b87f7d3ee74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:48.525295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd87eaf-f210-48ce-889b-8b87f7d3ee74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:48.526917 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd87eaf-f210-48ce-889b-8b87f7d3ee74 service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:48.536025 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 714/1419] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:54:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:49.542404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197252e0-a9ec-485c-8369-1a09974cc409 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:49.542994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197252e0-a9ec-485c-8369-1a09974cc409 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:49.542994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197252e0-a9ec-485c-8369-1a09974cc409 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:49.544332 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:49.550019 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4c0a3-e9b3-4fde-bdd4-5f9eca1c92e1 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:49.550486 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4c0a3-e9b3-4fde-bdd4-5f9eca1c92e1 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:49.550608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4c0a3-e9b3-4fde-bdd4-5f9eca1c92e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:49.570999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-e9c4c0a3-e9b3-4fde-bdd4-5f9eca1c92e1 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:49.572232 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-e9c4c0a3-e9b3-4fde-bdd4-5f9eca1c92e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:49.580023 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:49.728591 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197252e0-a9ec-485c-8369-1a09974cc409 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:49.743438 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197252e0-a9ec-485c-8369-1a09974cc409 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:49.748789 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb26bf9-4c33-4df9-baf4-b48ba05c64cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:49.749433 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb26bf9-4c33-4df9-baf4-b48ba05c64cd service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:49.749713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb26bf9-4c33-4df9-baf4-b48ba05c64cd service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:49.749982 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb26bf9-4c33-4df9-baf4-b48ba05c64cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:49.759376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb26bf9-4c33-4df9-baf4-b48ba05c64cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:49.760943 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb26bf9-4c33-4df9-baf4-b48ba05c64cd service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:49.770092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 707/1422] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:50.708841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09236fe7-1185-4bfe-b1e6-9c1ec8719333 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:50.709961 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09236fe7-1185-4bfe-b1e6-9c1ec8719333 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:50.710063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09236fe7-1185-4bfe-b1e6-9c1ec8719333 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:50.711615 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:54:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:50.716999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb45daf-e7b6-4b8c-9e92-6b2daada05e8 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:50.717424 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb45daf-e7b6-4b8c-9e92-6b2daada05e8 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:50.717551 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb45daf-e7b6-4b8c-9e92-6b2daada05e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:50.735467 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-8bb45daf-e7b6-4b8c-9e92-6b2daada05e8 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:50.736896 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-8bb45daf-e7b6-4b8c-9e92-6b2daada05e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:50.745310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:50.896011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09236fe7-1185-4bfe-b1e6-9c1ec8719333 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:50.911010 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09236fe7-1185-4bfe-b1e6-9c1ec8719333 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:50.916648 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceef772-a8e4-4b2b-a67f-95af7929354a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:50.917290 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceef772-a8e4-4b2b-a67f-95af7929354a service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:50.917569 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceef772-a8e4-4b2b-a67f-95af7929354a service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:50.917841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceef772-a8e4-4b2b-a67f-95af7929354a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:50.925998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceef772-a8e4-4b2b-a67f-95af7929354a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:50.927618 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceef772-a8e4-4b2b-a67f-95af7929354a service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:50.937048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 717/1425] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:54:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:51.866307 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7963bb7-220d-493d-9091-00ccb6f7e271 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:51.866798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7963bb7-220d-493d-9091-00ccb6f7e271 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:51.866896 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7963bb7-220d-493d-9091-00ccb6f7e271 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:51.868227 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:51.873313 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b67b3-63b7-41da-b1ab-cfc639848da4 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:51.873745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b67b3-63b7-41da-b1ab-cfc639848da4 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:51.873854 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b67b3-63b7-41da-b1ab-cfc639848da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:51.891604 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-1f9b67b3-63b7-41da-b1ab-cfc639848da4 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:51.892795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-1f9b67b3-63b7-41da-b1ab-cfc639848da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:51.901191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:52.051372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7963bb7-220d-493d-9091-00ccb6f7e271 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:52.066845 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7963bb7-220d-493d-9091-00ccb6f7e271 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:52.073245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6dd2d-0776-497e-acef-8eca8118eba4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:52.073892 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6dd2d-0776-497e-acef-8eca8118eba4 service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:52.074175 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6dd2d-0776-497e-acef-8eca8118eba4 service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:52.074482 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6dd2d-0776-497e-acef-8eca8118eba4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:52.082650 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6dd2d-0776-497e-acef-8eca8118eba4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:52.084453 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6dd2d-0776-497e-acef-8eca8118eba4 service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:52.093832 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 710/1428] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:54:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:52.972047 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d02a71-6e0d-4256-9509-7aeb53c3cbf2 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:52.972580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d02a71-6e0d-4256-9509-7aeb53c3cbf2 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:52.972695 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d02a71-6e0d-4256-9509-7aeb53c3cbf2 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:52.974065 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:52.979907 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905db5b1-e5b5-4861-b88f-ed839268b027 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:52.980296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905db5b1-e5b5-4861-b88f-ed839268b027 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:52.980502 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905db5b1-e5b5-4861-b88f-ed839268b027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:52.999270 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-905db5b1-e5b5-4861-b88f-ed839268b027 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:53.000472 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-905db5b1-e5b5-4861-b88f-ed839268b027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:53.009301 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:53.170003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d02a71-6e0d-4256-9509-7aeb53c3cbf2 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:53.184037 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d02a71-6e0d-4256-9509-7aeb53c3cbf2 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:53.192934 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97feb4-074a-447b-ae54-cb45987f1e12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:53.194617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97feb4-074a-447b-ae54-cb45987f1e12 service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:53.195130 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97feb4-074a-447b-ae54-cb45987f1e12 service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:53.195641 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97feb4-074a-447b-ae54-cb45987f1e12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:53.208412 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97feb4-074a-447b-ae54-cb45987f1e12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:53.210788 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97feb4-074a-447b-ae54-cb45987f1e12 service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:53.220247 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 720/1431] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:54:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:54.105144 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88358e33-6ab4-4751-884e-32adee7986f8 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:54.105751 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88358e33-6ab4-4751-884e-32adee7986f8 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:54.105751 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88358e33-6ab4-4751-884e-32adee7986f8 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:54.107267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:54.112432 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eccb47-77e8-4ce5-98cb-ca77675ead23 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:54.112866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eccb47-77e8-4ce5-98cb-ca77675ead23 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:54.113002 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eccb47-77e8-4ce5-98cb-ca77675ead23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:54.131974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-21eccb47-77e8-4ce5-98cb-ca77675ead23 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:54.133164 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-21eccb47-77e8-4ce5-98cb-ca77675ead23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:54.141412 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:54.293713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88358e33-6ab4-4751-884e-32adee7986f8 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:54.308281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88358e33-6ab4-4751-884e-32adee7986f8 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:54.313589 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5af1f-1f20-4246-979b-01c791313941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:54.314255 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5af1f-1f20-4246-979b-01c791313941 service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:54.314542 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5af1f-1f20-4246-979b-01c791313941 service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:54.314818 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5af1f-1f20-4246-979b-01c791313941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:54.323808 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5af1f-1f20-4246-979b-01c791313941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:54.325399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5af1f-1f20-4246-979b-01c791313941 service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:54.335073 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 713/1434] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:54:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:55.219635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898876e7-36a2-4da3-b717-393c60b68bfb None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:55.220176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898876e7-36a2-4da3-b717-393c60b68bfb None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:55.220176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898876e7-36a2-4da3-b717-393c60b68bfb None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:55.221631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:55.227459 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac88749-e48a-4632-a817-431f0de37345 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:55.227921 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac88749-e48a-4632-a817-431f0de37345 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:55.228030 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac88749-e48a-4632-a817-431f0de37345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:55.246692 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-5ac88749-e48a-4632-a817-431f0de37345 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:55.247869 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-5ac88749-e48a-4632-a817-431f0de37345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:55.255533 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:55.404726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898876e7-36a2-4da3-b717-393c60b68bfb None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:55.419454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898876e7-36a2-4da3-b717-393c60b68bfb None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:55.424811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd868b-fd30-4ab9-b566-96f2fc5b7b67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:55.425443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd868b-fd30-4ab9-b566-96f2fc5b7b67 service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:55.425727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd868b-fd30-4ab9-b566-96f2fc5b7b67 service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:55.426003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd868b-fd30-4ab9-b566-96f2fc5b7b67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:55.434722 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd868b-fd30-4ab9-b566-96f2fc5b7b67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:55.436287 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd868b-fd30-4ab9-b566-96f2fc5b7b67 service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:55.445611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 723/1437] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:54:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:56.343506 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6629c-feeb-40de-83c9-6fc7abf90c13 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:56.344060 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6629c-feeb-40de-83c9-6fc7abf90c13 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:56.344060 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6629c-feeb-40de-83c9-6fc7abf90c13 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:56.345529 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:56.350464 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5d9a0-716a-437e-856a-8f97eef1eda0 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:56.350914 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5d9a0-716a-437e-856a-8f97eef1eda0 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:56.351038 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5d9a0-716a-437e-856a-8f97eef1eda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:56.369880 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-bda5d9a0-716a-437e-856a-8f97eef1eda0 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:56.371097 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-bda5d9a0-716a-437e-856a-8f97eef1eda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:56.378805 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:56.529459 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6629c-feeb-40de-83c9-6fc7abf90c13 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:56.543542 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6629c-feeb-40de-83c9-6fc7abf90c13 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:56.548791 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ea645-374d-4489-9a49-c1ece6b530e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:56.549421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ea645-374d-4489-9a49-c1ece6b530e7 service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:56.549701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ea645-374d-4489-9a49-c1ece6b530e7 service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:56.549979 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ea645-374d-4489-9a49-c1ece6b530e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:56.558481 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ea645-374d-4489-9a49-c1ece6b530e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:56.560049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ea645-374d-4489-9a49-c1ece6b530e7 service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:56.570230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 716/1440] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:54:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:58.718619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274e29b-8623-410c-9f8e-29223ac051a3 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:58.719192 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274e29b-8623-410c-9f8e-29223ac051a3 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:58.719192 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274e29b-8623-410c-9f8e-29223ac051a3 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:58.720549 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:58.726481 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612ab5b-3a48-48c0-8015-97e560eca565 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:58.726894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612ab5b-3a48-48c0-8015-97e560eca565 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:58.727036 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612ab5b-3a48-48c0-8015-97e560eca565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:58.744687 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-b612ab5b-3a48-48c0-8015-97e560eca565 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:58.745884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b612ab5b-3a48-48c0-8015-97e560eca565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:58.753724 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:58.793008 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274e29b-8623-410c-9f8e-29223ac051a3 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:58.803593 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274e29b-8623-410c-9f8e-29223ac051a3 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:58.807124 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d36c2-0695-48e0-b92c-8fa7240a08cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:58.807758 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d36c2-0695-48e0-b92c-8fa7240a08cc service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:58.808038 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d36c2-0695-48e0-b92c-8fa7240a08cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:58.808327 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d36c2-0695-48e0-b92c-8fa7240a08cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:58.817922 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d36c2-0695-48e0-b92c-8fa7240a08cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:58.819849 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d36c2-0695-48e0-b92c-8fa7240a08cc service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:58.830431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 726/1443] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:54:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:55:01.285167 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c1db1-c889-4765-a4ba-92c1249fe359 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:01.285745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c1db1-c889-4765-a4ba-92c1249fe359 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:01.285745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c1db1-c889-4765-a4ba-92c1249fe359 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:01.287724 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:55:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:55:01.293273 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482aed1-1a5f-4d24-aeb8-7d398bcd40cb None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:01.293688 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482aed1-1a5f-4d24-aeb8-7d398bcd40cb None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:01.293827 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482aed1-1a5f-4d24-aeb8-7d398bcd40cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:01.312346 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-7482aed1-1a5f-4d24-aeb8-7d398bcd40cb None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:55:01.313547 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-7482aed1-1a5f-4d24-aeb8-7d398bcd40cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:55:01.322039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:55:01.362327 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c1db1-c889-4765-a4ba-92c1249fe359 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:55:01.364027 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-ff5c1db1-c889-4765-a4ba-92c1249fe359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:55:01.377271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c1db1-c889-4765-a4ba-92c1249fe359 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:55:01.380727 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef6110-1850-4e4e-805a-5bcaa4eae491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:55:01.381354 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef6110-1850-4e4e-805a-5bcaa4eae491 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:01.381653 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef6110-1850-4e4e-805a-5bcaa4eae491 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:01.381926 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef6110-1850-4e4e-805a-5bcaa4eae491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:01.390791 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef6110-1850-4e4e-805a-5bcaa4eae491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:55:01.392179 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef6110-1850-4e4e-805a-5bcaa4eae491 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:55:01.401516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 719/1446] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:55:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:55:03.957160 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1e184-357e-4ef0-931d-d0c95ccff126 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:03.957721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1e184-357e-4ef0-931d-d0c95ccff126 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:03.957721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1e184-357e-4ef0-931d-d0c95ccff126 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:03.959926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:55:03.965395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cd1fb-1106-4e11-afb4-a2a3d93c6237 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:03.965811 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cd1fb-1106-4e11-afb4-a2a3d93c6237 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:03.965955 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cd1fb-1106-4e11-afb4-a2a3d93c6237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:03.984301 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-742cd1fb-1106-4e11-afb4-a2a3d93c6237 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:55:03.985513 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-742cd1fb-1106-4e11-afb4-a2a3d93c6237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:55:03.994030 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:55:04.032420 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1e184-357e-4ef0-931d-d0c95ccff126 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:55:04.043949 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1e184-357e-4ef0-931d-d0c95ccff126 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:55:04.047423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57029f9e-39b1-4892-800e-552445644d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:55:04.048056 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57029f9e-39b1-4892-800e-552445644d01 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:04.048336 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57029f9e-39b1-4892-800e-552445644d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:04.048609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57029f9e-39b1-4892-800e-552445644d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:04.057612 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57029f9e-39b1-4892-800e-552445644d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:55:04.059099 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57029f9e-39b1-4892-800e-552445644d01 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:55:04.068346 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 729/1449] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:55:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:55:06.445198 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd8040-ca7c-4228-8e41-451b1a9c77bc None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:06.445828 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd8040-ca7c-4228-8e41-451b1a9c77bc None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:06.445828 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd8040-ca7c-4228-8e41-451b1a9c77bc None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:06.447176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:55:06.452388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2ee11-4a2a-4ab2-bdcc-d24d8f9c87b9 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:06.452810 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2ee11-4a2a-4ab2-bdcc-d24d8f9c87b9 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:06.452937 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2ee11-4a2a-4ab2-bdcc-d24d8f9c87b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:06.471376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-aec2ee11-4a2a-4ab2-bdcc-d24d8f9c87b9 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:55:06.472572 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-aec2ee11-4a2a-4ab2-bdcc-d24d8f9c87b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:55:06.481000 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:55:06.519709 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd8040-ca7c-4228-8e41-451b1a9c77bc None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:55:06.530854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd8040-ca7c-4228-8e41-451b1a9c77bc None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:55:06.534329 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d9a65-b736-4d01-9dcb-be367007156f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:55:06.534958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d9a65-b736-4d01-9dcb-be367007156f service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:06.535239 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d9a65-b736-4d01-9dcb-be367007156f service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:06.535512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d9a65-b736-4d01-9dcb-be367007156f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:06.544224 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d9a65-b736-4d01-9dcb-be367007156f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:55:06.545648 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d9a65-b736-4d01-9dcb-be367007156f service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:55:06.554789 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 722/1452] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:55:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:55:08.832967 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b870a5c-1ae8-45b0-a6d7-78c25571c542 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:08.833497 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b870a5c-1ae8-45b0-a6d7-78c25571c542 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:08.833497 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b870a5c-1ae8-45b0-a6d7-78c25571c542 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:08.834886 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:55:08.840642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d035cd3-0427-4b88-bd50-161a4adb2420 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:08.841134 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d035cd3-0427-4b88-bd50-161a4adb2420 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:08.841249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d035cd3-0427-4b88-bd50-161a4adb2420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:08.864577 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-1d035cd3-0427-4b88-bd50-161a4adb2420 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:55:08.868102 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-1d035cd3-0427-4b88-bd50-161a4adb2420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:55:08.876489 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:55:08.916632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b870a5c-1ae8-45b0-a6d7-78c25571c542 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:55:08.928158 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b870a5c-1ae8-45b0-a6d7-78c25571c542 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:55:08.932260 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb032ca0-b069-4f22-9ee4-441d23720d49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:55:08.932913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb032ca0-b069-4f22-9ee4-441d23720d49 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:08.933199 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb032ca0-b069-4f22-9ee4-441d23720d49 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:08.933478 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb032ca0-b069-4f22-9ee4-441d23720d49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:08.943679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb032ca0-b069-4f22-9ee4-441d23720d49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:55:08.945141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb032ca0-b069-4f22-9ee4-441d23720d49 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:55:08.955846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 732/1455] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:55:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:55:11.328284 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08661e7-1bcb-45f9-82cd-83d88b281bb1 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:11.328827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08661e7-1bcb-45f9-82cd-83d88b281bb1 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:11.328827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08661e7-1bcb-45f9-82cd-83d88b281bb1 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:11.330171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:55:11.337158 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bd934-4e8e-414f-849c-bde3b7885545 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:11.337692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bd934-4e8e-414f-849c-bde3b7885545 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:11.337692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bd934-4e8e-414f-849c-bde3b7885545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:11.356481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-578bd934-4e8e-414f-849c-bde3b7885545 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:55:11.357694 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-578bd934-4e8e-414f-849c-bde3b7885545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:55:11.365866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:55:11.404809 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08661e7-1bcb-45f9-82cd-83d88b281bb1 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:55:11.416878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08661e7-1bcb-45f9-82cd-83d88b281bb1 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:55:11.420368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f919869-e34d-4056-b743-e57fa3058df0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:55:11.421008 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f919869-e34d-4056-b743-e57fa3058df0 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:11.421288 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f919869-e34d-4056-b743-e57fa3058df0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:11.421560 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f919869-e34d-4056-b743-e57fa3058df0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:11.430856 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f919869-e34d-4056-b743-e57fa3058df0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:55:11.432276 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f919869-e34d-4056-b743-e57fa3058df0 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:55:11.441589 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 725/1458] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:55:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:55:13.837050 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b7ea2-a05d-4450-9c1e-53073a69f649 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:13.837610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b7ea2-a05d-4450-9c1e-53073a69f649 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:13.838056 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b7ea2-a05d-4450-9c1e-53073a69f649 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:13.840811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:55:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:55:13.846444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd444a-48c4-4ff3-a44b-8356c07197df None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:13.846920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd444a-48c4-4ff3-a44b-8356c07197df None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:13.847036 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd444a-48c4-4ff3-a44b-8356c07197df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:13.866786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-defd444a-48c4-4ff3-a44b-8356c07197df None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:55:13.868000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-defd444a-48c4-4ff3-a44b-8356c07197df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:55:13.875743 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:55:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:55:13.913861 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b7ea2-a05d-4450-9c1e-53073a69f649 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:55:13.925067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b7ea2-a05d-4450-9c1e-53073a69f649 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:55:13.928626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b737e1-b4a8-4506-ab85-17602ca966b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:55:13.929268 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b737e1-b4a8-4506-ab85-17602ca966b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:13.929548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b737e1-b4a8-4506-ab85-17602ca966b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:13.929822 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b737e1-b4a8-4506-ab85-17602ca966b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:13.938940 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b737e1-b4a8-4506-ab85-17602ca966b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:55:13.940362 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b737e1-b4a8-4506-ab85-17602ca966b4 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:55:13.951077 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 735/1461] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:55:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:55:16.290827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85c8e9-fbde-4bea-936e-edaf271c2a6b None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:16.291375 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85c8e9-fbde-4bea-936e-edaf271c2a6b None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:16.291375 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85c8e9-fbde-4bea-936e-edaf271c2a6b None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:16.292754 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:55:16.298325 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae77ec-9580-4823-93e9-ad99cd51ae74 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:16.298852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae77ec-9580-4823-93e9-ad99cd51ae74 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:16.298975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae77ec-9580-4823-93e9-ad99cd51ae74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:16.318753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-c1ae77ec-9580-4823-93e9-ad99cd51ae74 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:55:16.319988 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c1ae77ec-9580-4823-93e9-ad99cd51ae74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:55:16.327954 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:55:16.366763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85c8e9-fbde-4bea-936e-edaf271c2a6b None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:55:16.377986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85c8e9-fbde-4bea-936e-edaf271c2a6b None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:55:16.382185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f434488-0c0a-40b1-88eb-cf261c144e48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:55:16.382872 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f434488-0c0a-40b1-88eb-cf261c144e48 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:16.383150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f434488-0c0a-40b1-88eb-cf261c144e48 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:16.383420 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f434488-0c0a-40b1-88eb-cf261c144e48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:16.393638 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f434488-0c0a-40b1-88eb-cf261c144e48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:55:16.395141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f434488-0c0a-40b1-88eb-cf261c144e48 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:55:16.406342 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 728/1464] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:55:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:55:18.708289 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f9108-6fe6-487c-a0c2-4484ea2aa64a None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:18.708900 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f9108-6fe6-487c-a0c2-4484ea2aa64a None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:18.709157 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f9108-6fe6-487c-a0c2-4484ea2aa64a None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:18.710630 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:55:18.716473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbfb65-ed49-4e17-bdc5-749405b0838e None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:18.716909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbfb65-ed49-4e17-bdc5-749405b0838e None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:18.717043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbfb65-ed49-4e17-bdc5-749405b0838e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:18.735866 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-bbcbfb65-ed49-4e17-bdc5-749405b0838e None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:55:18.737315 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-bbcbfb65-ed49-4e17-bdc5-749405b0838e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:55:18.745995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:55:18.781273 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f9108-6fe6-487c-a0c2-4484ea2aa64a None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:55:18.794648 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f9108-6fe6-487c-a0c2-4484ea2aa64a None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:55:18.798166 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee79e82-331e-44bd-a006-c25a5865230c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:55:18.798841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee79e82-331e-44bd-a006-c25a5865230c service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:18.799125 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee79e82-331e-44bd-a006-c25a5865230c service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:18.799403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee79e82-331e-44bd-a006-c25a5865230c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:18.809896 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee79e82-331e-44bd-a006-c25a5865230c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:55:18.811380 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee79e82-331e-44bd-a006-c25a5865230c service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:55:18.821665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 738/1467] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:55:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:55:21.202130 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f02b6-267e-482f-afbc-96aab1764716 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:21.202708 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f02b6-267e-482f-afbc-96aab1764716 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:21.202708 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f02b6-267e-482f-afbc-96aab1764716 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:21.203985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:55:21.209618 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e9f7e-1d4c-4b80-9fa4-5412eaf4930a None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:21.210077 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e9f7e-1d4c-4b80-9fa4-5412eaf4930a None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:21.210182 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e9f7e-1d4c-4b80-9fa4-5412eaf4930a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:21.227640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-0d6e9f7e-1d4c-4b80-9fa4-5412eaf4930a None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:55:21.228840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-0d6e9f7e-1d4c-4b80-9fa4-5412eaf4930a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:55:21.236611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:55:21.275083 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f02b6-267e-482f-afbc-96aab1764716 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:55:21.286566 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f02b6-267e-482f-afbc-96aab1764716 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:55:21.290669 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91252a5-df31-49aa-b1da-123e63c6d947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:55:21.291343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91252a5-df31-49aa-b1da-123e63c6d947 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:21.291625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91252a5-df31-49aa-b1da-123e63c6d947 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:21.291902 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91252a5-df31-49aa-b1da-123e63c6d947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:21.301701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91252a5-df31-49aa-b1da-123e63c6d947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:55:21.304095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91252a5-df31-49aa-b1da-123e63c6d947 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:55:21.314624 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 731/1470] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:55:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:55:54.857157 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8a9d7-493b-4944-b0aa-66ac6e02fcd6 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:54.857585 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8a9d7-493b-4944-b0aa-66ac6e02fcd6 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:54.857719 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8a9d7-493b-4944-b0aa-66ac6e02fcd6 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:54.859170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 740/1471] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:55:54.865933 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdcc7a-25e7-418f-91c8-7b9cd5a86213 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:54.866506 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdcc7a-25e7-418f-91c8-7b9cd5a86213 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:54.866506 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdcc7a-25e7-418f-91c8-7b9cd5a86213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:54.888745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-98fdcc7a-25e7-418f-91c8-7b9cd5a86213 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:55:54.889955 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-98fdcc7a-25e7-418f-91c8-7b9cd5a86213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:55:54.898706 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 732/1472] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:55:54.956788 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb01596-f065-43ec-8752-8efdb94f2c18 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:54.957078 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb01596-f065-43ec-8752-8efdb94f2c18 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:54.957352 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb01596-f065-43ec-8752-8efdb94f2c18 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:54.958971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 741/1473] 10.222.0.32 () {54 vars in 962 bytes} [Tue May 10 13:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:55:54.963975 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94170a9e-17dd-4016-9257-d33e5aa85251 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:54.964262 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94170a9e-17dd-4016-9257-d33e5aa85251 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:54.964538 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94170a9e-17dd-4016-9257-d33e5aa85251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:54.982318 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-94170a9e-17dd-4016-9257-d33e5aa85251 None None] MFA Rules not processed for user `ada4e799ead24839b109377db3c6393b`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:55:54.983519 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-94170a9e-17dd-4016-9257-d33e5aa85251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:55:54.990810 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 733/1474] 10.222.0.32 () {58 vars in 1059 bytes} [Tue May 10 13:55:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:55:54.998035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb01596-f065-43ec-8752-8efdb94f2c18 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:55:55.009341 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb01596-f065-43ec-8752-8efdb94f2c18 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:55:55.012865 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2d492-e7e2-4707-a675-3af87f430661 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada4e799ead24839b109377db3c6393b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:55:55.013496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2d492-e7e2-4707-a675-3af87f430661 service glance] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:55.013772 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2d492-e7e2-4707-a675-3af87f430661 service glance] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:55.014074 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2d492-e7e2-4707-a675-3af87f430661 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:55.023661 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2d492-e7e2-4707-a675-3af87f430661 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:55:55.025082 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2d492-e7e2-4707-a675-3af87f430661 service glance] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:55:55.034407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 742/1475] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:55:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:55:57.400322 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917de2cb-27dc-4024-b4d5-9239c701e1c5 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:57.400893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917de2cb-27dc-4024-b4d5-9239c701e1c5 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:57.400893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917de2cb-27dc-4024-b4d5-9239c701e1c5 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:57.402266 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 734/1476] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:55:57.407490 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2355eca-0304-4617-b26d-597e0f6a29a6 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:57.407925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2355eca-0304-4617-b26d-597e0f6a29a6 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:57.408045 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2355eca-0304-4617-b26d-597e0f6a29a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:57.427588 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-a2355eca-0304-4617-b26d-597e0f6a29a6 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:55:57.428883 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-a2355eca-0304-4617-b26d-597e0f6a29a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:55:57.437083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 743/1477] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:55:57.461184 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917de2cb-27dc-4024-b4d5-9239c701e1c5 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:55:57.473692 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917de2cb-27dc-4024-b4d5-9239c701e1c5 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:55:57.478038 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82231b96-0ebf-4ae9-8e91-b19445b5a930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:55:57.478716 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82231b96-0ebf-4ae9-8e91-b19445b5a930 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:57.478998 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82231b96-0ebf-4ae9-8e91-b19445b5a930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:57.479270 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82231b96-0ebf-4ae9-8e91-b19445b5a930 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:57.479997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82231b96-0ebf-4ae9-8e91-b19445b5a930 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:55:57.481750 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: WARNING py.warnings [None req-82231b96-0ebf-4ae9-8e91-b19445b5a930 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 13:55:57.481750 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: warnings.warn(msg) May 10 13:55:57.481750 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: May 10 13:55:57.482905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82231b96-0ebf-4ae9-8e91-b19445b5a930 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:55:57.502805 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 735/1478] 10.222.0.32 () {56 vars in 1108 bytes} [Tue May 10 13:55:57 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:55:59.836399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35842077-9d8d-40d6-ba4c-588022f5d4d8 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:59.836973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35842077-9d8d-40d6-ba4c-588022f5d4d8 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:59.836973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35842077-9d8d-40d6-ba4c-588022f5d4d8 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:59.838319 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 744/1479] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:55:59.843767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e4956-96a6-4eb3-8157-d024884d46fc None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:59.844197 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e4956-96a6-4eb3-8157-d024884d46fc None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:59.844307 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e4956-96a6-4eb3-8157-d024884d46fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:59.863189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-b16e4956-96a6-4eb3-8157-d024884d46fc None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:55:59.865167 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b16e4956-96a6-4eb3-8157-d024884d46fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:55:59.873017 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 736/1480] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:55:59.915194 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35842077-9d8d-40d6-ba4c-588022f5d4d8 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:55:59.929719 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35842077-9d8d-40d6-ba4c-588022f5d4d8 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:55:59.935325 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d95c56-964f-4744-852c-8e191b2aa845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:55:59.935886 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d95c56-964f-4744-852c-8e191b2aa845 service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:55:59.936163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d95c56-964f-4744-852c-8e191b2aa845 service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:55:59.936432 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d95c56-964f-4744-852c-8e191b2aa845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:55:59.944668 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d95c56-964f-4744-852c-8e191b2aa845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:55:59.946257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d95c56-964f-4744-852c-8e191b2aa845 service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:55:59.955627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 745/1481] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:55:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:56:02.372560 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e1636-e52f-4462-9083-fb7bde491422 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:02.373186 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e1636-e52f-4462-9083-fb7bde491422 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:02.373186 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e1636-e52f-4462-9083-fb7bde491422 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:02.374535 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 737/1482] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:56:02.379848 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d220c-cb64-4177-a76f-493368a67073 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:02.380293 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d220c-cb64-4177-a76f-493368a67073 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:02.380434 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d220c-cb64-4177-a76f-493368a67073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:02.398138 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-7e2d220c-cb64-4177-a76f-493368a67073 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:56:02.399345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-7e2d220c-cb64-4177-a76f-493368a67073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:56:02.407221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 746/1483] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:56:02.443643 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e1636-e52f-4462-9083-fb7bde491422 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:56:02.454427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e1636-e52f-4462-9083-fb7bde491422 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:56:02.458886 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49db22-a177-4dcc-9749-0d73cb0fa0a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:56:02.459526 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49db22-a177-4dcc-9749-0d73cb0fa0a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:02.459810 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49db22-a177-4dcc-9749-0d73cb0fa0a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:02.460087 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49db22-a177-4dcc-9749-0d73cb0fa0a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:02.468970 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49db22-a177-4dcc-9749-0d73cb0fa0a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:56:02.470433 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49db22-a177-4dcc-9749-0d73cb0fa0a4 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:56:02.480420 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 738/1484] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:56:04.763730 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bc1a4-0065-454a-8b9f-bfc8ac16b214 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:04.764265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bc1a4-0065-454a-8b9f-bfc8ac16b214 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:04.764265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bc1a4-0065-454a-8b9f-bfc8ac16b214 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:04.765630 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 747/1485] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:56:04.771688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6784f5-4bee-4a31-843d-8acd4e941138 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:04.772127 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6784f5-4bee-4a31-843d-8acd4e941138 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:04.772244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6784f5-4bee-4a31-843d-8acd4e941138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:04.790596 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-6d6784f5-4bee-4a31-843d-8acd4e941138 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:56:04.791781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-6d6784f5-4bee-4a31-843d-8acd4e941138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:56:04.799492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 739/1486] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:56:04.841504 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bc1a4-0065-454a-8b9f-bfc8ac16b214 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:56:04.853196 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bc1a4-0065-454a-8b9f-bfc8ac16b214 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:56:04.856785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ac8c8-348b-4b47-948c-c1300ff00025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:56:04.857431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ac8c8-348b-4b47-948c-c1300ff00025 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:04.857712 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ac8c8-348b-4b47-948c-c1300ff00025 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:04.857985 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ac8c8-348b-4b47-948c-c1300ff00025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:04.867709 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ac8c8-348b-4b47-948c-c1300ff00025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:56:04.869136 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ac8c8-348b-4b47-948c-c1300ff00025 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:56:04.878318 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 748/1487] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:56:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 13:56:07.237342 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb5412-66e3-4e4c-bfbb-cf33713a2275 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:07.237918 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb5412-66e3-4e4c-bfbb-cf33713a2275 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:07.237918 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb5412-66e3-4e4c-bfbb-cf33713a2275 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:07.239922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 740/1488] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:56:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:56:07.245292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e626e-f9ec-4bd2-b2bf-a92977a77ed4 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:07.245726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e626e-f9ec-4bd2-b2bf-a92977a77ed4 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:07.245919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e626e-f9ec-4bd2-b2bf-a92977a77ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:07.264075 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-3e7e626e-f9ec-4bd2-b2bf-a92977a77ed4 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:56:07.265273 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-3e7e626e-f9ec-4bd2-b2bf-a92977a77ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:56:07.273571 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 749/1489] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:56:07.313988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb5412-66e3-4e4c-bfbb-cf33713a2275 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:56:07.324865 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb5412-66e3-4e4c-bfbb-cf33713a2275 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:56:07.328344 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387168d0-2bba-4293-8e9a-4e3fba5a8b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:56:07.328977 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387168d0-2bba-4293-8e9a-4e3fba5a8b15 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:07.329256 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387168d0-2bba-4293-8e9a-4e3fba5a8b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:07.329529 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387168d0-2bba-4293-8e9a-4e3fba5a8b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:07.338511 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387168d0-2bba-4293-8e9a-4e3fba5a8b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:56:07.339919 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387168d0-2bba-4293-8e9a-4e3fba5a8b15 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:56:07.349730 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 741/1490] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:56:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:56:09.815530 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d62b8-a394-478b-bb0e-d5e780e6d20f None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:09.816105 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d62b8-a394-478b-bb0e-d5e780e6d20f None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:09.816105 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d62b8-a394-478b-bb0e-d5e780e6d20f None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:09.818210 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 750/1491] 10.222.0.32 () {54 vars in 926 bytes} [Tue May 10 13:56:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:56:09.823355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb737c7-0fc0-4b3c-a28b-69b482be215e None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:09.823778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb737c7-0fc0-4b3c-a28b-69b482be215e None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:09.823912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb737c7-0fc0-4b3c-a28b-69b482be215e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:09.841592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-abb737c7-0fc0-4b3c-a28b-69b482be215e None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:56:09.842814 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-abb737c7-0fc0-4b3c-a28b-69b482be215e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:56:09.850749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 742/1492] 10.222.0.32 () {58 vars in 1023 bytes} [Tue May 10 13:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:56:09.890750 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d62b8-a394-478b-bb0e-d5e780e6d20f None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:56:09.901419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d62b8-a394-478b-bb0e-d5e780e6d20f None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:56:09.905155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ab21d-cdfe-43b8-90a2-99a6c8208364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:56:09.905798 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ab21d-cdfe-43b8-90a2-99a6c8208364 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:09.906077 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ab21d-cdfe-43b8-90a2-99a6c8208364 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:09.906389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ab21d-cdfe-43b8-90a2-99a6c8208364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:09.915641 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ab21d-cdfe-43b8-90a2-99a6c8208364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:56:09.917072 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ab21d-cdfe-43b8-90a2-99a6c8208364 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:56:09.926929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 751/1493] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:56:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:57:43.918811 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7c443-e496-4221-8956-a1859754e9d7 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:43.919407 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7c443-e496-4221-8956-a1859754e9d7 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:43.919407 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7c443-e496-4221-8956-a1859754e9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:43.937871 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-4bb7c443-e496-4221-8956-a1859754e9d7 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:57:43.939087 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-4bb7c443-e496-4221-8956-a1859754e9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:57:43.946821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 743/1494] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 13:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:57:43.956410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b548d-9597-4f70-b305-1a2255b43187 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:43.956938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b548d-9597-4f70-b305-1a2255b43187 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:43.956938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b548d-9597-4f70-b305-1a2255b43187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:43.975763 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-144b548d-9597-4f70-b305-1a2255b43187 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:57:43.976965 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-144b548d-9597-4f70-b305-1a2255b43187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:57:43.984847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 752/1495] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 13:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:57:43.990669 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7c443-e496-4221-8956-a1859754e9d7 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:57:44.000177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7c443-e496-4221-8956-a1859754e9d7 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:57:44.005137 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7fb5b-3851-43fa-8f16-c853328b9062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:57:44.005788 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7fb5b-3851-43fa-8f16-c853328b9062 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:44.006072 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7fb5b-3851-43fa-8f16-c853328b9062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:44.006385 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7fb5b-3851-43fa-8f16-c853328b9062 admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:44.007120 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7fb5b-3851-43fa-8f16-c853328b9062 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:57:44.007422 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7fb5b-3851-43fa-8f16-c853328b9062 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:57:44.008443 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: WARNING py.warnings [None req-f8f7fb5b-3851-43fa-8f16-c853328b9062 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:57:44.008443 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: warnings.warn(msg) May 10 13:57:44.008443 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: May 10 13:57:44.009318 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7fb5b-3851-43fa-8f16-c853328b9062 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:57:44.021169 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 744/1496] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 13:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:57:44.029507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b548d-9597-4f70-b305-1a2255b43187 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:57:44.039412 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b548d-9597-4f70-b305-1a2255b43187 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:57:44.043885 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c117aa-3980-4957-9784-a72856b82717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:57:44.044532 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c117aa-3980-4957-9784-a72856b82717 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:44.044810 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c117aa-3980-4957-9784-a72856b82717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:44.045084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c117aa-3980-4957-9784-a72856b82717 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:44.045772 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c117aa-3980-4957-9784-a72856b82717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:57:44.047568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: WARNING py.warnings [None req-b7c117aa-3980-4957-9784-a72856b82717 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 13:57:44.047568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: warnings.warn(msg) May 10 13:57:44.047568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: May 10 13:57:44.048771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c117aa-3980-4957-9784-a72856b82717 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:57:44.085150 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 753/1497] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 13:57:44 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:57:44.089612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7fb5b-3851-43fa-8f16-c853328b9062 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:57:44.100243 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7fb5b-3851-43fa-8f16-c853328b9062 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:57:44.155809 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c854e-5b2d-455d-856b-9b94805256d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:57:44.156396 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c854e-5b2d-455d-856b-9b94805256d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:44.156677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c854e-5b2d-455d-856b-9b94805256d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:44.156951 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c854e-5b2d-455d-856b-9b94805256d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:44.157649 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c854e-5b2d-455d-856b-9b94805256d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:57:44.159222 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: WARNING py.warnings [None req-724c854e-5b2d-455d-856b-9b94805256d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 13:57:44.159222 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: warnings.warn(msg) May 10 13:57:44.159222 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: May 10 13:57:44.160413 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c854e-5b2d-455d-856b-9b94805256d1 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:57:44.180494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 745/1498] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 13:57:44 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:57:44.184662 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c117aa-3980-4957-9784-a72856b82717 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:57:44.195710 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c117aa-3980-4957-9784-a72856b82717 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:57:44.200373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75584537-0761-42e6-92cf-d709a396317f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:57:44.201036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75584537-0761-42e6-92cf-d709a396317f admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:44.201318 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75584537-0761-42e6-92cf-d709a396317f admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:44.201593 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75584537-0761-42e6-92cf-d709a396317f admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:44.202338 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75584537-0761-42e6-92cf-d709a396317f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:57:44.203349 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: WARNING py.warnings [None req-75584537-0761-42e6-92cf-d709a396317f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:57:44.203349 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: warnings.warn(msg) May 10 13:57:44.203349 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: May 10 13:57:44.204215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75584537-0761-42e6-92cf-d709a396317f admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:57:44.218258 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 754/1499] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 13:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:57:44.222800 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c854e-5b2d-455d-856b-9b94805256d1 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:57:44.232439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c854e-5b2d-455d-856b-9b94805256d1 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:57:44.237511 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3b5ae-5d3b-4d2e-877f-2993abf2ae00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:57:44.238440 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3b5ae-5d3b-4d2e-877f-2993abf2ae00 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:44.238716 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3b5ae-5d3b-4d2e-877f-2993abf2ae00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:44.238983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3b5ae-5d3b-4d2e-877f-2993abf2ae00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:44.239694 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3b5ae-5d3b-4d2e-877f-2993abf2ae00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:57:44.240698 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: WARNING py.warnings [None req-42e3b5ae-5d3b-4d2e-877f-2993abf2ae00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:57:44.240698 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: warnings.warn(msg) May 10 13:57:44.240698 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: May 10 13:57:44.241563 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3b5ae-5d3b-4d2e-877f-2993abf2ae00 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:57:44.256010 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 746/1500] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 13:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:57:44.260136 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75584537-0761-42e6-92cf-d709a396317f admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:57:44.270664 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75584537-0761-42e6-92cf-d709a396317f admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:57:44.275097 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c7385-dc35-434f-b948-b503fdf2ad53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:57:44.275977 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c7385-dc35-434f-b948-b503fdf2ad53 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:44.276261 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c7385-dc35-434f-b948-b503fdf2ad53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:44.276537 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c7385-dc35-434f-b948-b503fdf2ad53 admin admin] PATH_INFO: `/v3/projects/3f29dd0c8c014c04a6152f235841d5ab/users/00939f1d8767461793a9c9993ca080e8/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:44.291325 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c7385-dc35-434f-b948-b503fdf2ad53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f29dd0c8c014c04a6152f235841d5ab, user_id=00939f1d8767461793a9c9993ca080e8, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:57:44.292351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: WARNING py.warnings [None req-c52c7385-dc35-434f-b948-b503fdf2ad53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 13:57:44.292351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: warnings.warn(msg) May 10 13:57:44.292351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: May 10 13:57:44.294293 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c7385-dc35-434f-b948-b503fdf2ad53 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:57:44.307697 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 755/1501] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 13:57:44 2022] PUT /identity/v3/projects/3f29dd0c8c014c04a6152f235841d5ab/users/00939f1d8767461793a9c9993ca080e8/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:57:44.319877 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e2f79-3632-4d96-8a96-271cf804c699 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:44.320164 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e2f79-3632-4d96-8a96-271cf804c699 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:44.320444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e2f79-3632-4d96-8a96-271cf804c699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:44.346514 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-184e2f79-3632-4d96-8a96-271cf804c699 None None] MFA Rules not processed for user `00939f1d8767461793a9c9993ca080e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:57:44.347721 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-184e2f79-3632-4d96-8a96-271cf804c699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:57:44.414246 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 747/1502] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 13:57:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:57:44.428008 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04c8ad-a8da-49b3-b8d5-ece95446b452 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:44.428306 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04c8ad-a8da-49b3-b8d5-ece95446b452 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:44.428589 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04c8ad-a8da-49b3-b8d5-ece95446b452 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:44.429955 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 756/1503] 10.222.0.32 () {54 vars in 963 bytes} [Tue May 10 13:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:57:44.434782 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37ee1a-e997-4b56-9be5-bdb4666e2df7 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:44.435067 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37ee1a-e997-4b56-9be5-bdb4666e2df7 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:44.435338 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37ee1a-e997-4b56-9be5-bdb4666e2df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:44.453833 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-cb37ee1a-e997-4b56-9be5-bdb4666e2df7 None None] MFA Rules not processed for user `42629678b7dd40fe8013b9644ac337d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:57:44.455235 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-cb37ee1a-e997-4b56-9be5-bdb4666e2df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:57:44.505681 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 748/1504] 10.222.0.32 () {58 vars in 1060 bytes} [Tue May 10 13:57:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:57:44.513090 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04c8ad-a8da-49b3-b8d5-ece95446b452 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:57:44.523777 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04c8ad-a8da-49b3-b8d5-ece95446b452 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:57:44.527271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bceff-edbc-46b8-9a42-658055f414f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:57:44.527911 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bceff-edbc-46b8-9a42-658055f414f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:44.528193 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bceff-edbc-46b8-9a42-658055f414f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:44.528487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bceff-edbc-46b8-9a42-658055f414f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:44.536748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bceff-edbc-46b8-9a42-658055f414f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:57:44.538171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bceff-edbc-46b8-9a42-658055f414f3 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:57:44.546765 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 757/1505] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:57:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:57:44.592206 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad34d8-b3a7-49be-9206-aaa3b1b6ab76 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:44.592492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad34d8-b3a7-49be-9206-aaa3b1b6ab76 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:44.592767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad34d8-b3a7-49be-9206-aaa3b1b6ab76 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:44.594034 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 749/1506] 10.222.0.32 () {52 vars in 829 bytes} [Tue May 10 13:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:57:44.597682 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bceff-edbc-46b8-9a42-658055f414f3 service cinder] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:57:44.658241 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bceff-edbc-46b8-9a42-658055f414f3 service cinder] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:57:44.663274 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a3260-47ae-4e6e-9d04-56ea8ab955d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:57:44.664135 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a3260-47ae-4e6e-9d04-56ea8ab955d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:44.664462 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a3260-47ae-4e6e-9d04-56ea8ab955d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:44.664686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a3260-47ae-4e6e-9d04-56ea8ab955d1 admin admin] PATH_INFO: `/v3/users/00939f1d8767461793a9c9993ca080e8` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:44.665863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a3260-47ae-4e6e-9d04-56ea8ab955d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00939f1d8767461793a9c9993ca080e8)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:57:44.666916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: WARNING py.warnings [None req-0a4a3260-47ae-4e6e-9d04-56ea8ab955d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 13:57:44.666916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: warnings.warn(msg) May 10 13:57:44.666916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: May 10 13:57:44.668121 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a3260-47ae-4e6e-9d04-56ea8ab955d1 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:57:44.731874 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0a4a3260-47ae-4e6e-9d04-56ea8ab955d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00939f1d8767461793a9c9993ca080e8'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:57:44.732503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0a4a3260-47ae-4e6e-9d04-56ea8ab955d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00939f1d8767461793a9c9993ca080e8'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:57:44.755928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0a4a3260-47ae-4e6e-9d04-56ea8ab955d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00939f1d8767461793a9c9993ca080e8'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:57:44.768572 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0a4a3260-47ae-4e6e-9d04-56ea8ab955d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00939f1d8767461793a9c9993ca080e8'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:57:44.782507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0a4a3260-47ae-4e6e-9d04-56ea8ab955d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00939f1d8767461793a9c9993ca080e8'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:57:44.789179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 758/1507] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 13:57:44 2022] DELETE /identity/v3/users/00939f1d8767461793a9c9993ca080e8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:57:44.793728 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71257c-1fa1-468e-810f-356780875cf2 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:44.794016 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71257c-1fa1-468e-810f-356780875cf2 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:44.794324 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71257c-1fa1-468e-810f-356780875cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:44.811871 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-8f71257c-1fa1-468e-810f-356780875cf2 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:57:44.813045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-8f71257c-1fa1-468e-810f-356780875cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:57:44.871594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 750/1508] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 13:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:57:44.881401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a3260-47ae-4e6e-9d04-56ea8ab955d1 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:57:44.882869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-0a4a3260-47ae-4e6e-9d04-56ea8ab955d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:57:44.940448 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a3260-47ae-4e6e-9d04-56ea8ab955d1 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:57:44.943985 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f61fa-4f0e-4397-a554-797fd7e3afd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:57:44.944632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f61fa-4f0e-4397-a554-797fd7e3afd5 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:44.944918 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f61fa-4f0e-4397-a554-797fd7e3afd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:44.945195 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f61fa-4f0e-4397-a554-797fd7e3afd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:44.954008 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f61fa-4f0e-4397-a554-797fd7e3afd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:57:44.955644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f61fa-4f0e-4397-a554-797fd7e3afd5 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:57:44.966728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 759/1509] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:57:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:57:45.289210 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71257c-1fa1-468e-810f-356780875cf2 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:57:45.291031 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-8f71257c-1fa1-468e-810f-356780875cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:57:45.303441 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71257c-1fa1-468e-810f-356780875cf2 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:57:45.309808 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298b017-0d14-4621-91e6-117bfeefd5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:57:45.310948 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298b017-0d14-4621-91e6-117bfeefd5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:45.311232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298b017-0d14-4621-91e6-117bfeefd5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:45.311521 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298b017-0d14-4621-91e6-117bfeefd5a2 admin admin] PATH_INFO: `/v3/projects/3f29dd0c8c014c04a6152f235841d5ab` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:45.312697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298b017-0d14-4621-91e6-117bfeefd5a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f29dd0c8c014c04a6152f235841d5ab)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:57:45.313723 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: WARNING py.warnings [None req-1298b017-0d14-4621-91e6-117bfeefd5a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 13:57:45.313723 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: warnings.warn(msg) May 10 13:57:45.313723 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: May 10 13:57:45.315585 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298b017-0d14-4621-91e6-117bfeefd5a2 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:57:45.376513 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1298b017-0d14-4621-91e6-117bfeefd5a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f29dd0c8c014c04a6152f235841d5ab', 'request_id': 'req-1298b017-0d14-4621-91e6-117bfeefd5a2'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:57:45.382339 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1298b017-0d14-4621-91e6-117bfeefd5a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f29dd0c8c014c04a6152f235841d5ab', 'request_id': 'req-1298b017-0d14-4621-91e6-117bfeefd5a2'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:57:45.396204 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1298b017-0d14-4621-91e6-117bfeefd5a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f29dd0c8c014c04a6152f235841d5ab', 'request_id': 'req-1298b017-0d14-4621-91e6-117bfeefd5a2'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:57:45.412592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1298b017-0d14-4621-91e6-117bfeefd5a2 admin admin] The token cache is being invalidate because project 3f29dd0c8c014c04a6152f235841d5ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 13:57:45.412877 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1298b017-0d14-4621-91e6-117bfeefd5a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:57:45.413513 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1298b017-0d14-4621-91e6-117bfeefd5a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:57:45.415178 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 751/1510] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 13:57:45 2022] DELETE /identity/v3/projects/3f29dd0c8c014c04a6152f235841d5ab => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:59:29.607299 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba17722-0ef5-40f5-88e4-f3d3e1f4ae1c None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:29.607881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba17722-0ef5-40f5-88e4-f3d3e1f4ae1c None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:29.607881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba17722-0ef5-40f5-88e4-f3d3e1f4ae1c None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:29.609222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:59:29.614125 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb1767-5459-4c8f-ac13-8d12849bee1e None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:29.614816 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb1767-5459-4c8f-ac13-8d12849bee1e None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:29.614951 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb1767-5459-4c8f-ac13-8d12849bee1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:29.633289 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-3bbb1767-5459-4c8f-ac13-8d12849bee1e None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:29.634517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-3bbb1767-5459-4c8f-ac13-8d12849bee1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:29.690745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:29.861545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba17722-0ef5-40f5-88e4-f3d3e1f4ae1c None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:29.863188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-0ba17722-0ef5-40f5-88e4-f3d3e1f4ae1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:29.944873 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba17722-0ef5-40f5-88e4-f3d3e1f4ae1c None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:29.950315 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0da48-b2d2-4c76-85c0-754400ef0411 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:29.950965 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0da48-b2d2-4c76-85c0-754400ef0411 service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:29.951249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0da48-b2d2-4c76-85c0-754400ef0411 service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:29.951522 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0da48-b2d2-4c76-85c0-754400ef0411 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:29.959992 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0da48-b2d2-4c76-85c0-754400ef0411 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:29.961571 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0da48-b2d2-4c76-85c0-754400ef0411 service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:29.971601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 761/1513] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:59:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:30.911556 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3879cd-b925-4c1b-bffc-ff56bc3ec4f9 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:30.912126 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3879cd-b925-4c1b-bffc-ff56bc3ec4f9 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:30.912126 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3879cd-b925-4c1b-bffc-ff56bc3ec4f9 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:30.913820 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:59:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:59:30.918909 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308bd66-f067-422c-b6c3-8197a1a011d0 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:30.919327 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308bd66-f067-422c-b6c3-8197a1a011d0 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:30.919467 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308bd66-f067-422c-b6c3-8197a1a011d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:30.938482 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-8308bd66-f067-422c-b6c3-8197a1a011d0 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:30.939699 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-8308bd66-f067-422c-b6c3-8197a1a011d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:30.948167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:31.114183 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3879cd-b925-4c1b-bffc-ff56bc3ec4f9 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:31.140374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3879cd-b925-4c1b-bffc-ff56bc3ec4f9 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:31.149096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf777cac-5dd2-43f3-93d2-091a436c723b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:31.149763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf777cac-5dd2-43f3-93d2-091a436c723b service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:31.150045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf777cac-5dd2-43f3-93d2-091a436c723b service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:31.150359 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf777cac-5dd2-43f3-93d2-091a436c723b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:31.160830 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf777cac-5dd2-43f3-93d2-091a436c723b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:31.162958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf777cac-5dd2-43f3-93d2-091a436c723b service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:31.173620 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 754/1516] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:59:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:31.186285 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41850bf8-79f4-48b0-b15d-a6892454e255 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:31.186576 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41850bf8-79f4-48b0-b15d-a6892454e255 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:31.186876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41850bf8-79f4-48b0-b15d-a6892454e255 None None] PATH_INFO: `/v3` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:31.188288 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 763/1517] 10.222.0.59 () {54 vars in 925 bytes} [Tue May 10 13:59:31 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:59:31.194226 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201cacc-baf7-433d-978f-cc3f55f8512f None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:31.194681 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201cacc-baf7-433d-978f-cc3f55f8512f None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:31.194981 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201cacc-baf7-433d-978f-cc3f55f8512f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:31.212722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-1201cacc-baf7-433d-978f-cc3f55f8512f None None] MFA Rules not processed for user `4859a69a988a4b10b67187553d829b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:31.213952 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-1201cacc-baf7-433d-978f-cc3f55f8512f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:31.278735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 755/1518] 10.222.0.59 () {58 vars in 1015 bytes} [Tue May 10 13:59:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:35.186887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c7d75-fea1-441e-b64d-b0f3fd6267cc None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:35.187573 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c7d75-fea1-441e-b64d-b0f3fd6267cc None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:35.187573 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c7d75-fea1-441e-b64d-b0f3fd6267cc None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:35.188946 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 764/1519] 10.222.0.32 () {54 vars in 960 bytes} [Tue May 10 13:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:59:35.194314 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da60d8-69ba-46ec-bc4d-bdcffb4e86a5 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:35.194822 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da60d8-69ba-46ec-bc4d-bdcffb4e86a5 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:35.194915 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da60d8-69ba-46ec-bc4d-bdcffb4e86a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:35.215588 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-04da60d8-69ba-46ec-bc4d-bdcffb4e86a5 None None] MFA Rules not processed for user `4859a69a988a4b10b67187553d829b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:35.216809 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-04da60d8-69ba-46ec-bc4d-bdcffb4e86a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:35.226793 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 756/1520] 10.222.0.32 () {58 vars in 1057 bytes} [Tue May 10 13:59:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:35.235325 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c7d75-fea1-441e-b64d-b0f3fd6267cc None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:35.250034 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c7d75-fea1-441e-b64d-b0f3fd6267cc None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:35.255724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bc8eb-0490-4814-a816-a2cfc985255e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4859a69a988a4b10b67187553d829b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:35.256439 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bc8eb-0490-4814-a816-a2cfc985255e service placement] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:35.257457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bc8eb-0490-4814-a816-a2cfc985255e service placement] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:35.257830 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bc8eb-0490-4814-a816-a2cfc985255e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:35.266726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7bc8eb-0490-4814-a816-a2cfc985255e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:35.269424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7bc8eb-0490-4814-a816-a2cfc985255e service placement] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:35.280855 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 765/1521] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:59:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:42.521390 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90090c1-5852-4ced-b774-471c4c6aa328 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:42.522052 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90090c1-5852-4ced-b774-471c4c6aa328 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:42.522052 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90090c1-5852-4ced-b774-471c4c6aa328 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:42.523833 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:59:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:59:42.528612 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a7f48-20fe-4206-95ea-3e45d956332f None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:42.529043 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a7f48-20fe-4206-95ea-3e45d956332f None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:42.529176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a7f48-20fe-4206-95ea-3e45d956332f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:42.547476 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-757a7f48-20fe-4206-95ea-3e45d956332f None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:42.548657 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-757a7f48-20fe-4206-95ea-3e45d956332f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:42.557420 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:42.706586 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90090c1-5852-4ced-b774-471c4c6aa328 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:42.721264 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90090c1-5852-4ced-b774-471c4c6aa328 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:42.727339 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed2162-2430-45c6-9036-007a5b76d55a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:42.727979 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed2162-2430-45c6-9036-007a5b76d55a service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:42.728259 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed2162-2430-45c6-9036-007a5b76d55a service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:42.728534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed2162-2430-45c6-9036-007a5b76d55a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:42.736962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed2162-2430-45c6-9036-007a5b76d55a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:42.738598 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed2162-2430-45c6-9036-007a5b76d55a service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:42.748388 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 758/1524] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:43.654623 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b442ca-77a2-427d-956c-af2de0d6d66b None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:43.655192 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b442ca-77a2-427d-956c-af2de0d6d66b None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:43.655192 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b442ca-77a2-427d-956c-af2de0d6d66b None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:43.656563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:59:43.661432 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be70358-92a6-4d2b-a52a-e106a04d50b4 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:43.661849 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be70358-92a6-4d2b-a52a-e106a04d50b4 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:43.662088 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be70358-92a6-4d2b-a52a-e106a04d50b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:43.680959 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-3be70358-92a6-4d2b-a52a-e106a04d50b4 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:43.682157 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-3be70358-92a6-4d2b-a52a-e106a04d50b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:43.689883 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:43.842068 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b442ca-77a2-427d-956c-af2de0d6d66b None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:43.856377 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b442ca-77a2-427d-956c-af2de0d6d66b None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:43.861667 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527b473-20d6-4701-a668-4b2610260305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:43.862490 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527b473-20d6-4701-a668-4b2610260305 service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:43.862623 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527b473-20d6-4701-a668-4b2610260305 service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:43.862927 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527b473-20d6-4701-a668-4b2610260305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:43.872649 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527b473-20d6-4701-a668-4b2610260305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:43.874364 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527b473-20d6-4701-a668-4b2610260305 service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:43.885146 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 768/1527] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:59:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:48.042049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824905ce-49eb-4328-99b0-e91dbba80107 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:48.042640 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824905ce-49eb-4328-99b0-e91dbba80107 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:48.042640 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824905ce-49eb-4328-99b0-e91dbba80107 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:48.043999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:59:48.049139 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79489a2a-f56f-4a3f-a3ed-eeae8a6cdc3e None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:48.049576 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79489a2a-f56f-4a3f-a3ed-eeae8a6cdc3e None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:48.049712 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79489a2a-f56f-4a3f-a3ed-eeae8a6cdc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:48.067951 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-79489a2a-f56f-4a3f-a3ed-eeae8a6cdc3e None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:48.069262 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-79489a2a-f56f-4a3f-a3ed-eeae8a6cdc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:48.077101 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:48.113135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824905ce-49eb-4328-99b0-e91dbba80107 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:48.115130 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-824905ce-49eb-4328-99b0-e91dbba80107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:48.170692 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824905ce-49eb-4328-99b0-e91dbba80107 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:48.174239 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f20696-ad2a-4a3b-833c-23574fa47a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:48.174891 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f20696-ad2a-4a3b-833c-23574fa47a82 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:48.175170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f20696-ad2a-4a3b-833c-23574fa47a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:48.175447 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f20696-ad2a-4a3b-833c-23574fa47a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:48.184374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f20696-ad2a-4a3b-833c-23574fa47a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:48.185811 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f20696-ad2a-4a3b-833c-23574fa47a82 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:48.195280 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 761/1530] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:59:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:50.418189 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ffd5b-6522-454a-b5f6-56b66e07ee76 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.418805 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ffd5b-6522-454a-b5f6-56b66e07ee76 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.418805 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ffd5b-6522-454a-b5f6-56b66e07ee76 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.420135 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:59:50.425323 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb5fc1-1392-4d5d-a678-e9f3e91c4005 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.425769 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb5fc1-1392-4d5d-a678-e9f3e91c4005 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.425878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb5fc1-1392-4d5d-a678-e9f3e91c4005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.445376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-01fb5fc1-1392-4d5d-a678-e9f3e91c4005 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:50.446625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-01fb5fc1-1392-4d5d-a678-e9f3e91c4005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:50.454570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:50.489914 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ffd5b-6522-454a-b5f6-56b66e07ee76 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:50.501246 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ffd5b-6522-454a-b5f6-56b66e07ee76 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:50.504726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efd88e-b256-4095-af5b-06d5be2b748d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:50.505360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efd88e-b256-4095-af5b-06d5be2b748d service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.505641 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efd88e-b256-4095-af5b-06d5be2b748d service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.505917 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efd88e-b256-4095-af5b-06d5be2b748d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.515464 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efd88e-b256-4095-af5b-06d5be2b748d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:50.516881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efd88e-b256-4095-af5b-06d5be2b748d service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:50.526489 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 771/1533] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:59:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:54.246461 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2656b1d-2a6b-4c2c-a479-7e88da43121d None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:54.247018 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2656b1d-2a6b-4c2c-a479-7e88da43121d None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:54.247018 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2656b1d-2a6b-4c2c-a479-7e88da43121d None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:54.248371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:59:54.253769 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02d0b4-2a87-4929-9a42-867f8903953c None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:54.254220 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02d0b4-2a87-4929-9a42-867f8903953c None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:54.254446 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02d0b4-2a87-4929-9a42-867f8903953c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:54.273202 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-9d02d0b4-2a87-4929-9a42-867f8903953c None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:54.274430 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-9d02d0b4-2a87-4929-9a42-867f8903953c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:54.282412 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:54.555970 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2656b1d-2a6b-4c2c-a479-7e88da43121d None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:54.557624 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b2656b1d-2a6b-4c2c-a479-7e88da43121d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:54.617911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2656b1d-2a6b-4c2c-a479-7e88da43121d None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:54.621507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca354638-3bc6-407b-902b-34a3ee9e4b9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:54.622154 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca354638-3bc6-407b-902b-34a3ee9e4b9e service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:54.622469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca354638-3bc6-407b-902b-34a3ee9e4b9e service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:54.622740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca354638-3bc6-407b-902b-34a3ee9e4b9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:54.632230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca354638-3bc6-407b-902b-34a3ee9e4b9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:54.633677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca354638-3bc6-407b-902b-34a3ee9e4b9e service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:54.643254 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 764/1536] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:59:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:56.925351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76d57e-2066-4305-a8a4-5c1b5d7d7249 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:56.925906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76d57e-2066-4305-a8a4-5c1b5d7d7249 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:56.925906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76d57e-2066-4305-a8a4-5c1b5d7d7249 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:56.927324 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:59:56.933116 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc8490-e254-4127-897a-8788fba6e8f4 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:56.933564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc8490-e254-4127-897a-8788fba6e8f4 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:56.933659 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc8490-e254-4127-897a-8788fba6e8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:56.952004 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-c5dc8490-e254-4127-897a-8788fba6e8f4 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:56.953208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-c5dc8490-e254-4127-897a-8788fba6e8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:56.961239 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:57.237423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76d57e-2066-4305-a8a4-5c1b5d7d7249 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:57.239137 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-3b76d57e-2066-4305-a8a4-5c1b5d7d7249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:57.253672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76d57e-2066-4305-a8a4-5c1b5d7d7249 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:57.257855 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868744c-4983-40f2-bb20-60883f81f517 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:57.258542 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868744c-4983-40f2-bb20-60883f81f517 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:57.258829 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868744c-4983-40f2-bb20-60883f81f517 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:57.259108 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868744c-4983-40f2-bb20-60883f81f517 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:57.267984 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868744c-4983-40f2-bb20-60883f81f517 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:57.269410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868744c-4983-40f2-bb20-60883f81f517 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:57.278827 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 774/1539] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 13:59:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:29.296273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9daf9-75a1-4d54-b1ba-06dae6e50c51 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:29.297441 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9daf9-75a1-4d54-b1ba-06dae6e50c51 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:29.298007 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9daf9-75a1-4d54-b1ba-06dae6e50c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:29.328217 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-4ff9daf9-75a1-4d54-b1ba-06dae6e50c51 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:29.335503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-4ff9daf9-75a1-4d54-b1ba-06dae6e50c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:29.345021 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 766/1540] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:29.355608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadaaea-a00b-4789-b8a2-ef07d3d3399d None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:29.356218 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadaaea-a00b-4789-b8a2-ef07d3d3399d None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:29.356218 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadaaea-a00b-4789-b8a2-ef07d3d3399d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:29.387420 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-7aadaaea-a00b-4789-b8a2-ef07d3d3399d None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:29.388660 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-7aadaaea-a00b-4789-b8a2-ef07d3d3399d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:29.407131 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 775/1541] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:29.412269 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9daf9-75a1-4d54-b1ba-06dae6e50c51 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:29.427113 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9daf9-75a1-4d54-b1ba-06dae6e50c51 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:29.435391 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8121b5-b657-453a-ad21-7f44a9486796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:29.436586 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8121b5-b657-453a-ad21-7f44a9486796 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:29.437111 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8121b5-b657-453a-ad21-7f44a9486796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:29.437621 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8121b5-b657-453a-ad21-7f44a9486796 admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:29.438640 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8121b5-b657-453a-ad21-7f44a9486796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:29.439154 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8121b5-b657-453a-ad21-7f44a9486796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:29.441218 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8121b5-b657-453a-ad21-7f44a9486796 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:29.460151 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 767/1542] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:01:29.469341 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadaaea-a00b-4789-b8a2-ef07d3d3399d None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:29.484367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadaaea-a00b-4789-b8a2-ef07d3d3399d None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:29.489784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a72225-57fb-4376-bb69-4510d8d2db42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:29.490600 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a72225-57fb-4376-bb69-4510d8d2db42 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:29.491145 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a72225-57fb-4376-bb69-4510d8d2db42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:29.491421 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a72225-57fb-4376-bb69-4510d8d2db42 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:29.492130 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a72225-57fb-4376-bb69-4510d8d2db42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:29.495255 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a72225-57fb-4376-bb69-4510d8d2db42 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:29.538285 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 776/1543] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:01:29 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:01:29.542360 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8121b5-b657-453a-ad21-7f44a9486796 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:29.557526 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8121b5-b657-453a-ad21-7f44a9486796 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:29.642546 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5dd6f4-4ce7-436c-8770-466b07e8405a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:29.643753 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dd6f4-4ce7-436c-8770-466b07e8405a admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:29.644266 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dd6f4-4ce7-436c-8770-466b07e8405a admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:29.644833 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dd6f4-4ce7-436c-8770-466b07e8405a admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:29.646706 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5dd6f4-4ce7-436c-8770-466b07e8405a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:29.649062 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5dd6f4-4ce7-436c-8770-466b07e8405a admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:29.683722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 768/1544] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:01:29 2022] POST /identity/v3/users => generated 285 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:29.688451 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a72225-57fb-4376-bb69-4510d8d2db42 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:29.704503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a72225-57fb-4376-bb69-4510d8d2db42 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:29.713452 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccaf0e-5c37-4f23-995f-53c00d2f07c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:29.714071 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccaf0e-5c37-4f23-995f-53c00d2f07c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:29.714379 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccaf0e-5c37-4f23-995f-53c00d2f07c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:29.714654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccaf0e-5c37-4f23-995f-53c00d2f07c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:29.715387 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccaf0e-5c37-4f23-995f-53c00d2f07c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:29.717506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccaf0e-5c37-4f23-995f-53c00d2f07c6 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:29.738307 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 777/1545] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:29.742676 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5dd6f4-4ce7-436c-8770-466b07e8405a admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:29.758469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5dd6f4-4ce7-436c-8770-466b07e8405a admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:29.766954 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfa89b-4f7e-49e1-93e3-ce6c7c32619b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:29.767981 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfa89b-4f7e-49e1-93e3-ce6c7c32619b admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:29.768489 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfa89b-4f7e-49e1-93e3-ce6c7c32619b admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:29.769017 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfa89b-4f7e-49e1-93e3-ce6c7c32619b admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:29.769969 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfa89b-4f7e-49e1-93e3-ce6c7c32619b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:29.772536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfa89b-4f7e-49e1-93e3-ce6c7c32619b admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:29.788619 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 769/1546] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:29.792378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccaf0e-5c37-4f23-995f-53c00d2f07c6 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:29.817986 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccaf0e-5c37-4f23-995f-53c00d2f07c6 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:29.831324 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e23c1e-7571-4f53-842c-eeebf6ed5d6c None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:29.832194 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e23c1e-7571-4f53-842c-eeebf6ed5d6c None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:29.832708 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e23c1e-7571-4f53-842c-eeebf6ed5d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:29.837988 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aec2ad-fc63-49d3-85d8-174ad20054c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:29.837988 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aec2ad-fc63-49d3-85d8-174ad20054c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:29.837988 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aec2ad-fc63-49d3-85d8-174ad20054c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:29.837988 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aec2ad-fc63-49d3-85d8-174ad20054c0 admin admin] PATH_INFO: `/v3/projects/4f5468859afd431c89cb34c8957d60dd/users/bb7cdb21321c4ca49c3d273a2439a928/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:29.870597 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aec2ad-fc63-49d3-85d8-174ad20054c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f5468859afd431c89cb34c8957d60dd, user_id=bb7cdb21321c4ca49c3d273a2439a928, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:29.873282 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aec2ad-fc63-49d3-85d8-174ad20054c0 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:29.881181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-c1e23c1e-7571-4f53-842c-eeebf6ed5d6c None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:29.883198 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-c1e23c1e-7571-4f53-842c-eeebf6ed5d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:29.897930 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 778/1547] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:29 2022] PUT /identity/v3/projects/4f5468859afd431c89cb34c8957d60dd/users/bb7cdb21321c4ca49c3d273a2439a928/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:29.901613 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 770/1548] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:29.910642 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab616ad-1a10-4c2e-9bca-fcbaa250e689 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:29.911541 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab616ad-1a10-4c2e-9bca-fcbaa250e689 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:29.911847 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab616ad-1a10-4c2e-9bca-fcbaa250e689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:29.915575 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e10708-affb-4cf5-8e53-5457a305a061 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:29.916151 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e10708-affb-4cf5-8e53-5457a305a061 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:29.916629 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e10708-affb-4cf5-8e53-5457a305a061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:29.946970 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-eab616ad-1a10-4c2e-9bca-fcbaa250e689 None None] MFA Rules not processed for user `bb7cdb21321c4ca49c3d273a2439a928`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:29.948219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-eab616ad-1a10-4c2e-9bca-fcbaa250e689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:29.948580 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-e3e10708-affb-4cf5-8e53-5457a305a061 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:29.950000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-e3e10708-affb-4cf5-8e53-5457a305a061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:30.035058 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 771/1549] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:01:30.036783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4858d-35c8-436e-98b2-ed1c8148e1a8 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.037273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4858d-35c8-436e-98b2-ed1c8148e1a8 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.037715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4858d-35c8-436e-98b2-ed1c8148e1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.041739 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 779/1550] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:30.041739 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd9e4e-8bab-4718-9730-20a36af7a1b7 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.046434 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd9e4e-8bab-4718-9730-20a36af7a1b7 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.047707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd9e4e-8bab-4718-9730-20a36af7a1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.081248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-a7b4858d-35c8-436e-98b2-ed1c8148e1a8 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:30.081248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a7b4858d-35c8-436e-98b2-ed1c8148e1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:30.090824 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 772/1551] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:30.091700 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4858d-35c8-436e-98b2-ed1c8148e1a8 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:30.093391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-79bd9e4e-8bab-4718-9730-20a36af7a1b7 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:30.096215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-79bd9e4e-8bab-4718-9730-20a36af7a1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:30.103094 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4858d-35c8-436e-98b2-ed1c8148e1a8 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.118077 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba9dbb-d2b8-4c35-858a-38dc94ad4442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.119266 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba9dbb-d2b8-4c35-858a-38dc94ad4442 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.119615 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 780/1552] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:30.119882 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba9dbb-d2b8-4c35-858a-38dc94ad4442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.120169 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba9dbb-d2b8-4c35-858a-38dc94ad4442 admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.121730 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba9dbb-d2b8-4c35-858a-38dc94ad4442 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:30.122073 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89986301-05ef-4809-b0bf-1ce5c5ef0b2f None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.122358 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba9dbb-d2b8-4c35-858a-38dc94ad4442 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.123390 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89986301-05ef-4809-b0bf-1ce5c5ef0b2f None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.123902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89986301-05ef-4809-b0bf-1ce5c5ef0b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.124136 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba9dbb-d2b8-4c35-858a-38dc94ad4442 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:30.138976 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 773/1553] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:01:30.140375 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f86bd-b0ab-4565-b395-4fd212eacb46 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.140661 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f86bd-b0ab-4565-b395-4fd212eacb46 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.140941 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f86bd-b0ab-4565-b395-4fd212eacb46 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.148219 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 774/1554] 10.222.0.32 () {54 vars in 961 bytes} [Tue May 10 14:01:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:01:30.149981 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a201cdf-3d96-4919-ab66-ecbd1ae9c550 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.150298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a201cdf-3d96-4919-ab66-ecbd1ae9c550 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.150618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a201cdf-3d96-4919-ab66-ecbd1ae9c550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.151539 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-89986301-05ef-4809-b0bf-1ce5c5ef0b2f None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:30.153053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-89986301-05ef-4809-b0bf-1ce5c5ef0b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:30.164052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 781/1555] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:30.165941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076cc42-e7ef-40f4-9fcd-51d101b75284 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.166560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076cc42-e7ef-40f4-9fcd-51d101b75284 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.167397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076cc42-e7ef-40f4-9fcd-51d101b75284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.173290 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-5a201cdf-3d96-4919-ab66-ecbd1ae9c550 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:30.174555 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-5a201cdf-3d96-4919-ab66-ecbd1ae9c550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:30.190074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 775/1556] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:30.191332 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a201cdf-3d96-4919-ab66-ecbd1ae9c550 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:30.196135 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-1076cc42-e7ef-40f4-9fcd-51d101b75284 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:30.197531 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-1076cc42-e7ef-40f4-9fcd-51d101b75284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:30.203455 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a201cdf-3d96-4919-ab66-ecbd1ae9c550 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.214088 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 782/1557] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:30.214344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f2892-6321-4eda-b323-ed8c45c25cfc None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.214670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f2892-6321-4eda-b323-ed8c45c25cfc None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.214838 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f2892-6321-4eda-b323-ed8c45c25cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.217237 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfcfa3-322f-46e6-a1db-030d0a3a0916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.218347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfcfa3-322f-46e6-a1db-030d0a3a0916 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.218860 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfcfa3-322f-46e6-a1db-030d0a3a0916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.219598 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfcfa3-322f-46e6-a1db-030d0a3a0916 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.220490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfcfa3-322f-46e6-a1db-030d0a3a0916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.221961 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: WARNING py.warnings [None req-7ebfcfa3-322f-46e6-a1db-030d0a3a0916 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 14:01:30.221961 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: warnings.warn(msg) May 10 14:01:30.221961 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: May 10 14:01:30.224711 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfcfa3-322f-46e6-a1db-030d0a3a0916 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:30.235633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-e95f2892-6321-4eda-b323-ed8c45c25cfc None None] MFA Rules not processed for user `e5d4fd26c21f4170a6790369344f8334`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:30.236874 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-e95f2892-6321-4eda-b323-ed8c45c25cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:30.253134 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 776/1558] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:01:30 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:30.258599 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd41ce-9297-420e-857d-8cd07aad065d None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.258599 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd41ce-9297-420e-857d-8cd07aad065d None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.258599 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd41ce-9297-420e-857d-8cd07aad065d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.280108 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-3ffd41ce-9297-420e-857d-8cd07aad065d None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:30.281481 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-3ffd41ce-9297-420e-857d-8cd07aad065d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:30.320075 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 783/1559] 10.222.0.32 () {58 vars in 1058 bytes} [Tue May 10 14:01:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:30.321425 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751ecf7-175a-4502-9b2b-2733580364c9 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.321720 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751ecf7-175a-4502-9b2b-2733580364c9 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.322003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751ecf7-175a-4502-9b2b-2733580364c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.341487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-b751ecf7-175a-4502-9b2b-2733580364c9 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:30.342739 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-b751ecf7-175a-4502-9b2b-2733580364c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:30.347217 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 777/1560] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:30.347880 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd41ce-9297-420e-857d-8cd07aad065d None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:30.353231 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 784/1561] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:30.354220 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751ecf7-175a-4502-9b2b-2733580364c9 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:30.357695 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd41ce-9297-420e-857d-8cd07aad065d None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.363167 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381c36e-7d06-44e1-bf88-84faa1754076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.363838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381c36e-7d06-44e1-bf88-84faa1754076 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.363965 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751ecf7-175a-4502-9b2b-2733580364c9 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.364493 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381c36e-7d06-44e1-bf88-84faa1754076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.364493 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381c36e-7d06-44e1-bf88-84faa1754076 admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.365168 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381c36e-7d06-44e1-bf88-84faa1754076 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:30.365474 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381c36e-7d06-44e1-bf88-84faa1754076 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.367350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381c36e-7d06-44e1-bf88-84faa1754076 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:30.370183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35001513-82a3-4caf-97de-1a181a81d323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.370357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35001513-82a3-4caf-97de-1a181a81d323 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.370675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35001513-82a3-4caf-97de-1a181a81d323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.370956 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35001513-82a3-4caf-97de-1a181a81d323 admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.371687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35001513-82a3-4caf-97de-1a181a81d323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:30.371995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35001513-82a3-4caf-97de-1a181a81d323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.373008 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: WARNING py.warnings [None req-35001513-82a3-4caf-97de-1a181a81d323 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 14:01:30.373008 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: warnings.warn(msg) May 10 14:01:30.373008 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: May 10 14:01:30.373890 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35001513-82a3-4caf-97de-1a181a81d323 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:30.379237 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 778/1562] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:01:30.381220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da45ea-79ba-43db-b360-0173c44a72f8 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.381511 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da45ea-79ba-43db-b360-0173c44a72f8 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.381792 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da45ea-79ba-43db-b360-0173c44a72f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.392057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 785/1563] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:01:30.392935 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35001513-82a3-4caf-97de-1a181a81d323 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:30.401498 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-47da45ea-79ba-43db-b360-0173c44a72f8 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:30.402736 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-47da45ea-79ba-43db-b360-0173c44a72f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:30.403068 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35001513-82a3-4caf-97de-1a181a81d323 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.407474 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8f4f4-6ba7-4e39-be35-eff8235391b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.408158 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8f4f4-6ba7-4e39-be35-eff8235391b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.408439 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8f4f4-6ba7-4e39-be35-eff8235391b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.408713 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8f4f4-6ba7-4e39-be35-eff8235391b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.409385 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8f4f4-6ba7-4e39-be35-eff8235391b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.410415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: WARNING py.warnings [None req-82b8f4f4-6ba7-4e39-be35-eff8235391b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 14:01:30.410415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: warnings.warn(msg) May 10 14:01:30.410415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: May 10 14:01:30.410681 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 779/1564] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:30.412566 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8f4f4-6ba7-4e39-be35-eff8235391b1 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:30.412697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f681075-766e-4b53-9e54-f6d10c16ad69 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.412962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f681075-766e-4b53-9e54-f6d10c16ad69 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.413352 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f681075-766e-4b53-9e54-f6d10c16ad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.431705 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-0f681075-766e-4b53-9e54-f6d10c16ad69 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:30.432899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-0f681075-766e-4b53-9e54-f6d10c16ad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:30.434445 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 786/1565] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:01:30 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:30.435087 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8f4f4-6ba7-4e39-be35-eff8235391b1 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:30.441019 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 780/1566] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:30.441732 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f681075-766e-4b53-9e54-f6d10c16ad69 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:30.451644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f681075-766e-4b53-9e54-f6d10c16ad69 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.456294 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0c6fb-3493-4df5-a9a0-bfddaae78503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.456955 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0c6fb-3493-4df5-a9a0-bfddaae78503 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.457235 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0c6fb-3493-4df5-a9a0-bfddaae78503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.457507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0c6fb-3493-4df5-a9a0-bfddaae78503 admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.459271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0c6fb-3493-4df5-a9a0-bfddaae78503 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:30.459411 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0c6fb-3493-4df5-a9a0-bfddaae78503 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.460911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0c6fb-3493-4df5-a9a0-bfddaae78503 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:30.472463 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 781/1567] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:01:30.473632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bee242-4e35-45bd-9287-e5e19bf72646 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.474864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bee242-4e35-45bd-9287-e5e19bf72646 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.474864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bee242-4e35-45bd-9287-e5e19bf72646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.493227 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-a3bee242-4e35-45bd-9287-e5e19bf72646 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:30.494381 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a3bee242-4e35-45bd-9287-e5e19bf72646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:30.502225 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 782/1568] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:30.502979 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bee242-4e35-45bd-9287-e5e19bf72646 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:30.512047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bee242-4e35-45bd-9287-e5e19bf72646 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.515090 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8f4f4-6ba7-4e39-be35-eff8235391b1 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.516536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687eacd-4df4-4772-991d-e21275d1c4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.517165 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687eacd-4df4-4772-991d-e21275d1c4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.517443 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687eacd-4df4-4772-991d-e21275d1c4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.517715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687eacd-4df4-4772-991d-e21275d1c4e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.518430 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687eacd-4df4-4772-991d-e21275d1c4e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.520310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687eacd-4df4-4772-991d-e21275d1c4e8 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:30.521606 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af89419-1d86-49a0-88c5-89562823c19b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.522559 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af89419-1d86-49a0-88c5-89562823c19b service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.522846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af89419-1d86-49a0-88c5-89562823c19b service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.523125 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af89419-1d86-49a0-88c5-89562823c19b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.549371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 783/1569] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:01:30 2022] POST /identity/v3/projects => generated 367 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:30.549371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687eacd-4df4-4772-991d-e21275d1c4e8 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:30.581401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af89419-1d86-49a0-88c5-89562823c19b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.583107 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af89419-1d86-49a0-88c5-89562823c19b service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:30.591944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 787/1570] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:30 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:30.593210 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648619bb-d465-415a-a409-b9e2455d8107 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.593505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648619bb-d465-415a-a409-b9e2455d8107 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.593778 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648619bb-d465-415a-a409-b9e2455d8107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.610962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687eacd-4df4-4772-991d-e21275d1c4e8 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.612843 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-648619bb-d465-415a-a409-b9e2455d8107 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:30.614796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-648619bb-d465-415a-a409-b9e2455d8107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:30.617088 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dd521-d698-4920-b721-d28f7528ba32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.617788 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dd521-d698-4920-b721-d28f7528ba32 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.618030 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dd521-d698-4920-b721-d28f7528ba32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.618333 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dd521-d698-4920-b721-d28f7528ba32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.619021 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5dd521-d698-4920-b721-d28f7528ba32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.621049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5dd521-d698-4920-b721-d28f7528ba32 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:30.623758 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 788/1571] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:30.624466 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648619bb-d465-415a-a409-b9e2455d8107 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:30.637493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648619bb-d465-415a-a409-b9e2455d8107 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.642554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5538b64-0dab-40bb-8553-fc1ae31fcd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.643322 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5538b64-0dab-40bb-8553-fc1ae31fcd0a admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.643607 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5538b64-0dab-40bb-8553-fc1ae31fcd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.643874 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5538b64-0dab-40bb-8553-fc1ae31fcd0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.644904 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5538b64-0dab-40bb-8553-fc1ae31fcd0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.646841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5538b64-0dab-40bb-8553-fc1ae31fcd0a admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:30.654854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 784/1572] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:01:30 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:30.654854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99498da6-4637-4fc0-9faf-6a37b133cc2d None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.654854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99498da6-4637-4fc0-9faf-6a37b133cc2d None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.654854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99498da6-4637-4fc0-9faf-6a37b133cc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.660764 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 789/1573] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:30.662164 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5538b64-0dab-40bb-8553-fc1ae31fcd0a admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:30.672260 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5538b64-0dab-40bb-8553-fc1ae31fcd0a admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.674100 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-99498da6-4637-4fc0-9faf-6a37b133cc2d None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:30.675323 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-99498da6-4637-4fc0-9faf-6a37b133cc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:30.728840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59651edf-1245-4372-8ab9-ec245d01e1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.729567 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59651edf-1245-4372-8ab9-ec245d01e1ff admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.729854 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59651edf-1245-4372-8ab9-ec245d01e1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.730128 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59651edf-1245-4372-8ab9-ec245d01e1ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.730883 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59651edf-1245-4372-8ab9-ec245d01e1ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.732841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59651edf-1245-4372-8ab9-ec245d01e1ff admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:30.738242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 785/1574] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:30.739535 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99498da6-4637-4fc0-9faf-6a37b133cc2d None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:30.750945 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99498da6-4637-4fc0-9faf-6a37b133cc2d None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.756666 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac0aad-fd0c-4893-81d6-8c87d81edcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.757407 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac0aad-fd0c-4893-81d6-8c87d81edcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.757732 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac0aad-fd0c-4893-81d6-8c87d81edcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.758158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac0aad-fd0c-4893-81d6-8c87d81edcc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.759109 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac0aad-fd0c-4893-81d6-8c87d81edcc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:30.759482 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac0aad-fd0c-4893-81d6-8c87d81edcc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.761116 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac0aad-fd0c-4893-81d6-8c87d81edcc8 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:30.772640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 790/1575] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:01:30 2022] POST /identity/v3/projects => generated 393 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:30.773726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59651edf-1245-4372-8ab9-ec245d01e1ff admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:30.778840 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 786/1576] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:01:30.780052 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac0aad-fd0c-4893-81d6-8c87d81edcc8 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:30.792023 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac0aad-fd0c-4893-81d6-8c87d81edcc8 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.849634 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59651edf-1245-4372-8ab9-ec245d01e1ff admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.854855 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eafe0e-de5e-4682-ac80-1683066a0bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.855541 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eafe0e-de5e-4682-ac80-1683066a0bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.855827 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eafe0e-de5e-4682-ac80-1683066a0bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.856108 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eafe0e-de5e-4682-ac80-1683066a0bf2 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.856797 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eafe0e-de5e-4682-ac80-1683066a0bf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.858762 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eafe0e-de5e-4682-ac80-1683066a0bf2 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:30.864914 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74ca93-9ce3-4e4e-b3e6-b902ba881513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.865442 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74ca93-9ce3-4e4e-b3e6-b902ba881513 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.866129 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74ca93-9ce3-4e4e-b3e6-b902ba881513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.866441 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74ca93-9ce3-4e4e-b3e6-b902ba881513 admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.867207 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74ca93-9ce3-4e4e-b3e6-b902ba881513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:30.867514 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74ca93-9ce3-4e4e-b3e6-b902ba881513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.869141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74ca93-9ce3-4e4e-b3e6-b902ba881513 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:30.882447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 791/1577] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:01:30 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:30.882447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eafe0e-de5e-4682-ac80-1683066a0bf2 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:30.890358 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 787/1578] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:01:30.890358 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74ca93-9ce3-4e4e-b3e6-b902ba881513 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:30.890595 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eafe0e-de5e-4682-ac80-1683066a0bf2 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.895228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b191a4-519a-4084-a81e-5de27c0e9c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.897221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b191a4-519a-4084-a81e-5de27c0e9c3a admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.897508 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b191a4-519a-4084-a81e-5de27c0e9c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.897786 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b191a4-519a-4084-a81e-5de27c0e9c3a admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.898511 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b191a4-519a-4084-a81e-5de27c0e9c3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.900426 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b191a4-519a-4084-a81e-5de27c0e9c3a admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:30.900543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74ca93-9ce3-4e4e-b3e6-b902ba881513 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.905340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43563ff-ecd3-4538-85c5-3abe8bce4129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.906009 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43563ff-ecd3-4538-85c5-3abe8bce4129 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.906339 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43563ff-ecd3-4538-85c5-3abe8bce4129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.906642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43563ff-ecd3-4538-85c5-3abe8bce4129 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.907373 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43563ff-ecd3-4538-85c5-3abe8bce4129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.909013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43563ff-ecd3-4538-85c5-3abe8bce4129 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:30.920124 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 792/1579] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:01:30 2022] POST /identity/v3/users => generated 285 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:30.923591 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 788/1580] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:30.923591 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43563ff-ecd3-4538-85c5-3abe8bce4129 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:30.923862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b191a4-519a-4084-a81e-5de27c0e9c3a admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:30.932864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43563ff-ecd3-4538-85c5-3abe8bce4129 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.933025 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b191a4-519a-4084-a81e-5de27c0e9c3a admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.937406 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3c9b0-0321-438e-9064-155ba08581b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.938044 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8024366-b132-4eb4-967f-f959700baa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.938183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3c9b0-0321-438e-9064-155ba08581b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.938424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3c9b0-0321-438e-9064-155ba08581b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.938645 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3c9b0-0321-438e-9064-155ba08581b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.938768 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8024366-b132-4eb4-967f-f959700baa82 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.939026 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8024366-b132-4eb4-967f-f959700baa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.939297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8024366-b132-4eb4-967f-f959700baa82 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.939406 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3c9b0-0321-438e-9064-155ba08581b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:30.939659 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3c9b0-0321-438e-9064-155ba08581b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.939980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8024366-b132-4eb4-967f-f959700baa82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.941285 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3c9b0-0321-438e-9064-155ba08581b0 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:30.941968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8024366-b132-4eb4-967f-f959700baa82 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:30.955297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 793/1581] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:01:30.956101 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3c9b0-0321-438e-9064-155ba08581b0 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:30.965462 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 789/1582] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:01:30 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:30.965462 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702469e-89dc-49e2-8b22-81d75813ba47 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.965462 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702469e-89dc-49e2-8b22-81d75813ba47 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.965462 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702469e-89dc-49e2-8b22-81d75813ba47 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.966549 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 790/1583] 10.222.0.32 () {54 vars in 912 bytes} [Tue May 10 14:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:01:30.971369 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702469e-89dc-49e2-8b22-81d75813ba47 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:30.971496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3c9b0-0321-438e-9064-155ba08581b0 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.976455 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f6eed-436e-4def-aa0c-9ae2349dbd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.977118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f6eed-436e-4def-aa0c-9ae2349dbd0f admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.977400 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f6eed-436e-4def-aa0c-9ae2349dbd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.977726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f6eed-436e-4def-aa0c-9ae2349dbd0f admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.979103 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f6eed-436e-4def-aa0c-9ae2349dbd0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.981027 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f6eed-436e-4def-aa0c-9ae2349dbd0f admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:30.983404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702469e-89dc-49e2-8b22-81d75813ba47 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.987752 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9e3f3-8ebc-4475-8b5d-c7152af3d36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.988511 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9e3f3-8ebc-4475-8b5d-c7152af3d36b admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.988789 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9e3f3-8ebc-4475-8b5d-c7152af3d36b admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.989057 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9e3f3-8ebc-4475-8b5d-c7152af3d36b admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.989777 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9e3f3-8ebc-4475-8b5d-c7152af3d36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.991629 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9e3f3-8ebc-4475-8b5d-c7152af3d36b admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.001966 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 791/1584] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:31.002799 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9e3f3-8ebc-4475-8b5d-c7152af3d36b admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.013537 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 794/1585] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:01:30 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:31.013537 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f6eed-436e-4def-aa0c-9ae2349dbd0f admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.013802 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9e3f3-8ebc-4475-8b5d-c7152af3d36b admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.072163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb5004-637c-4c89-b980-71e5293e942a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.072839 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb5004-637c-4c89-b980-71e5293e942a admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.073118 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb5004-637c-4c89-b980-71e5293e942a admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.073391 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb5004-637c-4c89-b980-71e5293e942a admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.074084 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb5004-637c-4c89-b980-71e5293e942a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.076061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb5004-637c-4c89-b980-71e5293e942a admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.080099 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f6eed-436e-4def-aa0c-9ae2349dbd0f admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.085869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74691158-8a91-445d-a5da-59fa22a62681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.086585 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74691158-8a91-445d-a5da-59fa22a62681 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.086869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74691158-8a91-445d-a5da-59fa22a62681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.087177 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74691158-8a91-445d-a5da-59fa22a62681 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.087944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74691158-8a91-445d-a5da-59fa22a62681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.089540 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74691158-8a91-445d-a5da-59fa22a62681 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.102072 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 795/1586] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:31.103084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74691158-8a91-445d-a5da-59fa22a62681 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.108628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 792/1587] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:01:31 2022] POST /identity/v3/projects => generated 403 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:31.109432 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb5004-637c-4c89-b980-71e5293e942a admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.116210 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74691158-8a91-445d-a5da-59fa22a62681 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.181642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb5004-637c-4c89-b980-71e5293e942a admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.188173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97a85d-d994-4fcd-b2b5-5486dbe6a0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.189029 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97a85d-d994-4fcd-b2b5-5486dbe6a0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.189390 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97a85d-d994-4fcd-b2b5-5486dbe6a0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.189873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97a85d-d994-4fcd-b2b5-5486dbe6a0a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.190252 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd364e6-f420-467b-b7a4-2c37b7260f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.190711 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97a85d-d994-4fcd-b2b5-5486dbe6a0a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.191146 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd364e6-f420-467b-b7a4-2c37b7260f23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.191428 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd364e6-f420-467b-b7a4-2c37b7260f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.191702 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd364e6-f420-467b-b7a4-2c37b7260f23 admin admin] PATH_INFO: `/v3/projects/db378765a65d4ed59cf60275bc325525/users/f57a715b890443d78579a056f0a9ff51/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.193571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97a85d-d994-4fcd-b2b5-5486dbe6a0a4 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.206439 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd364e6-f420-467b-b7a4-2c37b7260f23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db378765a65d4ed59cf60275bc325525, user_id=f57a715b890443d78579a056f0a9ff51, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.210028 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd364e6-f420-467b-b7a4-2c37b7260f23 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.220970 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 793/1588] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:01:31 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:31.221868 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97a85d-d994-4fcd-b2b5-5486dbe6a0a4 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.222820 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 796/1589] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:31 2022] PUT /identity/v3/projects/db378765a65d4ed59cf60275bc325525/users/f57a715b890443d78579a056f0a9ff51/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:31.224927 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d728e-47f8-4643-88ec-905bccd9c0b3 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.225216 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d728e-47f8-4643-88ec-905bccd9c0b3 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.225490 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d728e-47f8-4643-88ec-905bccd9c0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.244538 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-ef7d728e-47f8-4643-88ec-905bccd9c0b3 None None] MFA Rules not processed for user `e5d4fd26c21f4170a6790369344f8334`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:31.245749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-ef7d728e-47f8-4643-88ec-905bccd9c0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:31.287807 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97a85d-d994-4fcd-b2b5-5486dbe6a0a4 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.292376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442dea35-25a5-45c8-900f-ad252719b858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.293049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dea35-25a5-45c8-900f-ad252719b858 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.293329 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dea35-25a5-45c8-900f-ad252719b858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.293607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dea35-25a5-45c8-900f-ad252719b858 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.294365 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442dea35-25a5-45c8-900f-ad252719b858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.296090 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442dea35-25a5-45c8-900f-ad252719b858 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.306822 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 794/1590] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:31.306822 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442dea35-25a5-45c8-900f-ad252719b858 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.312894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 797/1591] 10.222.0.32 () {58 vars in 1009 bytes} [Tue May 10 14:01:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:31.313702 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d728e-47f8-4643-88ec-905bccd9c0b3 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.321540 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442dea35-25a5-45c8-900f-ad252719b858 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.325252 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d728e-47f8-4643-88ec-905bccd9c0b3 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.326266 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338abe3e-ffac-4674-b346-bf82643fa8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.327184 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338abe3e-ffac-4674-b346-bf82643fa8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.327635 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338abe3e-ffac-4674-b346-bf82643fa8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.327916 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338abe3e-ffac-4674-b346-bf82643fa8a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.328648 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338abe3e-ffac-4674-b346-bf82643fa8a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.330260 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338abe3e-ffac-4674-b346-bf82643fa8a6 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.330525 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e916f-f9dc-4190-9ef1-9796a4208ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.331199 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e916f-f9dc-4190-9ef1-9796a4208ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.331488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e916f-f9dc-4190-9ef1-9796a4208ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.331764 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e916f-f9dc-4190-9ef1-9796a4208ce2 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.332454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e916f-f9dc-4190-9ef1-9796a4208ce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.335015 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e916f-f9dc-4190-9ef1-9796a4208ce2 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.344261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 795/1592] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:31.344261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338abe3e-ffac-4674-b346-bf82643fa8a6 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.351662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338abe3e-ffac-4674-b346-bf82643fa8a6 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.359387 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 798/1593] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:01:31 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:31.359543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c83abc-fc1b-44ba-9ae3-fbadc03dd76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.359665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e916f-f9dc-4190-9ef1-9796a4208ce2 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.359746 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c83abc-fc1b-44ba-9ae3-fbadc03dd76d admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.359746 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c83abc-fc1b-44ba-9ae3-fbadc03dd76d admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.359746 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c83abc-fc1b-44ba-9ae3-fbadc03dd76d admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.359746 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c83abc-fc1b-44ba-9ae3-fbadc03dd76d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.360023 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c83abc-fc1b-44ba-9ae3-fbadc03dd76d admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.367681 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e916f-f9dc-4190-9ef1-9796a4208ce2 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.373845 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 796/1594] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:31.373845 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c83abc-fc1b-44ba-9ae3-fbadc03dd76d admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.376202 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d12c81-2e09-46b6-bd6a-2df89cb38103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.377101 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d12c81-2e09-46b6-bd6a-2df89cb38103 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.377386 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d12c81-2e09-46b6-bd6a-2df89cb38103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.377661 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d12c81-2e09-46b6-bd6a-2df89cb38103 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.378401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d12c81-2e09-46b6-bd6a-2df89cb38103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.381085 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d12c81-2e09-46b6-bd6a-2df89cb38103 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.381861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c83abc-fc1b-44ba-9ae3-fbadc03dd76d admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.386493 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d29121-4d17-4162-82f3-92074c4bd09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.387143 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d29121-4d17-4162-82f3-92074c4bd09e admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.387425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d29121-4d17-4162-82f3-92074c4bd09e admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.387699 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d29121-4d17-4162-82f3-92074c4bd09e admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.388376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d29121-4d17-4162-82f3-92074c4bd09e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.390354 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d29121-4d17-4162-82f3-92074c4bd09e admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.402399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 799/1595] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:01:31 2022] POST /identity/v3/users => generated 302 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:31.403774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3e3a9-2e8b-4671-b326-81ac0cfde30b None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.404251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3e3a9-2e8b-4671-b326-81ac0cfde30b None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.404488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3e3a9-2e8b-4671-b326-81ac0cfde30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.413450 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 797/1596] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:01:31 2022] POST /identity/v3/users => generated 292 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:31.414540 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d29121-4d17-4162-82f3-92074c4bd09e admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.423875 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-2db3e3a9-2e8b-4671-b326-81ac0cfde30b None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:31.424065 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d29121-4d17-4162-82f3-92074c4bd09e admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.425273 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-2db3e3a9-2e8b-4671-b326-81ac0cfde30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:31.429419 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4884472-5ea3-4d8e-bae3-592ca2188cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.430098 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4884472-5ea3-4d8e-bae3-592ca2188cbe admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.430411 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4884472-5ea3-4d8e-bae3-592ca2188cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.430690 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4884472-5ea3-4d8e-bae3-592ca2188cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.431452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4884472-5ea3-4d8e-bae3-592ca2188cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.433084 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4884472-5ea3-4d8e-bae3-592ca2188cbe admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.434626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 800/1597] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:31.435249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3e3a9-2e8b-4671-b326-81ac0cfde30b None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.447948 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 798/1598] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:31.448821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4884472-5ea3-4d8e-bae3-592ca2188cbe admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.458384 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4884472-5ea3-4d8e-bae3-592ca2188cbe admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.462965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20a281-ba61-48ce-92b3-a14c04898bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.463843 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20a281-ba61-48ce-92b3-a14c04898bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.464124 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20a281-ba61-48ce-92b3-a14c04898bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.464398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20a281-ba61-48ce-92b3-a14c04898bc6 admin admin] PATH_INFO: `/v3/projects/435c45880e46461bb8d4c7de37658929/users/a4118c10f3b842919b5e615300c485be/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.480221 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20a281-ba61-48ce-92b3-a14c04898bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=435c45880e46461bb8d4c7de37658929, user_id=a4118c10f3b842919b5e615300c485be, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.481259 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: WARNING py.warnings [None req-2f20a281-ba61-48ce-92b3-a14c04898bc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 14:01:31.481259 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: warnings.warn(msg) May 10 14:01:31.481259 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: May 10 14:01:31.483238 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20a281-ba61-48ce-92b3-a14c04898bc6 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.492466 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3e3a9-2e8b-4671-b326-81ac0cfde30b None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.497152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 799/1599] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:31 2022] PUT /identity/v3/projects/435c45880e46461bb8d4c7de37658929/users/a4118c10f3b842919b5e615300c485be/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:31.497952 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20a281-ba61-48ce-92b3-a14c04898bc6 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.542807 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd6c45-6be7-488f-a472-5b4105b48c84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.543472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd6c45-6be7-488f-a472-5b4105b48c84 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.543758 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd6c45-6be7-488f-a472-5b4105b48c84 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.544033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd6c45-6be7-488f-a472-5b4105b48c84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.559944 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20a281-ba61-48ce-92b3-a14c04898bc6 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.564676 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e253e9c-4f20-4ed9-be88-abf03969fcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.565335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e253e9c-4f20-4ed9-be88-abf03969fcc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.565620 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e253e9c-4f20-4ed9-be88-abf03969fcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.565896 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e253e9c-4f20-4ed9-be88-abf03969fcc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.566662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e253e9c-4f20-4ed9-be88-abf03969fcc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.568687 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e253e9c-4f20-4ed9-be88-abf03969fcc7 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.579572 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 800/1600] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:31.580631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e253e9c-4f20-4ed9-be88-abf03969fcc7 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.590585 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e253e9c-4f20-4ed9-be88-abf03969fcc7 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.595222 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c539aba-e970-4dda-bb15-c173aa135b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.596088 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c539aba-e970-4dda-bb15-c173aa135b65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.596364 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c539aba-e970-4dda-bb15-c173aa135b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.596633 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c539aba-e970-4dda-bb15-c173aa135b65 admin admin] PATH_INFO: `/v3/projects/c0efd7196e024bd99c85176bb72e2bc8/users/8cc78c5c9afe4116a659a6b352f2620c/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.611183 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c539aba-e970-4dda-bb15-c173aa135b65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0efd7196e024bd99c85176bb72e2bc8, user_id=8cc78c5c9afe4116a659a6b352f2620c, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.611972 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd6c45-6be7-488f-a472-5b4105b48c84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.613446 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd6c45-6be7-488f-a472-5b4105b48c84 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.613774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c539aba-e970-4dda-bb15-c173aa135b65 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.625462 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 801/1601] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:31.626303 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd6c45-6be7-488f-a472-5b4105b48c84 service cinder] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.627513 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 801/1602] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:31 2022] PUT /identity/v3/projects/c0efd7196e024bd99c85176bb72e2bc8/users/8cc78c5c9afe4116a659a6b352f2620c/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:31.632938 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c539aba-e970-4dda-bb15-c173aa135b65 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.643435 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd6c45-6be7-488f-a472-5b4105b48c84 service cinder] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.701100 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c539aba-e970-4dda-bb15-c173aa135b65 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.702476 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffad5a-852c-402c-b8cd-937448c9ab39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.703231 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffad5a-852c-402c-b8cd-937448c9ab39 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.703591 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffad5a-852c-402c-b8cd-937448c9ab39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.703930 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffad5a-852c-402c-b8cd-937448c9ab39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.704807 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffad5a-852c-402c-b8cd-937448c9ab39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.706126 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0fcc2-3d91-4d31-b96f-2f00c1a5671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.706571 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffad5a-852c-402c-b8cd-937448c9ab39 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.706994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0fcc2-3d91-4d31-b96f-2f00c1a5671a admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.707340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0fcc2-3d91-4d31-b96f-2f00c1a5671a admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.707672 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0fcc2-3d91-4d31-b96f-2f00c1a5671a admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.708727 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0fcc2-3d91-4d31-b96f-2f00c1a5671a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.710450 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0fcc2-3d91-4d31-b96f-2f00c1a5671a admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.719732 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 802/1603] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:31.724748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffad5a-852c-402c-b8cd-937448c9ab39 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.727872 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 802/1604] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:31.728752 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0fcc2-3d91-4d31-b96f-2f00c1a5671a admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.738584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0fcc2-3d91-4d31-b96f-2f00c1a5671a admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.744384 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b91c07-dbef-46e9-859e-8a57fc530f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.745638 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b91c07-dbef-46e9-859e-8a57fc530f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.745638 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b91c07-dbef-46e9-859e-8a57fc530f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.745859 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b91c07-dbef-46e9-859e-8a57fc530f90 admin admin] PATH_INFO: `/v3/projects/523029c9401f49c399be46bfe308b5e6/users/1897b88622664ceca4deac5a22079726/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.761496 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b91c07-dbef-46e9-859e-8a57fc530f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=523029c9401f49c399be46bfe308b5e6, user_id=1897b88622664ceca4deac5a22079726, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.764195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b91c07-dbef-46e9-859e-8a57fc530f90 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.780123 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 803/1605] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:31 2022] PUT /identity/v3/projects/523029c9401f49c399be46bfe308b5e6/users/1897b88622664ceca4deac5a22079726/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:31.781555 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd34a6-3ec0-4ec3-83ad-abce130d8acd None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.781907 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd34a6-3ec0-4ec3-83ad-abce130d8acd None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.782274 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd34a6-3ec0-4ec3-83ad-abce130d8acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.790320 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffad5a-852c-402c-b8cd-937448c9ab39 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.819317 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-e6bd34a6-3ec0-4ec3-83ad-abce130d8acd None None] MFA Rules not processed for user `a4118c10f3b842919b5e615300c485be`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:31.821610 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-e6bd34a6-3ec0-4ec3-83ad-abce130d8acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:31.864517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c4ba5-3bf9-494a-9c32-85f4d8c607c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.865206 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c4ba5-3bf9-494a-9c32-85f4d8c607c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.865504 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c4ba5-3bf9-494a-9c32-85f4d8c607c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.865779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c4ba5-3bf9-494a-9c32-85f4d8c607c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.905616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 804/1606] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:31.907159 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd34a6-3ec0-4ec3-83ad-abce130d8acd None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.935435 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c4ba5-3bf9-494a-9c32-85f4d8c607c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.936814 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c4ba5-3bf9-494a-9c32-85f4d8c607c9 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.948109 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 803/1607] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:31.949431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837fd05-c1d5-4078-9ba8-383d65c67e96 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.949786 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837fd05-c1d5-4078-9ba8-383d65c67e96 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.950001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837fd05-c1d5-4078-9ba8-383d65c67e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.981924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-0837fd05-c1d5-4078-9ba8-383d65c67e96 None None] MFA Rules not processed for user `8cc78c5c9afe4116a659a6b352f2620c`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:31.983287 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-0837fd05-c1d5-4078-9ba8-383d65c67e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:31.995054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd34a6-3ec0-4ec3-83ad-abce130d8acd None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:32.000983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b34b1-d9d7-41fd-8c62-12d8a5c50fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:32.001696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b34b1-d9d7-41fd-8c62-12d8a5c50fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:32.002446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b34b1-d9d7-41fd-8c62-12d8a5c50fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:32.002713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b34b1-d9d7-41fd-8c62-12d8a5c50fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:32.003455 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b34b1-d9d7-41fd-8c62-12d8a5c50fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:32.006453 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b34b1-d9d7-41fd-8c62-12d8a5c50fb5 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:32.019076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 805/1608] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:32.020156 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b34b1-d9d7-41fd-8c62-12d8a5c50fb5 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:32.034920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b34b1-d9d7-41fd-8c62-12d8a5c50fb5 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:32.041304 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f5e7d-7f82-416f-9524-7dc3f95f1c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:32.042033 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f5e7d-7f82-416f-9524-7dc3f95f1c40 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:32.042367 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f5e7d-7f82-416f-9524-7dc3f95f1c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:32.042642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f5e7d-7f82-416f-9524-7dc3f95f1c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:32.043603 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f5e7d-7f82-416f-9524-7dc3f95f1c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:32.045212 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f5e7d-7f82-416f-9524-7dc3f95f1c40 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:32.057630 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 806/1609] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:32.058561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f5e7d-7f82-416f-9524-7dc3f95f1c40 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:32.069680 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f5e7d-7f82-416f-9524-7dc3f95f1c40 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:32.076520 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16360224-a27c-467b-a908-04217438c88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:32.076838 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 804/1610] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:32.077201 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16360224-a27c-467b-a908-04217438c88b admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:32.077556 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16360224-a27c-467b-a908-04217438c88b admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:32.077832 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16360224-a27c-467b-a908-04217438c88b admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:32.078542 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8195ff-3058-4e37-a0b0-9de49004668d None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:32.078660 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16360224-a27c-467b-a908-04217438c88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:32.079001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8195ff-3058-4e37-a0b0-9de49004668d None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:32.079374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8195ff-3058-4e37-a0b0-9de49004668d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:32.080741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16360224-a27c-467b-a908-04217438c88b admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:32.096828 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 807/1611] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:32.096828 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16360224-a27c-467b-a908-04217438c88b admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:32.104073 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-8d8195ff-3058-4e37-a0b0-9de49004668d None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:32.105671 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-8d8195ff-3058-4e37-a0b0-9de49004668d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:32.116587 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 805/1612] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:32.117889 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8195ff-3058-4e37-a0b0-9de49004668d None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:32.140839 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8195ff-3058-4e37-a0b0-9de49004668d None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:32.148669 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cc339-af22-4d7b-a977-36f0bbe9e408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:32.150148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cc339-af22-4d7b-a977-36f0bbe9e408 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:32.150573 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cc339-af22-4d7b-a977-36f0bbe9e408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:32.151201 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cc339-af22-4d7b-a977-36f0bbe9e408 admin admin] PATH_INFO: `/v3/projects/47d6a9eb6fd3415d9059fe567e2dfa02/users/c98a5fc7863942c5b389aa9766d31129/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:32.165063 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16360224-a27c-467b-a908-04217438c88b admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:32.169378 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da78bc2-8014-4f85-9b6a-efede3003b0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:32.170266 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da78bc2-8014-4f85-9b6a-efede3003b0e service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:32.170717 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da78bc2-8014-4f85-9b6a-efede3003b0e service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:32.171039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811cc339-af22-4d7b-a977-36f0bbe9e408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47d6a9eb6fd3415d9059fe567e2dfa02, user_id=c98a5fc7863942c5b389aa9766d31129, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:32.171676 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da78bc2-8014-4f85-9b6a-efede3003b0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:32.174541 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811cc339-af22-4d7b-a977-36f0bbe9e408 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:32.185405 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da78bc2-8014-4f85-9b6a-efede3003b0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:32.186998 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da78bc2-8014-4f85-9b6a-efede3003b0e service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:32.195635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 806/1613] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:32 2022] PUT /identity/v3/projects/47d6a9eb6fd3415d9059fe567e2dfa02/users/c98a5fc7863942c5b389aa9766d31129/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:32.197342 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cc339-af22-4d7b-a977-36f0bbe9e408 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:32.201667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 808/1614] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:32.205409 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da78bc2-8014-4f85-9b6a-efede3003b0e service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:32.224301 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da78bc2-8014-4f85-9b6a-efede3003b0e service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:32.315301 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c5ff3-4a23-4802-9225-1b8838d6f22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:32.316366 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c5ff3-4a23-4802-9225-1b8838d6f22e admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:32.316822 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c5ff3-4a23-4802-9225-1b8838d6f22e admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:32.317755 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c5ff3-4a23-4802-9225-1b8838d6f22e admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:32.319894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c5ff3-4a23-4802-9225-1b8838d6f22e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:32.323002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c5ff3-4a23-4802-9225-1b8838d6f22e admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:32.324678 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cc339-af22-4d7b-a977-36f0bbe9e408 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:32.337999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5b615-7c1e-44f8-bac9-81889edb8e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:32.339001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5b615-7c1e-44f8-bac9-81889edb8e77 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:32.339883 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5b615-7c1e-44f8-bac9-81889edb8e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:32.340192 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5b615-7c1e-44f8-bac9-81889edb8e77 admin admin] PATH_INFO: `/v3/projects/556c061344a24efdba2563443e937653/users/542b41f2dd714d3fb19ddbb3e80842a5/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:32.371417 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 809/1615] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:01:32 2022] POST /identity/v3/projects => generated 369 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:32.374958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c5ff3-4a23-4802-9225-1b8838d6f22e admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:32.377220 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5b615-7c1e-44f8-bac9-81889edb8e77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=556c061344a24efdba2563443e937653, user_id=542b41f2dd714d3fb19ddbb3e80842a5, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:32.380985 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5b615-7c1e-44f8-bac9-81889edb8e77 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:32.407500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 807/1616] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:32 2022] PUT /identity/v3/projects/556c061344a24efdba2563443e937653/users/542b41f2dd714d3fb19ddbb3e80842a5/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:32.409835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5b615-7c1e-44f8-bac9-81889edb8e77 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:32.417783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-47a5b615-7c1e-44f8-bac9-81889edb8e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:32.542095 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5b615-7c1e-44f8-bac9-81889edb8e77 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:32.545975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6060c84-5fb4-4b31-a32a-1067e137089b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:32.546673 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6060c84-5fb4-4b31-a32a-1067e137089b service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:32.546956 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6060c84-5fb4-4b31-a32a-1067e137089b service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:32.547232 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6060c84-5fb4-4b31-a32a-1067e137089b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:32.566778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c5ff3-4a23-4802-9225-1b8838d6f22e admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:32.658056 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6060c84-5fb4-4b31-a32a-1067e137089b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:32.659579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6060c84-5fb4-4b31-a32a-1067e137089b service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:32.689738 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 808/1617] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:32.691148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b5130-c2d6-4f86-9ab1-16ac1f9790fb None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:32.691486 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b5130-c2d6-4f86-9ab1-16ac1f9790fb None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:32.692098 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b5130-c2d6-4f86-9ab1-16ac1f9790fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:32.694767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ae37a-5268-47e0-9ec4-be0e8fdf6401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:32.695675 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ae37a-5268-47e0-9ec4-be0e8fdf6401 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:32.695949 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ae37a-5268-47e0-9ec4-be0e8fdf6401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:32.696219 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ae37a-5268-47e0-9ec4-be0e8fdf6401 admin admin] PATH_INFO: `/v3/projects/e21b6bba67764b7989197eda3f4c6804/users/e144879406f14a10818dcc702ecf6a81/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:32.715852 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ae37a-5268-47e0-9ec4-be0e8fdf6401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e21b6bba67764b7989197eda3f4c6804, user_id=e144879406f14a10818dcc702ecf6a81, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:32.718949 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ae37a-5268-47e0-9ec4-be0e8fdf6401 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:32.735392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-202b5130-c2d6-4f86-9ab1-16ac1f9790fb None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:32.736632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-202b5130-c2d6-4f86-9ab1-16ac1f9790fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:32.747877 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 810/1618] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:32 2022] PUT /identity/v3/projects/e21b6bba67764b7989197eda3f4c6804/users/e144879406f14a10818dcc702ecf6a81/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:32.748977 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ae37a-5268-47e0-9ec4-be0e8fdf6401 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:32.843929 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ae37a-5268-47e0-9ec4-be0e8fdf6401 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:32.854562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec181d3e-8999-4dd5-88c8-12559db6d611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:32.855537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec181d3e-8999-4dd5-88c8-12559db6d611 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:32.856450 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec181d3e-8999-4dd5-88c8-12559db6d611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:32.856450 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec181d3e-8999-4dd5-88c8-12559db6d611 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:32.857219 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec181d3e-8999-4dd5-88c8-12559db6d611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:32.860507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec181d3e-8999-4dd5-88c8-12559db6d611 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:32.876936 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 809/1619] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:32.879054 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc764a8b-88f3-4f66-a54c-a7c37c98d1d8 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:32.879054 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc764a8b-88f3-4f66-a54c-a7c37c98d1d8 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:32.879254 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc764a8b-88f3-4f66-a54c-a7c37c98d1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:32.890548 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 811/1620] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:01:32 2022] POST /identity/v3/users => generated 291 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:32.892206 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46ed4a-4a0e-489f-8807-bd9023f4a4ac None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:32.892635 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46ed4a-4a0e-489f-8807-bd9023f4a4ac None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:32.893179 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46ed4a-4a0e-489f-8807-bd9023f4a4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:32.930778 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-dc764a8b-88f3-4f66-a54c-a7c37c98d1d8 None None] MFA Rules not processed for user `542b41f2dd714d3fb19ddbb3e80842a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:32.931917 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-dc764a8b-88f3-4f66-a54c-a7c37c98d1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:32.934864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-4c46ed4a-4a0e-489f-8807-bd9023f4a4ac None None] MFA Rules not processed for user `e144879406f14a10818dcc702ecf6a81`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:32.936474 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-4c46ed4a-4a0e-489f-8807-bd9023f4a4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:33.012863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 810/1621] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:33.013815 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc764a8b-88f3-4f66-a54c-a7c37c98d1d8 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:33.032883 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 812/1622] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:33.045785 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46ed4a-4a0e-489f-8807-bd9023f4a4ac None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:33.061410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46ed4a-4a0e-489f-8807-bd9023f4a4ac None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:33.070220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4fb5b-255d-4e5d-95b7-2452c92e8e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:33.071028 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4fb5b-255d-4e5d-95b7-2452c92e8e1e admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:33.071317 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4fb5b-255d-4e5d-95b7-2452c92e8e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:33.071595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4fb5b-255d-4e5d-95b7-2452c92e8e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:33.072524 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4fb5b-255d-4e5d-95b7-2452c92e8e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:33.074991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4fb5b-255d-4e5d-95b7-2452c92e8e1e admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:33.089569 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc764a8b-88f3-4f66-a54c-a7c37c98d1d8 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:33.093928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca1358-1617-439a-8c51-b672a163273f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:33.094693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca1358-1617-439a-8c51-b672a163273f service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:33.095073 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca1358-1617-439a-8c51-b672a163273f service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:33.095658 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca1358-1617-439a-8c51-b672a163273f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:33.102262 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 813/1623] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:33.104035 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcde8e-7564-4b6a-b154-664d38e3b742 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:33.104608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcde8e-7564-4b6a-b154-664d38e3b742 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:33.104863 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcde8e-7564-4b6a-b154-664d38e3b742 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:33.107247 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 814/1624] 10.222.0.32 () {54 vars in 961 bytes} [Tue May 10 14:01:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:01:33.108076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcde8e-7564-4b6a-b154-664d38e3b742 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:33.112531 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca1358-1617-439a-8c51-b672a163273f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:33.115439 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca1358-1617-439a-8c51-b672a163273f service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:33.128438 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcde8e-7564-4b6a-b154-664d38e3b742 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:33.128990 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 811/1625] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:33.130833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca1358-1617-439a-8c51-b672a163273f service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:33.136512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4357b51-57ee-43bb-857c-1105e1ba8fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:33.137423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4357b51-57ee-43bb-857c-1105e1ba8fec admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:33.137774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4357b51-57ee-43bb-857c-1105e1ba8fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:33.138787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4357b51-57ee-43bb-857c-1105e1ba8fec admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:33.139567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4357b51-57ee-43bb-857c-1105e1ba8fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:33.142820 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4357b51-57ee-43bb-857c-1105e1ba8fec admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:33.200445 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 815/1626] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:01:33 2022] POST /identity/v3/projects => generated 405 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:33.205790 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4357b51-57ee-43bb-857c-1105e1ba8fec admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:33.242185 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca1358-1617-439a-8c51-b672a163273f service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:33.340027 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0329ff-a683-4b87-a877-20095e643a3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:33.340781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0329ff-a683-4b87-a877-20095e643a3d service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:33.341172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0329ff-a683-4b87-a877-20095e643a3d service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:33.341439 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0329ff-a683-4b87-a877-20095e643a3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:33.343830 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4357b51-57ee-43bb-857c-1105e1ba8fec admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:33.363448 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555eb43-dbe7-4054-a382-500976648712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:33.366797 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555eb43-dbe7-4054-a382-500976648712 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:33.367212 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555eb43-dbe7-4054-a382-500976648712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:33.367914 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555eb43-dbe7-4054-a382-500976648712 admin admin] PATH_INFO: `/v3/projects/10f38e6004cb444d8ed6ba0c573c411f/users/83307211c08b4d778d42f7661e0743e8/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:33.396233 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555eb43-dbe7-4054-a382-500976648712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f38e6004cb444d8ed6ba0c573c411f, user_id=83307211c08b4d778d42f7661e0743e8, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:33.400445 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555eb43-dbe7-4054-a382-500976648712 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:33.429523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 816/1627] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:33 2022] PUT /identity/v3/projects/10f38e6004cb444d8ed6ba0c573c411f/users/83307211c08b4d778d42f7661e0743e8/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:33.438253 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4170c61-735f-4d82-917b-e66ac3f4c435 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:33.443893 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0329ff-a683-4b87-a877-20095e643a3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:33.444712 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4170c61-735f-4d82-917b-e66ac3f4c435 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:33.445079 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4170c61-735f-4d82-917b-e66ac3f4c435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:33.447252 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0329ff-a683-4b87-a877-20095e643a3d service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:33.470871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 812/1628] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:33.475424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0329ff-a683-4b87-a877-20095e643a3d service nova] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:33.485961 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-c4170c61-735f-4d82-917b-e66ac3f4c435 None None] MFA Rules not processed for user `e5d4fd26c21f4170a6790369344f8334`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:33.487211 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-c4170c61-735f-4d82-917b-e66ac3f4c435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:33.513506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0329ff-a683-4b87-a877-20095e643a3d service nova] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:33.626595 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e431cb-321f-455f-92ce-dcdffa5c159e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:33.627471 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e431cb-321f-455f-92ce-dcdffa5c159e admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:33.627881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e431cb-321f-455f-92ce-dcdffa5c159e admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:33.628263 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e431cb-321f-455f-92ce-dcdffa5c159e admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:33.629388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e431cb-321f-455f-92ce-dcdffa5c159e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:33.632421 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e431cb-321f-455f-92ce-dcdffa5c159e admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:33.662608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 813/1629] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:01:33 2022] POST /identity/v3/users => generated 309 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:33.663986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 817/1630] 10.222.0.32 () {58 vars in 1058 bytes} [Tue May 10 14:01:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:33.665440 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f6dae-9ffa-4019-a1bf-00a1764549fb None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:33.665744 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f6dae-9ffa-4019-a1bf-00a1764549fb None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:33.666010 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f6dae-9ffa-4019-a1bf-00a1764549fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:33.667386 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e431cb-321f-455f-92ce-dcdffa5c159e admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:33.688908 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e431cb-321f-455f-92ce-dcdffa5c159e admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:33.699992 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50eecf-a64a-4820-8a85-cb0201303399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:33.700676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50eecf-a64a-4820-8a85-cb0201303399 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:33.700954 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50eecf-a64a-4820-8a85-cb0201303399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:33.701227 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50eecf-a64a-4820-8a85-cb0201303399 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:33.704172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50eecf-a64a-4820-8a85-cb0201303399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:33.705799 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50eecf-a64a-4820-8a85-cb0201303399 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:33.722870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-873f6dae-9ffa-4019-a1bf-00a1764549fb None None] MFA Rules not processed for user `f57a715b890443d78579a056f0a9ff51`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:33.727180 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-873f6dae-9ffa-4019-a1bf-00a1764549fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:33.731572 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 814/1631] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:33.732453 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50eecf-a64a-4820-8a85-cb0201303399 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:33.756375 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50eecf-a64a-4820-8a85-cb0201303399 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:33.768470 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795bcba-16ef-4638-8c13-ea803e968d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:33.769159 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795bcba-16ef-4638-8c13-ea803e968d02 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:33.769440 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795bcba-16ef-4638-8c13-ea803e968d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:33.769713 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795bcba-16ef-4638-8c13-ea803e968d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:33.770533 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795bcba-16ef-4638-8c13-ea803e968d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:33.772170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795bcba-16ef-4638-8c13-ea803e968d02 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:33.797961 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 815/1632] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:33.799471 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3dd84-499d-4d25-9783-ee8b0f27f0df None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:33.799757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3dd84-499d-4d25-9783-ee8b0f27f0df None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:33.800031 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3dd84-499d-4d25-9783-ee8b0f27f0df None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:33.807585 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 816/1633] 10.222.0.32 () {54 vars in 912 bytes} [Tue May 10 14:01:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:01:33.808508 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3dd84-499d-4d25-9783-ee8b0f27f0df None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:33.834864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3dd84-499d-4d25-9783-ee8b0f27f0df None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:33.842011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9aaad3-4678-494c-8179-6c4df62f0218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:33.847614 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9aaad3-4678-494c-8179-6c4df62f0218 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:33.848132 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9aaad3-4678-494c-8179-6c4df62f0218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:33.848561 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9aaad3-4678-494c-8179-6c4df62f0218 admin admin] PATH_INFO: `/v3/projects/10f38e6004cb444d8ed6ba0c573c411f/users/83307211c08b4d778d42f7661e0743e8/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:33.851897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9aaad3-4678-494c-8179-6c4df62f0218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f38e6004cb444d8ed6ba0c573c411f, user_id=83307211c08b4d778d42f7661e0743e8, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:33.859413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9aaad3-4678-494c-8179-6c4df62f0218 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:33.875028 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 817/1634] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:33 2022] PUT /identity/v3/projects/10f38e6004cb444d8ed6ba0c573c411f/users/83307211c08b4d778d42f7661e0743e8/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:33.877247 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9aaad3-4678-494c-8179-6c4df62f0218 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:33.887454 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 818/1635] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:33.888879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c67aed-259a-40b1-b6e9-2e37083948d0 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:33.889169 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c67aed-259a-40b1-b6e9-2e37083948d0 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:33.889442 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c67aed-259a-40b1-b6e9-2e37083948d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:33.931801 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-e6c67aed-259a-40b1-b6e9-2e37083948d0 None None] MFA Rules not processed for user `e5d4fd26c21f4170a6790369344f8334`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:33.939136 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-e6c67aed-259a-40b1-b6e9-2e37083948d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:33.970805 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9aaad3-4678-494c-8179-6c4df62f0218 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:33.998346 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2b09f-7e02-4176-a79a-d2dec25bd768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:33.999861 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2b09f-7e02-4176-a79a-d2dec25bd768 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:34.000375 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2b09f-7e02-4176-a79a-d2dec25bd768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:34.000757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2b09f-7e02-4176-a79a-d2dec25bd768 admin admin] PATH_INFO: `/v3/projects/d2593621a2b245f9afc28b901e1d8855/users/840ec400642c4061a1262637d576050c/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:34.035571 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2b09f-7e02-4176-a79a-d2dec25bd768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2593621a2b245f9afc28b901e1d8855, user_id=840ec400642c4061a1262637d576050c, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:34.039064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2b09f-7e02-4176-a79a-d2dec25bd768 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:34.065727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 818/1636] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:33 2022] PUT /identity/v3/projects/d2593621a2b245f9afc28b901e1d8855/users/840ec400642c4061a1262637d576050c/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:34.068828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d1eb6-9e09-4ad2-894b-ad4af8908027 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:34.069239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d1eb6-9e09-4ad2-894b-ad4af8908027 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:34.069469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d1eb6-9e09-4ad2-894b-ad4af8908027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:34.095313 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 819/1637] 10.222.0.32 () {58 vars in 1009 bytes} [Tue May 10 14:01:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:34.097631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcdd31-393b-490c-a808-d0c41c573366 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:34.097855 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcdd31-393b-490c-a808-d0c41c573366 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:34.098282 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcdd31-393b-490c-a808-d0c41c573366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:34.158985 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-4b2d1eb6-9e09-4ad2-894b-ad4af8908027 None None] MFA Rules not processed for user `83307211c08b4d778d42f7661e0743e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:34.160235 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-4b2d1eb6-9e09-4ad2-894b-ad4af8908027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:34.175960 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-6abcdd31-393b-490c-a808-d0c41c573366 None None] MFA Rules not processed for user `f57a715b890443d78579a056f0a9ff51`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:34.183409 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-6abcdd31-393b-490c-a808-d0c41c573366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:34.328793 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 820/1638] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:34.342485 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abcdd31-393b-490c-a808-d0c41c573366 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:34.370960 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 819/1639] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:34 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:34.372209 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d1eb6-9e09-4ad2-894b-ad4af8908027 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:34.428594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abcdd31-393b-490c-a808-d0c41c573366 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:34.441835 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06a6d9-a91b-4e0f-a2e0-b4205486713b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:34.447939 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06a6d9-a91b-4e0f-a2e0-b4205486713b admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:34.448235 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06a6d9-a91b-4e0f-a2e0-b4205486713b admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:34.448590 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06a6d9-a91b-4e0f-a2e0-b4205486713b admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:34.449407 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06a6d9-a91b-4e0f-a2e0-b4205486713b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:34.451893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06a6d9-a91b-4e0f-a2e0-b4205486713b admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:34.456776 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d1eb6-9e09-4ad2-894b-ad4af8908027 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:34.462112 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8b024-7ac8-406a-bae2-232a946e0f76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:34.462817 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8b024-7ac8-406a-bae2-232a946e0f76 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:34.463103 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8b024-7ac8-406a-bae2-232a946e0f76 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:34.463666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8b024-7ac8-406a-bae2-232a946e0f76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:34.468874 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 821/1640] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:34.469823 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06a6d9-a91b-4e0f-a2e0-b4205486713b admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:34.568761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8b024-7ac8-406a-bae2-232a946e0f76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:34.570566 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8b024-7ac8-406a-bae2-232a946e0f76 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:34.573206 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06a6d9-a91b-4e0f-a2e0-b4205486713b admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:34.581196 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311292fc-1ded-41c6-a371-855cf6d103bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:34.584757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 820/1641] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:34.585696 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8b024-7ac8-406a-bae2-232a946e0f76 service cinder] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:34.596046 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8b024-7ac8-406a-bae2-232a946e0f76 service cinder] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:34.599046 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311292fc-1ded-41c6-a371-855cf6d103bb service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:34.600203 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311292fc-1ded-41c6-a371-855cf6d103bb service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:34.600492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311292fc-1ded-41c6-a371-855cf6d103bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:34.601746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05220990-8e68-4063-bdd6-272f98c633ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:34.602624 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05220990-8e68-4063-bdd6-272f98c633ae service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:34.604181 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05220990-8e68-4063-bdd6-272f98c633ae service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:34.604628 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05220990-8e68-4063-bdd6-272f98c633ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:34.631068 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311292fc-1ded-41c6-a371-855cf6d103bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:34.631232 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05220990-8e68-4063-bdd6-272f98c633ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:34.632610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05220990-8e68-4063-bdd6-272f98c633ae service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:34.637645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311292fc-1ded-41c6-a371-855cf6d103bb service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:34.659099 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 821/1642] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:34 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:34.660557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05220990-8e68-4063-bdd6-272f98c633ae service cinder] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:34.674279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 822/1643] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:34.689209 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05220990-8e68-4063-bdd6-272f98c633ae service cinder] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:34.701077 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8c91b-ade8-40c0-9e0e-d5288047fcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:34.702030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8c91b-ade8-40c0-9e0e-d5288047fcf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:34.702329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8c91b-ade8-40c0-9e0e-d5288047fcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:34.702618 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8c91b-ade8-40c0-9e0e-d5288047fcf2 admin admin] PATH_INFO: `/v3/projects/d2593621a2b245f9afc28b901e1d8855/users/840ec400642c4061a1262637d576050c/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:34.713876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8c91b-ade8-40c0-9e0e-d5288047fcf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2593621a2b245f9afc28b901e1d8855, user_id=840ec400642c4061a1262637d576050c, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:34.720605 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8c91b-ade8-40c0-9e0e-d5288047fcf2 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:34.748193 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 822/1644] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:34 2022] PUT /identity/v3/projects/d2593621a2b245f9afc28b901e1d8855/users/840ec400642c4061a1262637d576050c/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:34.756689 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311292fc-1ded-41c6-a371-855cf6d103bb service nova] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:34.762553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138eafd-cb46-42bc-8a0e-b3bcb1c67936 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:34.762769 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138eafd-cb46-42bc-8a0e-b3bcb1c67936 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:34.763053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138eafd-cb46-42bc-8a0e-b3bcb1c67936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:34.772674 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311292fc-1ded-41c6-a371-855cf6d103bb service nova] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:34.843066 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-2138eafd-cb46-42bc-8a0e-b3bcb1c67936 None None] MFA Rules not processed for user `840ec400642c4061a1262637d576050c`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:34.845885 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-2138eafd-cb46-42bc-8a0e-b3bcb1c67936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:34.914911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455aaa4-c56c-47e3-a2b3-1ce506f9e389 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:34.915757 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455aaa4-c56c-47e3-a2b3-1ce506f9e389 service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:34.916049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455aaa4-c56c-47e3-a2b3-1ce506f9e389 service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:34.916324 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455aaa4-c56c-47e3-a2b3-1ce506f9e389 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:35.021928 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455aaa4-c56c-47e3-a2b3-1ce506f9e389 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:35.023423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455aaa4-c56c-47e3-a2b3-1ce506f9e389 service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:35.025728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 823/1645] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:34 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:01:35.045740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 823/1646] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:34 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:35.429182 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138eafd-cb46-42bc-8a0e-b3bcb1c67936 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:35.443161 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138eafd-cb46-42bc-8a0e-b3bcb1c67936 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:35.454193 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2714c-4088-4ebd-98c6-7074bd134a37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:35.455058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2714c-4088-4ebd-98c6-7074bd134a37 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:35.455371 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2714c-4088-4ebd-98c6-7074bd134a37 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:35.456163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2714c-4088-4ebd-98c6-7074bd134a37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:35.487735 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2714c-4088-4ebd-98c6-7074bd134a37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:35.489737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2714c-4088-4ebd-98c6-7074bd134a37 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:35.511525 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 824/1647] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:35 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:35.792022 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0942dc-4842-4785-95f1-b732810329af None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:35.792840 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0942dc-4842-4785-95f1-b732810329af None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:35.793454 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0942dc-4842-4785-95f1-b732810329af None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:35.795784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 824/1648] 10.222.0.32 () {54 vars in 912 bytes} [Tue May 10 14:01:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:01:35.807641 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba783e-79e9-405e-98f0-9d0badcef336 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:35.807945 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba783e-79e9-405e-98f0-9d0badcef336 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:35.808215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba783e-79e9-405e-98f0-9d0badcef336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:35.903921 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-a0ba783e-79e9-405e-98f0-9d0badcef336 None None] MFA Rules not processed for user `12eb1c001b5e44d8b5b5bc658ed464f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:35.905380 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-a0ba783e-79e9-405e-98f0-9d0badcef336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:35.980802 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0942dc-4842-4785-95f1-b732810329af None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:36.091900 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 825/1649] 10.222.0.32 () {58 vars in 1009 bytes} [Tue May 10 14:01:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:36.108086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0942dc-4842-4785-95f1-b732810329af None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:36.117341 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142c4e5-fc19-4149-820a-0db7b93f00c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:36.119013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142c4e5-fc19-4149-820a-0db7b93f00c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:36.119457 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142c4e5-fc19-4149-820a-0db7b93f00c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:36.120243 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142c4e5-fc19-4149-820a-0db7b93f00c1 admin admin] PATH_INFO: `/v3/users/542b41f2dd714d3fb19ddbb3e80842a5` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:36.122001 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142c4e5-fc19-4149-820a-0db7b93f00c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=542b41f2dd714d3fb19ddbb3e80842a5)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:36.123812 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: WARNING py.warnings [None req-9142c4e5-fc19-4149-820a-0db7b93f00c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 14:01:36.123812 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: warnings.warn(msg) May 10 14:01:36.123812 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: May 10 14:01:36.125603 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142c4e5-fc19-4149-820a-0db7b93f00c1 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:36.142000 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba783e-79e9-405e-98f0-9d0badcef336 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:36.153148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba783e-79e9-405e-98f0-9d0badcef336 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:36.164341 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ebb86-db0a-4253-aad4-15b5227f3f70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:36.165518 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ebb86-db0a-4253-aad4-15b5227f3f70 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:36.165518 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ebb86-db0a-4253-aad4-15b5227f3f70 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:36.165973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ebb86-db0a-4253-aad4-15b5227f3f70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:36.186765 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ebb86-db0a-4253-aad4-15b5227f3f70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:36.188242 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ebb86-db0a-4253-aad4-15b5227f3f70 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:36.202161 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 826/1650] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:01:36.340807 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9142c4e5-fc19-4149-820a-0db7b93f00c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '542b41f2dd714d3fb19ddbb3e80842a5'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:36.356715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9142c4e5-fc19-4149-820a-0db7b93f00c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '542b41f2dd714d3fb19ddbb3e80842a5'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:36.395262 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ebb86-db0a-4253-aad4-15b5227f3f70 service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:36.415846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ebb86-db0a-4253-aad4-15b5227f3f70 service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:36.434292 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9142c4e5-fc19-4149-820a-0db7b93f00c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '542b41f2dd714d3fb19ddbb3e80842a5'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:36.436906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86ef6f-85d1-4b00-bf86-ce543b58f5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:36.437851 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86ef6f-85d1-4b00-bf86-ce543b58f5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:36.438083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86ef6f-85d1-4b00-bf86-ce543b58f5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:36.438395 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86ef6f-85d1-4b00-bf86-ce543b58f5e2 admin admin] PATH_INFO: `/v3/users/bb7cdb21321c4ca49c3d273a2439a928` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:36.439345 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9142c4e5-fc19-4149-820a-0db7b93f00c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '542b41f2dd714d3fb19ddbb3e80842a5'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:36.446782 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9142c4e5-fc19-4149-820a-0db7b93f00c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '542b41f2dd714d3fb19ddbb3e80842a5'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:36.449161 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86ef6f-85d1-4b00-bf86-ce543b58f5e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb7cdb21321c4ca49c3d273a2439a928)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:36.452027 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86ef6f-85d1-4b00-bf86-ce543b58f5e2 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:36.530508 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 825/1651] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:01:35 2022] DELETE /identity/v3/users/542b41f2dd714d3fb19ddbb3e80842a5 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:36.544811 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff96b41-3b9e-4b5c-b2aa-d84a0d3ed05e None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:36.545226 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff96b41-3b9e-4b5c-b2aa-d84a0d3ed05e None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:36.545566 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff96b41-3b9e-4b5c-b2aa-d84a0d3ed05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:36.628028 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-2ff96b41-3b9e-4b5c-b2aa-d84a0d3ed05e None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:36.637306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-2ff96b41-3b9e-4b5c-b2aa-d84a0d3ed05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:36.654236 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-5f86ef6f-85d1-4b00-bf86-ce543b58f5e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb7cdb21321c4ca49c3d273a2439a928'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:36.654236 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-5f86ef6f-85d1-4b00-bf86-ce543b58f5e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb7cdb21321c4ca49c3d273a2439a928'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:36.711949 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-5f86ef6f-85d1-4b00-bf86-ce543b58f5e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb7cdb21321c4ca49c3d273a2439a928'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:36.729672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-5f86ef6f-85d1-4b00-bf86-ce543b58f5e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb7cdb21321c4ca49c3d273a2439a928'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:36.745999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-5f86ef6f-85d1-4b00-bf86-ce543b58f5e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb7cdb21321c4ca49c3d273a2439a928'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:36.779978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 827/1652] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:01:36 2022] DELETE /identity/v3/users/bb7cdb21321c4ca49c3d273a2439a928 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:36.781677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a221df-1cf9-4608-b157-550490d5e29d None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:36.781974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a221df-1cf9-4608-b157-550490d5e29d None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:36.782274 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a221df-1cf9-4608-b157-550490d5e29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:36.846158 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-41a221df-1cf9-4608-b157-550490d5e29d None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:36.847685 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-41a221df-1cf9-4608-b157-550490d5e29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:36.868730 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 826/1653] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:37.003455 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 828/1654] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:37.164610 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff96b41-3b9e-4b5c-b2aa-d84a0d3ed05e None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:37.166357 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-2ff96b41-3b9e-4b5c-b2aa-d84a0d3ed05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:37.167118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a221df-1cf9-4608-b157-550490d5e29d None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:37.168648 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-41a221df-1cf9-4608-b157-550490d5e29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:37.310278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff96b41-3b9e-4b5c-b2aa-d84a0d3ed05e None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:37.334168 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a221df-1cf9-4608-b157-550490d5e29d None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:37.340586 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f7ac8-6905-4bd6-9851-8fb79a5b8494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:37.345495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f7ac8-6905-4bd6-9851-8fb79a5b8494 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:37.346109 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f7ac8-6905-4bd6-9851-8fb79a5b8494 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:37.346566 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f7ac8-6905-4bd6-9851-8fb79a5b8494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:37.366141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f7ac8-6905-4bd6-9851-8fb79a5b8494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:37.368805 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f7ac8-6905-4bd6-9851-8fb79a5b8494 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:37.394972 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 829/1655] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:37.397802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d4b41-ecc8-46ec-b179-3a5e43521fb7 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:37.398391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d4b41-ecc8-46ec-b179-3a5e43521fb7 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:37.398839 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d4b41-ecc8-46ec-b179-3a5e43521fb7 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:37.401613 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 830/1656] 10.222.0.32 () {54 vars in 960 bytes} [Tue May 10 14:01:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:01:37.408033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93259f-a8b0-407c-aa87-01f3501b4fcd None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:37.410380 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93259f-a8b0-407c-aa87-01f3501b4fcd None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:37.410612 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93259f-a8b0-407c-aa87-01f3501b4fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:37.510744 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-ac93259f-a8b0-407c-aa87-01f3501b4fcd None None] MFA Rules not processed for user `4859a69a988a4b10b67187553d829b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:37.512011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-ac93259f-a8b0-407c-aa87-01f3501b4fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:37.608234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643c936-ecd4-4a8a-94b2-1c23f4e08680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:37.615842 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643c936-ecd4-4a8a-94b2-1c23f4e08680 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:37.616393 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643c936-ecd4-4a8a-94b2-1c23f4e08680 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:37.616677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643c936-ecd4-4a8a-94b2-1c23f4e08680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:37.680827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643c936-ecd4-4a8a-94b2-1c23f4e08680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:37.689240 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643c936-ecd4-4a8a-94b2-1c23f4e08680 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:37.796900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 827/1657] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:37.861619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 831/1658] 10.222.0.32 () {58 vars in 1057 bytes} [Tue May 10 14:01:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:37.862262 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643c936-ecd4-4a8a-94b2-1c23f4e08680 service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:37.891967 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643c936-ecd4-4a8a-94b2-1c23f4e08680 service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:37.918193 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcf94d-f60d-4b8c-a723-55fe1e510a32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4859a69a988a4b10b67187553d829b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:37.920684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcf94d-f60d-4b8c-a723-55fe1e510a32 service placement] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:37.933651 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcf94d-f60d-4b8c-a723-55fe1e510a32 service placement] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:37.933948 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcf94d-f60d-4b8c-a723-55fe1e510a32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:37.943707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-0ebcf94d-f60d-4b8c-a723-55fe1e510a32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:38.014820 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebcf94d-f60d-4b8c-a723-55fe1e510a32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:38.022113 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebcf94d-f60d-4b8c-a723-55fe1e510a32 service placement] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:38.072222 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 828/1659] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:01:39.301221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93259f-a8b0-407c-aa87-01f3501b4fcd None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:39.304096 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-ac93259f-a8b0-407c-aa87-01f3501b4fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:39.346624 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93259f-a8b0-407c-aa87-01f3501b4fcd None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:39.357138 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7182e-0c24-4618-95d8-906cce91c376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:39.359378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7182e-0c24-4618-95d8-906cce91c376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:39.364823 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7182e-0c24-4618-95d8-906cce91c376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:39.365421 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7182e-0c24-4618-95d8-906cce91c376 admin admin] PATH_INFO: `/v3/projects/556c061344a24efdba2563443e937653` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:39.368849 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7182e-0c24-4618-95d8-906cce91c376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=556c061344a24efdba2563443e937653)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:39.372307 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: WARNING py.warnings [None req-3be7182e-0c24-4618-95d8-906cce91c376 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 14:01:39.372307 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: warnings.warn(msg) May 10 14:01:39.372307 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: May 10 14:01:39.383250 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7182e-0c24-4618-95d8-906cce91c376 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:39.397798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcf94d-f60d-4b8c-a723-55fe1e510a32 service placement] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:39.399815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-0ebcf94d-f60d-4b8c-a723-55fe1e510a32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:39.443997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcf94d-f60d-4b8c-a723-55fe1e510a32 service placement] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:39.481073 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559282a-94f3-456b-9c8f-5282abcf66df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:39.482181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559282a-94f3-456b-9c8f-5282abcf66df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:39.482593 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559282a-94f3-456b-9c8f-5282abcf66df admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:39.483045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559282a-94f3-456b-9c8f-5282abcf66df admin admin] PATH_INFO: `/v3/projects/4f5468859afd431c89cb34c8957d60dd` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:39.485336 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559282a-94f3-456b-9c8f-5282abcf66df admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f5468859afd431c89cb34c8957d60dd)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:39.498770 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559282a-94f3-456b-9c8f-5282abcf66df admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:39.575376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-3be7182e-0c24-4618-95d8-906cce91c376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '556c061344a24efdba2563443e937653', 'request_id': 'req-3be7182e-0c24-4618-95d8-906cce91c376'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:39.596039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-3be7182e-0c24-4618-95d8-906cce91c376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '556c061344a24efdba2563443e937653', 'request_id': 'req-3be7182e-0c24-4618-95d8-906cce91c376'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:39.656431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-c559282a-94f3-456b-9c8f-5282abcf66df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f5468859afd431c89cb34c8957d60dd', 'request_id': 'req-c559282a-94f3-456b-9c8f-5282abcf66df'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:39.656617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-3be7182e-0c24-4618-95d8-906cce91c376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '556c061344a24efdba2563443e937653', 'request_id': 'req-3be7182e-0c24-4618-95d8-906cce91c376'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:39.677738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-c559282a-94f3-456b-9c8f-5282abcf66df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f5468859afd431c89cb34c8957d60dd', 'request_id': 'req-c559282a-94f3-456b-9c8f-5282abcf66df'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:39.691102 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-c559282a-94f3-456b-9c8f-5282abcf66df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f5468859afd431c89cb34c8957d60dd', 'request_id': 'req-c559282a-94f3-456b-9c8f-5282abcf66df'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:39.699578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-3be7182e-0c24-4618-95d8-906cce91c376 admin admin] The token cache is being invalidate because project 556c061344a24efdba2563443e937653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:39.699873 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-3be7182e-0c24-4618-95d8-906cce91c376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:39.702660 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-3be7182e-0c24-4618-95d8-906cce91c376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:39.705155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 832/1660] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:01:39 2022] DELETE /identity/v3/projects/556c061344a24efdba2563443e937653 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:39.709243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7182e-0c24-4618-95d8-906cce91c376 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:39.712840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-3be7182e-0c24-4618-95d8-906cce91c376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:39.719834 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-c559282a-94f3-456b-9c8f-5282abcf66df admin admin] The token cache is being invalidate because project 4f5468859afd431c89cb34c8957d60dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:39.720580 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-c559282a-94f3-456b-9c8f-5282abcf66df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:39.731870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-c559282a-94f3-456b-9c8f-5282abcf66df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:39.740095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 829/1661] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:01:39 2022] DELETE /identity/v3/projects/4f5468859afd431c89cb34c8957d60dd => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:39.745890 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452e4a4-957a-4cd0-8b7c-0bbb6ac7ab6f None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:39.746547 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452e4a4-957a-4cd0-8b7c-0bbb6ac7ab6f None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:39.747737 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452e4a4-957a-4cd0-8b7c-0bbb6ac7ab6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:39.830430 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-d452e4a4-957a-4cd0-8b7c-0bbb6ac7ab6f None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:39.833677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-d452e4a4-957a-4cd0-8b7c-0bbb6ac7ab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:39.899455 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7182e-0c24-4618-95d8-906cce91c376 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:39.967914 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 830/1662] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:39.977711 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a290be-dc41-45f2-8d12-f373a1a6fe00 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:39.979266 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a290be-dc41-45f2-8d12-f373a1a6fe00 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:39.981439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a290be-dc41-45f2-8d12-f373a1a6fe00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:40.038788 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-f5a290be-dc41-45f2-8d12-f373a1a6fe00 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:40.040141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-f5a290be-dc41-45f2-8d12-f373a1a6fe00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:40.055474 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923eae8-0207-486f-8f9e-cd95fe10f172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:40.056369 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923eae8-0207-486f-8f9e-cd95fe10f172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:40.056650 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923eae8-0207-486f-8f9e-cd95fe10f172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:40.056926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923eae8-0207-486f-8f9e-cd95fe10f172 admin admin] PATH_INFO: `/v3/users/840ec400642c4061a1262637d576050c` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:40.059735 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923eae8-0207-486f-8f9e-cd95fe10f172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=840ec400642c4061a1262637d576050c)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:40.061702 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923eae8-0207-486f-8f9e-cd95fe10f172 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:40.062880 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 831/1663] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:40.066687 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a290be-dc41-45f2-8d12-f373a1a6fe00 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:40.092977 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a290be-dc41-45f2-8d12-f373a1a6fe00 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:40.107107 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd0389-2276-4898-91ea-498416a772bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:40.109499 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd0389-2276-4898-91ea-498416a772bf admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:40.109499 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd0389-2276-4898-91ea-498416a772bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:40.113146 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd0389-2276-4898-91ea-498416a772bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:40.116533 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd0389-2276-4898-91ea-498416a772bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:40.117821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd0389-2276-4898-91ea-498416a772bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:40.122591 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd0389-2276-4898-91ea-498416a772bf admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:40.162258 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 832/1664] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:01:40.167113 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd0389-2276-4898-91ea-498416a772bf admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:40.190139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd0389-2276-4898-91ea-498416a772bf admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:40.202720 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6923eae8-0207-486f-8f9e-cd95fe10f172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '840ec400642c4061a1262637d576050c'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:40.204439 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6923eae8-0207-486f-8f9e-cd95fe10f172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '840ec400642c4061a1262637d576050c'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:40.204559 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08575c2c-8027-49cb-bca3-8e05e4dd95fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:40.205957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08575c2c-8027-49cb-bca3-8e05e4dd95fe admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:40.206530 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08575c2c-8027-49cb-bca3-8e05e4dd95fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:40.207330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08575c2c-8027-49cb-bca3-8e05e4dd95fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:40.209187 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08575c2c-8027-49cb-bca3-8e05e4dd95fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:40.214491 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08575c2c-8027-49cb-bca3-8e05e4dd95fe admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:40.251243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6923eae8-0207-486f-8f9e-cd95fe10f172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '840ec400642c4061a1262637d576050c'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:40.262469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6923eae8-0207-486f-8f9e-cd95fe10f172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '840ec400642c4061a1262637d576050c'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:40.272859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6923eae8-0207-486f-8f9e-cd95fe10f172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '840ec400642c4061a1262637d576050c'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:40.288734 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 833/1665] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:01:40 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:40.289767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08575c2c-8027-49cb-bca3-8e05e4dd95fe admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:40.294870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-08575c2c-8027-49cb-bca3-8e05e4dd95fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:40.298651 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 833/1666] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:01:39 2022] DELETE /identity/v3/users/840ec400642c4061a1262637d576050c => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:40.510239 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08575c2c-8027-49cb-bca3-8e05e4dd95fe admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:40.573126 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923eae8-0207-486f-8f9e-cd95fe10f172 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:40.574941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-6923eae8-0207-486f-8f9e-cd95fe10f172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:40.674020 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0cc45-6395-419a-a0c0-c239734c7851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:40.679897 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0cc45-6395-419a-a0c0-c239734c7851 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:40.680182 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0cc45-6395-419a-a0c0-c239734c7851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:40.680472 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0cc45-6395-419a-a0c0-c239734c7851 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:40.681197 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e0cc45-6395-419a-a0c0-c239734c7851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:40.683222 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e0cc45-6395-419a-a0c0-c239734c7851 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:40.733594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 834/1667] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:01:40 2022] POST /identity/v3/users => generated 289 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:40.737536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0cc45-6395-419a-a0c0-c239734c7851 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:40.746454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923eae8-0207-486f-8f9e-cd95fe10f172 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:40.756992 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc6fd0-ffee-4d8a-b1ff-57fbe0464330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:40.757900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0cc45-6395-419a-a0c0-c239734c7851 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:40.758731 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc6fd0-ffee-4d8a-b1ff-57fbe0464330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:40.759257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc6fd0-ffee-4d8a-b1ff-57fbe0464330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:40.759762 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc6fd0-ffee-4d8a-b1ff-57fbe0464330 admin admin] PATH_INFO: `/v3/users/8cc78c5c9afe4116a659a6b352f2620c` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:40.761379 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc6fd0-ffee-4d8a-b1ff-57fbe0464330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cc78c5c9afe4116a659a6b352f2620c)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:40.764481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc6fd0-ffee-4d8a-b1ff-57fbe0464330 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:40.779173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d58e3-5f27-4b89-9fde-3ef5b02ba5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:40.779995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d58e3-5f27-4b89-9fde-3ef5b02ba5ca admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:40.780285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d58e3-5f27-4b89-9fde-3ef5b02ba5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:40.780586 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d58e3-5f27-4b89-9fde-3ef5b02ba5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:40.781321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d58e3-5f27-4b89-9fde-3ef5b02ba5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:40.783011 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d58e3-5f27-4b89-9fde-3ef5b02ba5ca admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:40.808823 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 835/1668] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:01:40.812529 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d58e3-5f27-4b89-9fde-3ef5b02ba5ca admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:40.843545 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d58e3-5f27-4b89-9fde-3ef5b02ba5ca admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:40.853414 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a9f31-47a2-478d-98a7-8409d3259405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:40.854267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a9f31-47a2-478d-98a7-8409d3259405 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:40.854469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a9f31-47a2-478d-98a7-8409d3259405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:40.854761 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a9f31-47a2-478d-98a7-8409d3259405 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:40.855478 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a9f31-47a2-478d-98a7-8409d3259405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:40.857398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a9f31-47a2-478d-98a7-8409d3259405 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:40.872530 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 836/1669] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:01:40.876614 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-5ecc6fd0-ffee-4d8a-b1ff-57fbe0464330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cc78c5c9afe4116a659a6b352f2620c'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:40.877094 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a9f31-47a2-478d-98a7-8409d3259405 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:40.877605 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-5ecc6fd0-ffee-4d8a-b1ff-57fbe0464330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cc78c5c9afe4116a659a6b352f2620c'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:40.886460 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-cf5a9f31-47a2-478d-98a7-8409d3259405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:40.905309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a9f31-47a2-478d-98a7-8409d3259405 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:40.907079 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-5ecc6fd0-ffee-4d8a-b1ff-57fbe0464330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cc78c5c9afe4116a659a6b352f2620c'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:40.917072 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e3929-8409-41a6-880e-fb3c8b033765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:40.918503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e3929-8409-41a6-880e-fb3c8b033765 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:40.918938 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e3929-8409-41a6-880e-fb3c8b033765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:40.919316 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e3929-8409-41a6-880e-fb3c8b033765 admin admin] PATH_INFO: `/v3/projects/fbc2c2bd10964440b9cd09048e68ab9e/users/d6415c26ae5b44d7800c8bbe0d9de823/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:40.919925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-5ecc6fd0-ffee-4d8a-b1ff-57fbe0464330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cc78c5c9afe4116a659a6b352f2620c'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:40.932435 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-5ecc6fd0-ffee-4d8a-b1ff-57fbe0464330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cc78c5c9afe4116a659a6b352f2620c'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:40.946636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e3929-8409-41a6-880e-fb3c8b033765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc2c2bd10964440b9cd09048e68ab9e, user_id=d6415c26ae5b44d7800c8bbe0d9de823, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:40.947966 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 834/1670] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:01:40 2022] DELETE /identity/v3/users/8cc78c5c9afe4116a659a6b352f2620c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:40.952484 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ae8b5-9ea8-47d2-bc6b-2163d4090c03 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:40.952766 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ae8b5-9ea8-47d2-bc6b-2163d4090c03 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:40.953178 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e3929-8409-41a6-880e-fb3c8b033765 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:40.954303 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ae8b5-9ea8-47d2-bc6b-2163d4090c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:40.986375 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 837/1671] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:40 2022] PUT /identity/v3/projects/fbc2c2bd10964440b9cd09048e68ab9e/users/d6415c26ae5b44d7800c8bbe0d9de823/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:40.996974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-8f2ae8b5-9ea8-47d2-bc6b-2163d4090c03 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:40.998479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-8f2ae8b5-9ea8-47d2-bc6b-2163d4090c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:40.998590 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e5cdc-c3a4-460f-9b33-8955600b4974 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:40.998855 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e5cdc-c3a4-460f-9b33-8955600b4974 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:40.999138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e5cdc-c3a4-460f-9b33-8955600b4974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:41.119168 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-6e1e5cdc-c3a4-460f-9b33-8955600b4974 None None] MFA Rules not processed for user `d6415c26ae5b44d7800c8bbe0d9de823`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:41.120329 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-6e1e5cdc-c3a4-460f-9b33-8955600b4974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:41.190632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 835/1672] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:41.237222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ae8b5-9ea8-47d2-bc6b-2163d4090c03 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:41.238743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-8f2ae8b5-9ea8-47d2-bc6b-2163d4090c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:41.290913 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 838/1673] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:01:41.291944 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e5cdc-c3a4-460f-9b33-8955600b4974 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:41.315853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e5cdc-c3a4-460f-9b33-8955600b4974 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:41.322967 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ae8b5-9ea8-47d2-bc6b-2163d4090c03 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:41.326984 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4bdbb-0b55-4157-a8a7-b0bb14481581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:41.327622 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4bdbb-0b55-4157-a8a7-b0bb14481581 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:41.327912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4bdbb-0b55-4157-a8a7-b0bb14481581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:41.328197 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4bdbb-0b55-4157-a8a7-b0bb14481581 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:41.328895 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4bdbb-0b55-4157-a8a7-b0bb14481581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:41.330921 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4bdbb-0b55-4157-a8a7-b0bb14481581 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:41.332574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f903d60-85d3-4cb2-911b-80f2fcc56635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:41.334185 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f903d60-85d3-4cb2-911b-80f2fcc56635 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:41.334455 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f903d60-85d3-4cb2-911b-80f2fcc56635 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:41.334738 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f903d60-85d3-4cb2-911b-80f2fcc56635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:41.359009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f903d60-85d3-4cb2-911b-80f2fcc56635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:41.362857 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f903d60-85d3-4cb2-911b-80f2fcc56635 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:41.395296 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 836/1674] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:01:41.400197 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 839/1675] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:01:41 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:41.403153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f903d60-85d3-4cb2-911b-80f2fcc56635 service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:41.421309 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f903d60-85d3-4cb2-911b-80f2fcc56635 service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:41.508532 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3b310-8aea-4bc9-92d5-2111045ca013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:41.509602 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3b310-8aea-4bc9-92d5-2111045ca013 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:41.510035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3b310-8aea-4bc9-92d5-2111045ca013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:41.510458 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3b310-8aea-4bc9-92d5-2111045ca013 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:41.511357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3b310-8aea-4bc9-92d5-2111045ca013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:41.513622 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3b310-8aea-4bc9-92d5-2111045ca013 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:41.550235 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 837/1676] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:01:41 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:41.550541 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4bdbb-0b55-4157-a8a7-b0bb14481581 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:41.569186 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4bdbb-0b55-4157-a8a7-b0bb14481581 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:41.587276 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a978e5-20f5-4287-beb5-61325e211dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:41.588076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a978e5-20f5-4287-beb5-61325e211dad admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:41.588361 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a978e5-20f5-4287-beb5-61325e211dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:41.588633 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a978e5-20f5-4287-beb5-61325e211dad admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:41.590129 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a978e5-20f5-4287-beb5-61325e211dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:41.591157 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a978e5-20f5-4287-beb5-61325e211dad admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:41.617246 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 840/1677] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:01:41.622060 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3b310-8aea-4bc9-92d5-2111045ca013 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:41.642958 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3b310-8aea-4bc9-92d5-2111045ca013 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:41.661003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0aaa00-7ab5-4355-ac57-7bdfe224ab74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:41.665637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0aaa00-7ab5-4355-ac57-7bdfe224ab74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:41.666817 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0aaa00-7ab5-4355-ac57-7bdfe224ab74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:41.667098 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0aaa00-7ab5-4355-ac57-7bdfe224ab74 admin admin] PATH_INFO: `/v3/projects/56cccd1b02bc44358b588b3f9c22c8c8/users/cf32e9e8cc7b4dd88448583c397e1e96/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:41.723611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0aaa00-7ab5-4355-ac57-7bdfe224ab74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56cccd1b02bc44358b588b3f9c22c8c8, user_id=cf32e9e8cc7b4dd88448583c397e1e96, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:41.739529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0aaa00-7ab5-4355-ac57-7bdfe224ab74 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:41.790572 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 838/1678] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:41 2022] PUT /identity/v3/projects/56cccd1b02bc44358b588b3f9c22c8c8/users/cf32e9e8cc7b4dd88448583c397e1e96/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:41.794730 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a978e5-20f5-4287-beb5-61325e211dad admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:41.810269 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a978e5-20f5-4287-beb5-61325e211dad admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:41.895748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0aaa00-7ab5-4355-ac57-7bdfe224ab74 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:41.898125 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-9a0aaa00-7ab5-4355-ac57-7bdfe224ab74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:42.017726 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845f818-b34c-4655-a443-bec26e525fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:42.019528 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845f818-b34c-4655-a443-bec26e525fac admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:42.021103 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845f818-b34c-4655-a443-bec26e525fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:42.021599 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845f818-b34c-4655-a443-bec26e525fac admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:42.022761 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845f818-b34c-4655-a443-bec26e525fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:42.024597 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845f818-b34c-4655-a443-bec26e525fac admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:42.040609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 841/1679] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:42.045436 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0aaa00-7ab5-4355-ac57-7bdfe224ab74 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:42.052651 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845f818-b34c-4655-a443-bec26e525fac admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:42.060355 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db70e4-c6af-48c6-8bf5-c6bde4ed005d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:42.061993 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db70e4-c6af-48c6-8bf5-c6bde4ed005d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:42.062315 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db70e4-c6af-48c6-8bf5-c6bde4ed005d admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:42.068596 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db70e4-c6af-48c6-8bf5-c6bde4ed005d admin admin] PATH_INFO: `/v3/projects/d2593621a2b245f9afc28b901e1d8855` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:42.072341 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db70e4-c6af-48c6-8bf5-c6bde4ed005d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2593621a2b245f9afc28b901e1d8855)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:42.076298 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db70e4-c6af-48c6-8bf5-c6bde4ed005d admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:42.076637 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845f818-b34c-4655-a443-bec26e525fac admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:42.092219 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f8fa3-b8e3-4fd5-b085-3d3f11360dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:42.093491 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f8fa3-b8e3-4fd5-b085-3d3f11360dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:42.093967 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f8fa3-b8e3-4fd5-b085-3d3f11360dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:42.094526 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f8fa3-b8e3-4fd5-b085-3d3f11360dc6 admin admin] PATH_INFO: `/v3/projects/56cccd1b02bc44358b588b3f9c22c8c8/users/cf32e9e8cc7b4dd88448583c397e1e96/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:42.100666 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f8fa3-b8e3-4fd5-b085-3d3f11360dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56cccd1b02bc44358b588b3f9c22c8c8, user_id=cf32e9e8cc7b4dd88448583c397e1e96, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:42.104188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f8fa3-b8e3-4fd5-b085-3d3f11360dc6 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:42.130467 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 842/1680] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:42 2022] PUT /identity/v3/projects/56cccd1b02bc44358b588b3f9c22c8c8/users/cf32e9e8cc7b4dd88448583c397e1e96/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:42.133133 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49adcb7-cf4a-4a98-b16b-0995f0742602 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:42.133420 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49adcb7-cf4a-4a98-b16b-0995f0742602 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:42.133694 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49adcb7-cf4a-4a98-b16b-0995f0742602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:42.253792 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-f49adcb7-cf4a-4a98-b16b-0995f0742602 None None] MFA Rules not processed for user `cf32e9e8cc7b4dd88448583c397e1e96`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:42.255948 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-f49adcb7-cf4a-4a98-b16b-0995f0742602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:42.275300 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-63db70e4-c6af-48c6-8bf5-c6bde4ed005d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2593621a2b245f9afc28b901e1d8855', 'request_id': 'req-63db70e4-c6af-48c6-8bf5-c6bde4ed005d'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:42.291656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-63db70e4-c6af-48c6-8bf5-c6bde4ed005d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2593621a2b245f9afc28b901e1d8855', 'request_id': 'req-63db70e4-c6af-48c6-8bf5-c6bde4ed005d'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:42.321771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-63db70e4-c6af-48c6-8bf5-c6bde4ed005d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2593621a2b245f9afc28b901e1d8855', 'request_id': 'req-63db70e4-c6af-48c6-8bf5-c6bde4ed005d'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:42.364866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-63db70e4-c6af-48c6-8bf5-c6bde4ed005d admin admin] The token cache is being invalidate because project d2593621a2b245f9afc28b901e1d8855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:42.365387 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-63db70e4-c6af-48c6-8bf5-c6bde4ed005d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:42.367089 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-63db70e4-c6af-48c6-8bf5-c6bde4ed005d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:42.372504 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 839/1681] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:01:41 2022] DELETE /identity/v3/projects/d2593621a2b245f9afc28b901e1d8855 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:42.377367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25db3e-2b43-46ac-a373-be3b93e1d3dc None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:42.377715 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25db3e-2b43-46ac-a373-be3b93e1d3dc None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:42.377995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25db3e-2b43-46ac-a373-be3b93e1d3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:42.428100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-eb25db3e-2b43-46ac-a373-be3b93e1d3dc None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:42.429256 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-eb25db3e-2b43-46ac-a373-be3b93e1d3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:42.517374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 843/1682] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:42.524779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49adcb7-cf4a-4a98-b16b-0995f0742602 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:42.526639 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-f49adcb7-cf4a-4a98-b16b-0995f0742602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:42.644261 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 840/1683] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:42.654404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510ebf5-e291-48a7-90d5-c4e01ce67166 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:42.654697 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510ebf5-e291-48a7-90d5-c4e01ce67166 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:42.654984 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510ebf5-e291-48a7-90d5-c4e01ce67166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:42.738082 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-0510ebf5-e291-48a7-90d5-c4e01ce67166 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:42.742994 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-0510ebf5-e291-48a7-90d5-c4e01ce67166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:42.744790 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49adcb7-cf4a-4a98-b16b-0995f0742602 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:42.755792 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76da40-4346-48e1-a51e-0ac1f1e976f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:42.758597 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76da40-4346-48e1-a51e-0ac1f1e976f4 service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:42.759351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76da40-4346-48e1-a51e-0ac1f1e976f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:42.760962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76da40-4346-48e1-a51e-0ac1f1e976f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:42.769932 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-de76da40-4346-48e1-a51e-0ac1f1e976f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:42.771224 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 841/1684] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:42.772217 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510ebf5-e291-48a7-90d5-c4e01ce67166 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:42.816966 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510ebf5-e291-48a7-90d5-c4e01ce67166 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:42.841935 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d49bf8-de79-4054-9731-18beb3d8f074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:42.846762 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d49bf8-de79-4054-9731-18beb3d8f074 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:42.847643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d49bf8-de79-4054-9731-18beb3d8f074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:42.847931 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d49bf8-de79-4054-9731-18beb3d8f074 admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:42.852913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d49bf8-de79-4054-9731-18beb3d8f074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:42.854827 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d49bf8-de79-4054-9731-18beb3d8f074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:42.863050 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d49bf8-de79-4054-9731-18beb3d8f074 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:42.906962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 842/1685] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:01:42.912903 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d49bf8-de79-4054-9731-18beb3d8f074 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:42.944291 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d49bf8-de79-4054-9731-18beb3d8f074 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:42.954529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133af65-302f-48a1-8383-31c59409d600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:42.955454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133af65-302f-48a1-8383-31c59409d600 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:42.955877 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133af65-302f-48a1-8383-31c59409d600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:42.956284 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133af65-302f-48a1-8383-31c59409d600 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:42.957131 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4133af65-302f-48a1-8383-31c59409d600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:42.960209 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4133af65-302f-48a1-8383-31c59409d600 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:43.009939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 843/1686] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:01:42 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:43.017685 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133af65-302f-48a1-8383-31c59409d600 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:43.038304 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76da40-4346-48e1-a51e-0ac1f1e976f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:43.041712 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76da40-4346-48e1-a51e-0ac1f1e976f4 service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:43.092717 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 844/1687] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:01:43.167684 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133af65-302f-48a1-8383-31c59409d600 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:43.182967 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc72d76-5787-4d63-8a45-dafd1b69c200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:43.187168 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc72d76-5787-4d63-8a45-dafd1b69c200 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:43.187168 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc72d76-5787-4d63-8a45-dafd1b69c200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:43.188819 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc72d76-5787-4d63-8a45-dafd1b69c200 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:43.190773 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc72d76-5787-4d63-8a45-dafd1b69c200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:43.195028 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc72d76-5787-4d63-8a45-dafd1b69c200 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:43.240938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 844/1688] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:01:43 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:43.243227 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76da40-4346-48e1-a51e-0ac1f1e976f4 service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:43.259723 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76da40-4346-48e1-a51e-0ac1f1e976f4 service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:43.278437 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69de0e-a501-4de3-9bd9-3e37c225e3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:43.305045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69de0e-a501-4de3-9bd9-3e37c225e3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:43.306927 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69de0e-a501-4de3-9bd9-3e37c225e3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:43.307419 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69de0e-a501-4de3-9bd9-3e37c225e3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:43.308639 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69de0e-a501-4de3-9bd9-3e37c225e3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:43.315743 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69de0e-a501-4de3-9bd9-3e37c225e3e0 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:43.374338 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc72d76-5787-4d63-8a45-dafd1b69c200 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:43.380503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 845/1689] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:43.392928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc72d76-5787-4d63-8a45-dafd1b69c200 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:43.407350 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524998fe-0544-42dc-a091-eca87c242bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:43.409834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524998fe-0544-42dc-a091-eca87c242bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:43.410152 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524998fe-0544-42dc-a091-eca87c242bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:43.410456 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524998fe-0544-42dc-a091-eca87c242bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:43.411254 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524998fe-0544-42dc-a091-eca87c242bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:43.415170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524998fe-0544-42dc-a091-eca87c242bb6 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:43.433566 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f0d12-0b8e-41af-84c0-c06186b78101 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:43.434405 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f0d12-0b8e-41af-84c0-c06186b78101 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:43.434888 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f0d12-0b8e-41af-84c0-c06186b78101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:43.446742 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 845/1690] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:43.452535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524998fe-0544-42dc-a091-eca87c242bb6 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:43.470102 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524998fe-0544-42dc-a091-eca87c242bb6 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:43.479086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-7c6f0d12-0b8e-41af-84c0-c06186b78101 None None] MFA Rules not processed for user `686c869be43c40a9b63b3647bf689c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:43.482355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-7c6f0d12-0b8e-41af-84c0-c06186b78101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:43.482588 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843e3be-2dc0-4261-a459-3411f92bf8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:43.484582 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843e3be-2dc0-4261-a459-3411f92bf8f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:43.484898 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843e3be-2dc0-4261-a459-3411f92bf8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:43.487611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843e3be-2dc0-4261-a459-3411f92bf8f5 admin admin] PATH_INFO: `/v3/projects/7dc41ba49b2f46c09611c3f7310de0ea/users/a13735d5c3634f11801b63c3dd3d5981/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:43.524465 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843e3be-2dc0-4261-a459-3411f92bf8f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc41ba49b2f46c09611c3f7310de0ea, user_id=a13735d5c3634f11801b63c3dd3d5981, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:43.530018 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843e3be-2dc0-4261-a459-3411f92bf8f5 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:43.586404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 846/1691] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:43 2022] PUT /identity/v3/projects/7dc41ba49b2f46c09611c3f7310de0ea/users/a13735d5c3634f11801b63c3dd3d5981/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:43.586404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843e3be-2dc0-4261-a459-3411f92bf8f5 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:43.587269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c843e3be-2dc0-4261-a459-3411f92bf8f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:43.621023 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 846/1692] 10.222.0.32 () {58 vars in 1009 bytes} [Tue May 10 14:01:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 10 14:01:43.623615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781cf34-0dce-4c7b-99f8-2280b97bac33 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:43.623902 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781cf34-0dce-4c7b-99f8-2280b97bac33 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:43.624174 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781cf34-0dce-4c7b-99f8-2280b97bac33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:43.695706 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-b781cf34-0dce-4c7b-99f8-2280b97bac33 None None] MFA Rules not processed for user `a13735d5c3634f11801b63c3dd3d5981`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:43.701976 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b781cf34-0dce-4c7b-99f8-2280b97bac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:43.783320 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843e3be-2dc0-4261-a459-3411f92bf8f5 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:43.812996 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea491f-d3d5-4a0c-9445-e46269269434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:43.825122 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea491f-d3d5-4a0c-9445-e46269269434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:43.834438 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea491f-d3d5-4a0c-9445-e46269269434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:43.834438 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea491f-d3d5-4a0c-9445-e46269269434 admin admin] PATH_INFO: `/v3/projects/c0efd7196e024bd99c85176bb72e2bc8` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:43.834438 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea491f-d3d5-4a0c-9445-e46269269434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0efd7196e024bd99c85176bb72e2bc8)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:43.837543 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea491f-d3d5-4a0c-9445-e46269269434 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:44.005566 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 847/1693] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:44.006734 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781cf34-0dce-4c7b-99f8-2280b97bac33 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:44.011667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b781cf34-0dce-4c7b-99f8-2280b97bac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:44.095196 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6eea491f-d3d5-4a0c-9445-e46269269434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0efd7196e024bd99c85176bb72e2bc8', 'request_id': 'req-6eea491f-d3d5-4a0c-9445-e46269269434'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:44.107862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6eea491f-d3d5-4a0c-9445-e46269269434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0efd7196e024bd99c85176bb72e2bc8', 'request_id': 'req-6eea491f-d3d5-4a0c-9445-e46269269434'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:44.122418 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6eea491f-d3d5-4a0c-9445-e46269269434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0efd7196e024bd99c85176bb72e2bc8', 'request_id': 'req-6eea491f-d3d5-4a0c-9445-e46269269434'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:44.162837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6eea491f-d3d5-4a0c-9445-e46269269434 admin admin] The token cache is being invalidate because project c0efd7196e024bd99c85176bb72e2bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:44.163127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6eea491f-d3d5-4a0c-9445-e46269269434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:44.163821 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6eea491f-d3d5-4a0c-9445-e46269269434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:44.169180 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 847/1694] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:01:43 2022] DELETE /identity/v3/projects/c0efd7196e024bd99c85176bb72e2bc8 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:44.169180 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea491f-d3d5-4a0c-9445-e46269269434 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:44.169180 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-6eea491f-d3d5-4a0c-9445-e46269269434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:44.260144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea491f-d3d5-4a0c-9445-e46269269434 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:44.266661 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c89c0-6b3b-45ff-84e2-814e0b9f656e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:44.268012 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c89c0-6b3b-45ff-84e2-814e0b9f656e admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:44.268428 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c89c0-6b3b-45ff-84e2-814e0b9f656e admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:44.268870 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c89c0-6b3b-45ff-84e2-814e0b9f656e admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:44.269703 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c89c0-6b3b-45ff-84e2-814e0b9f656e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:44.272586 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c89c0-6b3b-45ff-84e2-814e0b9f656e admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:44.331063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 848/1695] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:01:44 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:44.331063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb35c4-f68b-427a-ad71-3f947d8d82ce None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:44.331063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb35c4-f68b-427a-ad71-3f947d8d82ce None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:44.331063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb35c4-f68b-427a-ad71-3f947d8d82ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:44.375344 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781cf34-0dce-4c7b-99f8-2280b97bac33 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:44.377871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-12eb35c4-f68b-427a-ad71-3f947d8d82ce None None] MFA Rules not processed for user `c98a5fc7863942c5b389aa9766d31129`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:44.380781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-12eb35c4-f68b-427a-ad71-3f947d8d82ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:44.483485 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 849/1696] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:44.484555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb35c4-f68b-427a-ad71-3f947d8d82ce None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:44.486189 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-12eb35c4-f68b-427a-ad71-3f947d8d82ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:44.571129 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be575837-7745-4655-ba75-e120928c2d67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bbad5318b6417087d7ce6906f8281f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:44.571813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be575837-7745-4655-ba75-e120928c2d67 service swift] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:44.572098 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be575837-7745-4655-ba75-e120928c2d67 service swift] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:44.574039 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be575837-7745-4655-ba75-e120928c2d67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:44.583504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-be575837-7745-4655-ba75-e120928c2d67 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:44.638260 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb35c4-f68b-427a-ad71-3f947d8d82ce None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:44.664231 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5202c3-cab8-44e7-ba44-2b2a4984a6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:44.665114 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5202c3-cab8-44e7-ba44-2b2a4984a6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:44.665222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5202c3-cab8-44e7-ba44-2b2a4984a6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:44.665506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5202c3-cab8-44e7-ba44-2b2a4984a6a5 admin admin] PATH_INFO: `/v3/users/83307211c08b4d778d42f7661e0743e8` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:44.667190 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5202c3-cab8-44e7-ba44-2b2a4984a6a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83307211c08b4d778d42f7661e0743e8)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:44.677240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5202c3-cab8-44e7-ba44-2b2a4984a6a5 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:44.736767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be575837-7745-4655-ba75-e120928c2d67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:44.740391 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be575837-7745-4655-ba75-e120928c2d67 service swift] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:44.753994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 848/1697] 10.222.0.32 () {60 vars in 1384 bytes} [Tue May 10 14:01:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 748 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:01:44.755434 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be575837-7745-4655-ba75-e120928c2d67 service swift] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:44.768288 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be575837-7745-4655-ba75-e120928c2d67 service swift] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:44.774642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a0b62-08e6-4e2e-a507-eb7728adc34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:44.776067 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a0b62-08e6-4e2e-a507-eb7728adc34a admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:44.776067 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a0b62-08e6-4e2e-a507-eb7728adc34a admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:44.776067 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a0b62-08e6-4e2e-a507-eb7728adc34a admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:44.777495 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a0b62-08e6-4e2e-a507-eb7728adc34a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:44.781600 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-dd5202c3-cab8-44e7-ba44-2b2a4984a6a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83307211c08b4d778d42f7661e0743e8'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:44.782356 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-dd5202c3-cab8-44e7-ba44-2b2a4984a6a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83307211c08b4d778d42f7661e0743e8'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:44.782457 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a0b62-08e6-4e2e-a507-eb7728adc34a admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:44.809768 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-dd5202c3-cab8-44e7-ba44-2b2a4984a6a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83307211c08b4d778d42f7661e0743e8'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:44.820009 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 849/1698] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:01:44 2022] POST /identity/v3/users => generated 292 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:44.821081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a0b62-08e6-4e2e-a507-eb7728adc34a admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:44.835564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-dd5202c3-cab8-44e7-ba44-2b2a4984a6a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83307211c08b4d778d42f7661e0743e8'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:44.841188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-870a0b62-08e6-4e2e-a507-eb7728adc34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:44.853188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-dd5202c3-cab8-44e7-ba44-2b2a4984a6a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83307211c08b4d778d42f7661e0743e8'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:44.875330 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 850/1699] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:01:44 2022] DELETE /identity/v3/users/83307211c08b4d778d42f7661e0743e8 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:44.878886 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c09ee-006a-4eca-bf25-b0a2cbdde90c None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:44.879252 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c09ee-006a-4eca-bf25-b0a2cbdde90c None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:44.880055 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c09ee-006a-4eca-bf25-b0a2cbdde90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:44.952926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-785c09ee-006a-4eca-bf25-b0a2cbdde90c None None] MFA Rules not processed for user `1897b88622664ceca4deac5a22079726`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:44.955824 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-785c09ee-006a-4eca-bf25-b0a2cbdde90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:45.159338 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a0b62-08e6-4e2e-a507-eb7728adc34a admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:45.255196 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 851/1700] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:45.259096 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c09ee-006a-4eca-bf25-b0a2cbdde90c None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:45.264919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-785c09ee-006a-4eca-bf25-b0a2cbdde90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:45.412567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7eddd-ca6c-473b-9897-623fa77ac3c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:45.413440 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7eddd-ca6c-473b-9897-623fa77ac3c6 service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:45.413722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7eddd-ca6c-473b-9897-623fa77ac3c6 service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:45.415747 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7eddd-ca6c-473b-9897-623fa77ac3c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:45.420488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-edf7eddd-ca6c-473b-9897-623fa77ac3c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:45.472125 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c09ee-006a-4eca-bf25-b0a2cbdde90c None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:45.495614 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4152dd9-127e-4159-802d-ad1e92cece25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:45.496320 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4152dd9-127e-4159-802d-ad1e92cece25 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:45.496612 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4152dd9-127e-4159-802d-ad1e92cece25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:45.496894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4152dd9-127e-4159-802d-ad1e92cece25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:45.497647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4152dd9-127e-4159-802d-ad1e92cece25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:45.503833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4152dd9-127e-4159-802d-ad1e92cece25 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:45.532897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 852/1701] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:45.534119 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922493af-116f-4377-8da0-fed5e3a9cf19 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:45.540841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922493af-116f-4377-8da0-fed5e3a9cf19 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:45.541127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922493af-116f-4377-8da0-fed5e3a9cf19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:45.608655 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7eddd-ca6c-473b-9897-623fa77ac3c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:45.623380 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-922493af-116f-4377-8da0-fed5e3a9cf19 None None] MFA Rules not processed for user `1897b88622664ceca4deac5a22079726`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:45.624332 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7eddd-ca6c-473b-9897-623fa77ac3c6 service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:45.626874 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-922493af-116f-4377-8da0-fed5e3a9cf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:45.667577 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 853/1702] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:45.670708 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922493af-116f-4377-8da0-fed5e3a9cf19 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:45.672613 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 850/1703] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 852 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:45.729103 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922493af-116f-4377-8da0-fed5e3a9cf19 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:45.750957 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd6f08-62fd-458c-a197-a8532d8d8273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:45.752446 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd6f08-62fd-458c-a197-a8532d8d8273 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:45.753114 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd6f08-62fd-458c-a197-a8532d8d8273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:45.753489 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd6f08-62fd-458c-a197-a8532d8d8273 admin admin] PATH_INFO: `/v3/projects/a4ff43c6854442d499a0c0e73d78ac60/users/cacd3500f640486496fbdb4eebe9dfa6/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:45.812710 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd6f08-62fd-458c-a197-a8532d8d8273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ff43c6854442d499a0c0e73d78ac60, user_id=cacd3500f640486496fbdb4eebe9dfa6, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:45.823938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd6f08-62fd-458c-a197-a8532d8d8273 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:45.835878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7eddd-ca6c-473b-9897-623fa77ac3c6 service nova] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:45.837894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-edf7eddd-ca6c-473b-9897-623fa77ac3c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:45.862682 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 854/1704] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:45 2022] PUT /identity/v3/projects/a4ff43c6854442d499a0c0e73d78ac60/users/cacd3500f640486496fbdb4eebe9dfa6/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:45.870603 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7eddd-ca6c-473b-9897-623fa77ac3c6 service nova] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:45.876743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd6f08-62fd-458c-a197-a8532d8d8273 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:46.079554 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29584367-bd47-45a4-8ad3-9ce81249af5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:46.098429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29584367-bd47-45a4-8ad3-9ce81249af5e service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:46.099956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29584367-bd47-45a4-8ad3-9ce81249af5e service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:46.100298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29584367-bd47-45a4-8ad3-9ce81249af5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:46.128630 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd6f08-62fd-458c-a197-a8532d8d8273 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:46.151334 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d3ea8-faa6-4316-bca3-bef74120fbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:46.152045 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d3ea8-faa6-4316-bca3-bef74120fbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:46.152331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d3ea8-faa6-4316-bca3-bef74120fbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:46.152604 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d3ea8-faa6-4316-bca3-bef74120fbf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:46.153362 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d3ea8-faa6-4316-bca3-bef74120fbf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:46.161677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d3ea8-faa6-4316-bca3-bef74120fbf7 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:46.195459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 855/1705] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:46.196377 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d3ea8-faa6-4316-bca3-bef74120fbf7 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:46.213208 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-763d3ea8-faa6-4316-bca3-bef74120fbf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:46.262424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d3ea8-faa6-4316-bca3-bef74120fbf7 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:46.272058 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29584367-bd47-45a4-8ad3-9ce81249af5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:46.275411 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29584367-bd47-45a4-8ad3-9ce81249af5e service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:46.279922 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b0a21-7e57-4aeb-8284-cef128c60ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:46.280819 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b0a21-7e57-4aeb-8284-cef128c60ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:46.281133 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b0a21-7e57-4aeb-8284-cef128c60ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:46.281820 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b0a21-7e57-4aeb-8284-cef128c60ed9 admin admin] PATH_INFO: `/v3/projects/10f38e6004cb444d8ed6ba0c573c411f` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:46.294824 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b0a21-7e57-4aeb-8284-cef128c60ed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10f38e6004cb444d8ed6ba0c573c411f)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:46.296780 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b0a21-7e57-4aeb-8284-cef128c60ed9 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:46.324395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 851/1706] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:46.325852 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29584367-bd47-45a4-8ad3-9ce81249af5e service nova] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:46.381296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29584367-bd47-45a4-8ad3-9ce81249af5e service nova] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:46.404609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c6530-8000-4252-8406-df427c9889fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:46.406612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c6530-8000-4252-8406-df427c9889fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:46.407073 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c6530-8000-4252-8406-df427c9889fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:46.407602 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c6530-8000-4252-8406-df427c9889fc admin admin] PATH_INFO: `/v3/projects/a4ff43c6854442d499a0c0e73d78ac60/users/cacd3500f640486496fbdb4eebe9dfa6/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:46.417288 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c6530-8000-4252-8406-df427c9889fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ff43c6854442d499a0c0e73d78ac60, user_id=cacd3500f640486496fbdb4eebe9dfa6, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:46.420438 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c6530-8000-4252-8406-df427c9889fc admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:46.450344 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 852/1707] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:46 2022] PUT /identity/v3/projects/a4ff43c6854442d499a0c0e73d78ac60/users/cacd3500f640486496fbdb4eebe9dfa6/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:46.451428 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c6530-8000-4252-8406-df427c9889fc admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:46.461342 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-bf6c6530-8000-4252-8406-df427c9889fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:46.471657 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-ac0b0a21-7e57-4aeb-8284-cef128c60ed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10f38e6004cb444d8ed6ba0c573c411f', 'request_id': 'req-ac0b0a21-7e57-4aeb-8284-cef128c60ed9'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:46.484887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-ac0b0a21-7e57-4aeb-8284-cef128c60ed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10f38e6004cb444d8ed6ba0c573c411f', 'request_id': 'req-ac0b0a21-7e57-4aeb-8284-cef128c60ed9'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:46.507032 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-ac0b0a21-7e57-4aeb-8284-cef128c60ed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10f38e6004cb444d8ed6ba0c573c411f', 'request_id': 'req-ac0b0a21-7e57-4aeb-8284-cef128c60ed9'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:46.538399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-ac0b0a21-7e57-4aeb-8284-cef128c60ed9 admin admin] The token cache is being invalidate because project 10f38e6004cb444d8ed6ba0c573c411f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:46.538763 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-ac0b0a21-7e57-4aeb-8284-cef128c60ed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:46.548986 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-ac0b0a21-7e57-4aeb-8284-cef128c60ed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:46.551051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 856/1708] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:01:46 2022] DELETE /identity/v3/projects/10f38e6004cb444d8ed6ba0c573c411f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:46.557356 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505718f9-85fe-441f-8fca-6e6c249f1ce7 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:46.557747 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505718f9-85fe-441f-8fca-6e6c249f1ce7 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:46.557914 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505718f9-85fe-441f-8fca-6e6c249f1ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:46.639909 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-505718f9-85fe-441f-8fca-6e6c249f1ce7 None None] MFA Rules not processed for user `cacd3500f640486496fbdb4eebe9dfa6`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:46.649789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-505718f9-85fe-441f-8fca-6e6c249f1ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:46.821715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c6530-8000-4252-8406-df427c9889fc admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:46.867419 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b01bd3-d8b1-4f20-aaff-fe20b3e403ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:46.868340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b01bd3-d8b1-4f20-aaff-fe20b3e403ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:46.868621 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b01bd3-d8b1-4f20-aaff-fe20b3e403ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:46.868897 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b01bd3-d8b1-4f20-aaff-fe20b3e403ea admin admin] PATH_INFO: `/v3/users/e144879406f14a10818dcc702ecf6a81` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:46.874730 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b01bd3-d8b1-4f20-aaff-fe20b3e403ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e144879406f14a10818dcc702ecf6a81)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:46.876748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b01bd3-d8b1-4f20-aaff-fe20b3e403ea admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:46.881325 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 857/1709] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:46 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:46.888449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681ba20-40a3-45dc-b784-0705bf69d245 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:46.888876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681ba20-40a3-45dc-b784-0705bf69d245 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:46.889427 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681ba20-40a3-45dc-b784-0705bf69d245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:46.920373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-f681ba20-40a3-45dc-b784-0705bf69d245 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:46.922271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f681ba20-40a3-45dc-b784-0705bf69d245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:46.944519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 858/1710] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:46.945758 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681ba20-40a3-45dc-b784-0705bf69d245 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:46.955832 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f681ba20-40a3-45dc-b784-0705bf69d245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:47.036961 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-34b01bd3-d8b1-4f20-aaff-fe20b3e403ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e144879406f14a10818dcc702ecf6a81'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:47.056878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-34b01bd3-d8b1-4f20-aaff-fe20b3e403ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e144879406f14a10818dcc702ecf6a81'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:47.096645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-34b01bd3-d8b1-4f20-aaff-fe20b3e403ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e144879406f14a10818dcc702ecf6a81'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:47.102520 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-34b01bd3-d8b1-4f20-aaff-fe20b3e403ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e144879406f14a10818dcc702ecf6a81'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:47.103672 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-34b01bd3-d8b1-4f20-aaff-fe20b3e403ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e144879406f14a10818dcc702ecf6a81'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:47.126439 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681ba20-40a3-45dc-b784-0705bf69d245 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:47.147302 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032f54d-adf0-445c-94b5-f228bee627cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:47.152835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032f54d-adf0-445c-94b5-f228bee627cc service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:47.153024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 853/1711] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:01:46 2022] DELETE /identity/v3/users/e144879406f14a10818dcc702ecf6a81 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:47.153124 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032f54d-adf0-445c-94b5-f228bee627cc service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:47.153124 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032f54d-adf0-445c-94b5-f228bee627cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:47.155725 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242391fa-cfbc-4207-a5d2-2c5375b14030 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:47.156269 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242391fa-cfbc-4207-a5d2-2c5375b14030 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:47.157724 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242391fa-cfbc-4207-a5d2-2c5375b14030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:47.158401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-3032f54d-adf0-445c-94b5-f228bee627cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:47.195294 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032f54d-adf0-445c-94b5-f228bee627cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:47.199673 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032f54d-adf0-445c-94b5-f228bee627cc service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:47.213429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-242391fa-cfbc-4207-a5d2-2c5375b14030 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:47.215924 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-242391fa-cfbc-4207-a5d2-2c5375b14030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:47.221682 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 859/1712] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:46 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:47.225881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e70109-5a3b-4f25-8207-83dbf96a992c None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:47.227070 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e70109-5a3b-4f25-8207-83dbf96a992c None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:47.227528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e70109-5a3b-4f25-8207-83dbf96a992c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:47.306687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-56e70109-5a3b-4f25-8207-83dbf96a992c None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:47.307921 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-56e70109-5a3b-4f25-8207-83dbf96a992c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:47.359113 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 854/1713] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:47.363279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242391fa-cfbc-4207-a5d2-2c5375b14030 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:47.374741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242391fa-cfbc-4207-a5d2-2c5375b14030 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:47.383401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683e1b0-7a4d-482b-b921-031e8ed74e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:47.384122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683e1b0-7a4d-482b-b921-031e8ed74e1e admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:47.384409 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683e1b0-7a4d-482b-b921-031e8ed74e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:47.384683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683e1b0-7a4d-482b-b921-031e8ed74e1e admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:47.385837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683e1b0-7a4d-482b-b921-031e8ed74e1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:47.386151 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683e1b0-7a4d-482b-b921-031e8ed74e1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:47.393681 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683e1b0-7a4d-482b-b921-031e8ed74e1e admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:47.443392 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 855/1714] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:01:47.443392 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683e1b0-7a4d-482b-b921-031e8ed74e1e admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:47.446587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-5683e1b0-7a4d-482b-b921-031e8ed74e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:47.540837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 860/1715] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:47.541700 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e70109-5a3b-4f25-8207-83dbf96a992c None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:47.572046 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e70109-5a3b-4f25-8207-83dbf96a992c None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:47.591746 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683e1b0-7a4d-482b-b921-031e8ed74e1e admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:47.594051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a762246-efd8-4635-9364-0b7a40584aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:47.594892 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a762246-efd8-4635-9364-0b7a40584aca admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:47.595199 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a762246-efd8-4635-9364-0b7a40584aca admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:47.595552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a762246-efd8-4635-9364-0b7a40584aca admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:47.596252 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a762246-efd8-4635-9364-0b7a40584aca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:47.598145 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6f89a-367c-46d2-ad1c-9bc7080f4c37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:47.599540 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a762246-efd8-4635-9364-0b7a40584aca admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:47.600147 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6f89a-367c-46d2-ad1c-9bc7080f4c37 service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:47.600609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6f89a-367c-46d2-ad1c-9bc7080f4c37 service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:47.600876 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6f89a-367c-46d2-ad1c-9bc7080f4c37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:47.603873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-cfc6f89a-367c-46d2-ad1c-9bc7080f4c37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:47.709025 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 861/1716] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:01:47 2022] POST /identity/v3/projects => generated 399 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:47.710523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c58c5-6adc-41b3-9b27-aed1165e8ea7 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:47.710812 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c58c5-6adc-41b3-9b27-aed1165e8ea7 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:47.711089 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c58c5-6adc-41b3-9b27-aed1165e8ea7 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:47.737585 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 862/1717] 10.222.0.32 () {54 vars in 912 bytes} [Tue May 10 14:01:47 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:01:47.738652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c58c5-6adc-41b3-9b27-aed1165e8ea7 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:47.745755 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6f89a-367c-46d2-ad1c-9bc7080f4c37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:47.752467 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6f89a-367c-46d2-ad1c-9bc7080f4c37 service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:47.755231 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-887c58c5-6adc-41b3-9b27-aed1165e8ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:47.763115 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 856/1718] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:47.764558 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6f89a-367c-46d2-ad1c-9bc7080f4c37 service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:47.780662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6f89a-367c-46d2-ad1c-9bc7080f4c37 service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:47.925796 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8528fec-cc7b-4304-a3d7-9ca52c32a093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:47.928315 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8528fec-cc7b-4304-a3d7-9ca52c32a093 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:47.929396 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8528fec-cc7b-4304-a3d7-9ca52c32a093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:47.932185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8528fec-cc7b-4304-a3d7-9ca52c32a093 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:47.934733 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8528fec-cc7b-4304-a3d7-9ca52c32a093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:47.950183 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8528fec-cc7b-4304-a3d7-9ca52c32a093 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:47.968881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c58c5-6adc-41b3-9b27-aed1165e8ea7 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:47.978366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20b534-7a14-455c-88f9-ee1a7639d328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:47.982245 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20b534-7a14-455c-88f9-ee1a7639d328 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:47.982522 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20b534-7a14-455c-88f9-ee1a7639d328 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:47.982743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20b534-7a14-455c-88f9-ee1a7639d328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:48.016635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20b534-7a14-455c-88f9-ee1a7639d328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:48.018180 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 857/1719] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:01:47 2022] POST /identity/v3/users => generated 300 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:48.022444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20b534-7a14-455c-88f9-ee1a7639d328 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:48.022679 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ca0cb-b394-4118-9642-d5273760a6a0 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:48.022952 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ca0cb-b394-4118-9642-d5273760a6a0 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:48.034848 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ca0cb-b394-4118-9642-d5273760a6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:48.064575 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 863/1720] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:48.065871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20b534-7a14-455c-88f9-ee1a7639d328 service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:48.076862 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-f26ca0cb-b394-4118-9642-d5273760a6a0 None None] MFA Rules not processed for user `12eb1c001b5e44d8b5b5bc658ed464f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:48.079350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-f26ca0cb-b394-4118-9642-d5273760a6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:48.096026 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 858/1721] 10.222.0.32 () {58 vars in 1009 bytes} [Tue May 10 14:01:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:48.130518 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ca0cb-b394-4118-9642-d5273760a6a0 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:48.132528 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-f26ca0cb-b394-4118-9642-d5273760a6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:48.147135 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20b534-7a14-455c-88f9-ee1a7639d328 service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:48.154132 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ca0cb-b394-4118-9642-d5273760a6a0 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:48.167035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5d2a2-6be1-4787-afb9-94cd77ba584e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:48.167411 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319083e-f2f4-4041-91db-bd94b06ace35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:48.167768 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5d2a2-6be1-4787-afb9-94cd77ba584e admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:48.168057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5d2a2-6be1-4787-afb9-94cd77ba584e admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:48.168337 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5d2a2-6be1-4787-afb9-94cd77ba584e admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:48.168927 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319083e-f2f4-4041-91db-bd94b06ace35 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:48.169086 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5d2a2-6be1-4787-afb9-94cd77ba584e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:48.170623 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319083e-f2f4-4041-91db-bd94b06ace35 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:48.170944 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319083e-f2f4-4041-91db-bd94b06ace35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:48.193353 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319083e-f2f4-4041-91db-bd94b06ace35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:48.194332 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5d2a2-6be1-4787-afb9-94cd77ba584e admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:48.197056 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319083e-f2f4-4041-91db-bd94b06ace35 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:48.221526 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 859/1722] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:48.238685 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319083e-f2f4-4041-91db-bd94b06ace35 service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:48.252100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 864/1723] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:48.269183 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319083e-f2f4-4041-91db-bd94b06ace35 service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:48.276652 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ee273-695b-402a-b32f-b85d62cf36a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:48.277355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ee273-695b-402a-b32f-b85d62cf36a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:48.277683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ee273-695b-402a-b32f-b85d62cf36a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:48.277963 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ee273-695b-402a-b32f-b85d62cf36a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:48.281927 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ee273-695b-402a-b32f-b85d62cf36a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:48.287095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ee273-695b-402a-b32f-b85d62cf36a8 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:48.324906 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 860/1724] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:01:48.326159 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5d2a2-6be1-4787-afb9-94cd77ba584e admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:48.338659 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5d2a2-6be1-4787-afb9-94cd77ba584e admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:48.366817 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99bebc-1951-4a48-af16-752d311450cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:48.367905 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99bebc-1951-4a48-af16-752d311450cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:48.368250 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99bebc-1951-4a48-af16-752d311450cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:48.368861 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99bebc-1951-4a48-af16-752d311450cf admin admin] PATH_INFO: `/v3/projects/258cea3bff244e188a1e92b8a55a2219/users/c18aa0966c8c42a895ced7945d2bcf67/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:48.457237 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99bebc-1951-4a48-af16-752d311450cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=258cea3bff244e188a1e92b8a55a2219, user_id=c18aa0966c8c42a895ced7945d2bcf67, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:48.473773 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99bebc-1951-4a48-af16-752d311450cf admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:48.543180 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 865/1725] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:48 2022] PUT /identity/v3/projects/258cea3bff244e188a1e92b8a55a2219/users/c18aa0966c8c42a895ced7945d2bcf67/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:48.557052 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7d5dc-4f10-4922-b3fb-1a03feee0df0 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:48.557619 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7d5dc-4f10-4922-b3fb-1a03feee0df0 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:48.557619 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7d5dc-4f10-4922-b3fb-1a03feee0df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:48.594168 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-59a7d5dc-4f10-4922-b3fb-1a03feee0df0 None None] MFA Rules not processed for user `c18aa0966c8c42a895ced7945d2bcf67`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:48.597502 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-59a7d5dc-4f10-4922-b3fb-1a03feee0df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:48.713830 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 861/1726] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:48.714600 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99bebc-1951-4a48-af16-752d311450cf admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:48.842743 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7d5dc-4f10-4922-b3fb-1a03feee0df0 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:48.844570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-59a7d5dc-4f10-4922-b3fb-1a03feee0df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:48.960846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99bebc-1951-4a48-af16-752d311450cf admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:48.978504 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd652b3-733f-428b-908f-e5522edecf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:48.979212 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd652b3-733f-428b-908f-e5522edecf9d admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:48.979469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd652b3-733f-428b-908f-e5522edecf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:48.979738 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd652b3-733f-428b-908f-e5522edecf9d admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:48.981441 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd652b3-733f-428b-908f-e5522edecf9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:48.983681 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd652b3-733f-428b-908f-e5522edecf9d admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:49.000900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7d5dc-4f10-4922-b3fb-1a03feee0df0 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:49.006913 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a14bf-df36-4085-a053-f68482bd8889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:49.008629 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a14bf-df36-4085-a053-f68482bd8889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:49.009059 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a14bf-df36-4085-a053-f68482bd8889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:49.010928 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a14bf-df36-4085-a053-f68482bd8889 admin admin] PATH_INFO: `/v3/projects/e21b6bba67764b7989197eda3f4c6804` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:49.015167 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a14bf-df36-4085-a053-f68482bd8889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e21b6bba67764b7989197eda3f4c6804)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:49.019139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a14bf-df36-4085-a053-f68482bd8889 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:49.069641 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 866/1727] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:01:48 2022] POST /identity/v3/projects => generated 401 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:01:49.077717 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd652b3-733f-428b-908f-e5522edecf9d admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:49.197563 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-611a14bf-df36-4085-a053-f68482bd8889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e21b6bba67764b7989197eda3f4c6804', 'request_id': 'req-611a14bf-df36-4085-a053-f68482bd8889'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:49.252831 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-611a14bf-df36-4085-a053-f68482bd8889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e21b6bba67764b7989197eda3f4c6804', 'request_id': 'req-611a14bf-df36-4085-a053-f68482bd8889'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:49.277164 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-611a14bf-df36-4085-a053-f68482bd8889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e21b6bba67764b7989197eda3f4c6804', 'request_id': 'req-611a14bf-df36-4085-a053-f68482bd8889'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:49.336944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd652b3-733f-428b-908f-e5522edecf9d admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:49.347519 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-611a14bf-df36-4085-a053-f68482bd8889 admin admin] The token cache is being invalidate because project e21b6bba67764b7989197eda3f4c6804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:49.355274 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-611a14bf-df36-4085-a053-f68482bd8889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:49.356248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-611a14bf-df36-4085-a053-f68482bd8889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:49.359173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 862/1728] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:01:48 2022] DELETE /identity/v3/projects/e21b6bba67764b7989197eda3f4c6804 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:49.360632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2c4be-8d00-4081-8be3-d02ec1eb8c4c None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:49.361013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2c4be-8d00-4081-8be3-d02ec1eb8c4c None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:49.361416 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2c4be-8d00-4081-8be3-d02ec1eb8c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:49.439008 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-3ca2c4be-8d00-4081-8be3-d02ec1eb8c4c None None] MFA Rules not processed for user `12eb1c001b5e44d8b5b5bc658ed464f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:49.440561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-3ca2c4be-8d00-4081-8be3-d02ec1eb8c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:49.478477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c104d-24d1-4159-b4d3-ed4f2032b9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:49.480425 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c104d-24d1-4159-b4d3-ed4f2032b9cf admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:49.481027 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c104d-24d1-4159-b4d3-ed4f2032b9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:49.481287 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c104d-24d1-4159-b4d3-ed4f2032b9cf admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:49.482178 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c104d-24d1-4159-b4d3-ed4f2032b9cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:49.484386 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c104d-24d1-4159-b4d3-ed4f2032b9cf admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:49.534112 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 867/1729] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:01:49 2022] POST /identity/v3/users => generated 307 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:49.537544 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b60d1-ea56-4406-a26d-9db1b814532d None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:49.537853 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b60d1-ea56-4406-a26d-9db1b814532d None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:49.538142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b60d1-ea56-4406-a26d-9db1b814532d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:49.588318 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-8f7b60d1-ea56-4406-a26d-9db1b814532d None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:49.590344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-8f7b60d1-ea56-4406-a26d-9db1b814532d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:49.622352 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 863/1730] 10.222.0.59 () {58 vars in 1015 bytes} [Tue May 10 14:01:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:49.628191 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2c4be-8d00-4081-8be3-d02ec1eb8c4c None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:49.634248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-3ca2c4be-8d00-4081-8be3-d02ec1eb8c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:49.634507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 868/1731] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:49.636910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4108fa-7a44-4a0c-9b0f-37a5c5de2ece None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:49.637209 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4108fa-7a44-4a0c-9b0f-37a5c5de2ece None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:49.637569 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4108fa-7a44-4a0c-9b0f-37a5c5de2ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:49.686869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-ad4108fa-7a44-4a0c-9b0f-37a5c5de2ece None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:49.688119 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-ad4108fa-7a44-4a0c-9b0f-37a5c5de2ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:49.689470 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2c4be-8d00-4081-8be3-d02ec1eb8c4c None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:49.714491 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 869/1732] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:49.718634 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4108fa-7a44-4a0c-9b0f-37a5c5de2ece None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:49.737423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51803351-820e-48b9-8fee-9081fc4532d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:49.740344 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51803351-820e-48b9-8fee-9081fc4532d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:49.740344 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51803351-820e-48b9-8fee-9081fc4532d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:49.745336 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4108fa-7a44-4a0c-9b0f-37a5c5de2ece None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:49.748398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51803351-820e-48b9-8fee-9081fc4532d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:49.750123 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51803351-820e-48b9-8fee-9081fc4532d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:49.753257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51803351-820e-48b9-8fee-9081fc4532d4 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:49.764569 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0962a71-a88a-4787-9574-72022e068a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:49.765643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0962a71-a88a-4787-9574-72022e068a1a admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:49.766230 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0962a71-a88a-4787-9574-72022e068a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:49.766741 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0962a71-a88a-4787-9574-72022e068a1a admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:49.767775 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0962a71-a88a-4787-9574-72022e068a1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:49.770877 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0962a71-a88a-4787-9574-72022e068a1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:49.773465 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0962a71-a88a-4787-9574-72022e068a1a admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:49.806406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 864/1733] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:49.810728 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51803351-820e-48b9-8fee-9081fc4532d4 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:49.812396 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 870/1734] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:01:49.813353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0962a71-a88a-4787-9574-72022e068a1a admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:49.828039 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51803351-820e-48b9-8fee-9081fc4532d4 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:49.835202 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e65ef-2cd2-4f6c-8961-612de9546f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:49.836373 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e65ef-2cd2-4f6c-8961-612de9546f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:49.836800 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e65ef-2cd2-4f6c-8961-612de9546f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:49.837564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e65ef-2cd2-4f6c-8961-612de9546f09 admin admin] PATH_INFO: `/v3/projects/f4b2ad4cd1f74fc8bf99d935a2d6309f/users/8ca31ea3c27b4a00a62d84e302a76ec6/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:49.857657 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0962a71-a88a-4787-9574-72022e068a1a admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:49.873312 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142180e-ff26-4bd2-8f38-3e813e1783cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:49.874293 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142180e-ff26-4bd2-8f38-3e813e1783cf admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:49.874842 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142180e-ff26-4bd2-8f38-3e813e1783cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:49.875975 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e65ef-2cd2-4f6c-8961-612de9546f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b2ad4cd1f74fc8bf99d935a2d6309f, user_id=8ca31ea3c27b4a00a62d84e302a76ec6, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:49.876512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142180e-ff26-4bd2-8f38-3e813e1783cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:49.877703 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142180e-ff26-4bd2-8f38-3e813e1783cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:49.884189 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142180e-ff26-4bd2-8f38-3e813e1783cf admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:49.885480 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e65ef-2cd2-4f6c-8961-612de9546f09 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:49.920324 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 865/1735] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:49 2022] PUT /identity/v3/projects/f4b2ad4cd1f74fc8bf99d935a2d6309f/users/8ca31ea3c27b4a00a62d84e302a76ec6/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:49.924349 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e65ef-2cd2-4f6c-8961-612de9546f09 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:50.002006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 871/1736] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:01:49 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:50.009160 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142180e-ff26-4bd2-8f38-3e813e1783cf admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:50.024396 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e65ef-2cd2-4f6c-8961-612de9546f09 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:50.111178 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29ce50-c7be-491e-9bcb-e1236a005681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:50.114059 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29ce50-c7be-491e-9bcb-e1236a005681 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:50.115772 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29ce50-c7be-491e-9bcb-e1236a005681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:50.116014 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29ce50-c7be-491e-9bcb-e1236a005681 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:50.120162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29ce50-c7be-491e-9bcb-e1236a005681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:50.125000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29ce50-c7be-491e-9bcb-e1236a005681 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:50.178806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 866/1737] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:01:50.180405 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64471e0-6c57-4da8-9080-38b84742cb8c None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:50.180697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64471e0-6c57-4da8-9080-38b84742cb8c None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:50.180975 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64471e0-6c57-4da8-9080-38b84742cb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:50.230407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142180e-ff26-4bd2-8f38-3e813e1783cf admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:50.232571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-e64471e0-6c57-4da8-9080-38b84742cb8c None None] MFA Rules not processed for user `1897b88622664ceca4deac5a22079726`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:50.234026 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-e64471e0-6c57-4da8-9080-38b84742cb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:50.248272 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d3a45-ad43-4cd3-be0e-320b4535ed80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:50.248582 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d3a45-ad43-4cd3-be0e-320b4535ed80 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:50.248869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d3a45-ad43-4cd3-be0e-320b4535ed80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:50.249306 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d3a45-ad43-4cd3-be0e-320b4535ed80 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:50.250354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d3a45-ad43-4cd3-be0e-320b4535ed80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:50.253938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d3a45-ad43-4cd3-be0e-320b4535ed80 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:50.337502 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 872/1738] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:01:50 2022] POST /identity/v3/users => generated 289 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:50.339933 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d3a45-ad43-4cd3-be0e-320b4535ed80 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:50.385082 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d3a45-ad43-4cd3-be0e-320b4535ed80 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:50.401582 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a3ad2-ffce-4678-93d0-1a89ffbf2da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:50.402471 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a3ad2-ffce-4678-93d0-1a89ffbf2da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:50.407387 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a3ad2-ffce-4678-93d0-1a89ffbf2da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:50.407711 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a3ad2-ffce-4678-93d0-1a89ffbf2da2 admin admin] PATH_INFO: `/v3/projects/f4b2ad4cd1f74fc8bf99d935a2d6309f/users/8ca31ea3c27b4a00a62d84e302a76ec6/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:50.419713 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a3ad2-ffce-4678-93d0-1a89ffbf2da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b2ad4cd1f74fc8bf99d935a2d6309f, user_id=8ca31ea3c27b4a00a62d84e302a76ec6, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:50.423396 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 867/1739] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:50.427575 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64471e0-6c57-4da8-9080-38b84742cb8c None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:50.442924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a3ad2-ffce-4678-93d0-1a89ffbf2da2 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:50.444440 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64471e0-6c57-4da8-9080-38b84742cb8c None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:50.450254 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a76e2b-51b9-4710-858a-a9d8ae46d3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:50.451057 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a76e2b-51b9-4710-858a-a9d8ae46d3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:50.451473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a76e2b-51b9-4710-858a-a9d8ae46d3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:50.452558 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a76e2b-51b9-4710-858a-a9d8ae46d3a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:50.452915 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a76e2b-51b9-4710-858a-a9d8ae46d3a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:50.455277 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a76e2b-51b9-4710-858a-a9d8ae46d3a6 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:50.477272 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 873/1740] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:50 2022] PUT /identity/v3/projects/f4b2ad4cd1f74fc8bf99d935a2d6309f/users/8ca31ea3c27b4a00a62d84e302a76ec6/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:50.491783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5046bcb-94cd-4312-90d3-54757aca9f06 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:50.492552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5046bcb-94cd-4312-90d3-54757aca9f06 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:50.493660 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5046bcb-94cd-4312-90d3-54757aca9f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:50.501765 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 868/1741] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:50.506365 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a76e2b-51b9-4710-858a-a9d8ae46d3a6 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:50.521657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a76e2b-51b9-4710-858a-a9d8ae46d3a6 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:50.585374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-f5046bcb-94cd-4312-90d3-54757aca9f06 None None] MFA Rules not processed for user `8ca31ea3c27b4a00a62d84e302a76ec6`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:50.590616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f5046bcb-94cd-4312-90d3-54757aca9f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:50.704793 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bca1ce-23b7-4a82-ad93-776e0a259f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:50.708826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bca1ce-23b7-4a82-ad93-776e0a259f0b admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:50.712872 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bca1ce-23b7-4a82-ad93-776e0a259f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:50.713284 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bca1ce-23b7-4a82-ad93-776e0a259f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:50.714339 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bca1ce-23b7-4a82-ad93-776e0a259f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:50.718079 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bca1ce-23b7-4a82-ad93-776e0a259f0b admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:50.740632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 874/1742] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:50 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:50.746739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 869/1743] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:01:50.751060 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5046bcb-94cd-4312-90d3-54757aca9f06 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:50.755905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bca1ce-23b7-4a82-ad93-776e0a259f0b admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:50.758498 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-37bca1ce-23b7-4a82-ad93-776e0a259f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:50.782064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5046bcb-94cd-4312-90d3-54757aca9f06 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:50.799097 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b6918-9201-4caf-80c8-2321d16b9aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:50.800930 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b6918-9201-4caf-80c8-2321d16b9aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:50.803160 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b6918-9201-4caf-80c8-2321d16b9aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:50.804844 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b6918-9201-4caf-80c8-2321d16b9aa3 admin admin] PATH_INFO: `/v3/projects/f4c8b4d897af41e48334a798e0a40c7c/users/f0cbe00f23f74e528b95e85984d10d80/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:50.831891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b6918-9201-4caf-80c8-2321d16b9aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4c8b4d897af41e48334a798e0a40c7c, user_id=f0cbe00f23f74e528b95e85984d10d80, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:50.837965 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b6918-9201-4caf-80c8-2321d16b9aa3 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:50.933440 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 875/1744] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:50 2022] PUT /identity/v3/projects/f4c8b4d897af41e48334a798e0a40c7c/users/f0cbe00f23f74e528b95e85984d10d80/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:50.935251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40737345-68b5-41d5-a92a-d4f881a7b4fc None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:50.939492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40737345-68b5-41d5-a92a-d4f881a7b4fc None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:50.942162 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40737345-68b5-41d5-a92a-d4f881a7b4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:50.945442 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bca1ce-23b7-4a82-ad93-776e0a259f0b admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:51.050479 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f0d38-15ab-478d-868c-5c614c10851c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:51.052633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-40737345-68b5-41d5-a92a-d4f881a7b4fc None None] MFA Rules not processed for user `f0cbe00f23f74e528b95e85984d10d80`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:51.053172 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f0d38-15ab-478d-868c-5c614c10851c service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:51.054114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f0d38-15ab-478d-868c-5c614c10851c service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:51.055560 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f0d38-15ab-478d-868c-5c614c10851c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:51.063871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-40737345-68b5-41d5-a92a-d4f881a7b4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:51.280675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 876/1745] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:51.283767 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40737345-68b5-41d5-a92a-d4f881a7b4fc None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:51.326173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f0d38-15ab-478d-868c-5c614c10851c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:51.351094 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f0d38-15ab-478d-868c-5c614c10851c service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:51.419277 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 870/1746] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:50 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:01:51.427083 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f0d38-15ab-478d-868c-5c614c10851c service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:51.444742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-dc2f0d38-15ab-478d-868c-5c614c10851c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:51.695455 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40737345-68b5-41d5-a92a-d4f881a7b4fc None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:51.713399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca2508-f28e-4449-8f14-70c344e5fa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:51.714099 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca2508-f28e-4449-8f14-70c344e5fa91 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:51.721536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca2508-f28e-4449-8f14-70c344e5fa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:51.721871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca2508-f28e-4449-8f14-70c344e5fa91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:51.727008 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca2508-f28e-4449-8f14-70c344e5fa91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:51.735421 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca2508-f28e-4449-8f14-70c344e5fa91 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:51.796734 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f0d38-15ab-478d-868c-5c614c10851c service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:51.813797 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de2b68-e439-4ef8-b83f-2747633cac35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:51.816307 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de2b68-e439-4ef8-b83f-2747633cac35 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:51.821781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de2b68-e439-4ef8-b83f-2747633cac35 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:51.824166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de2b68-e439-4ef8-b83f-2747633cac35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:51.855651 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de2b68-e439-4ef8-b83f-2747633cac35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:51.865640 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de2b68-e439-4ef8-b83f-2747633cac35 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:51.871270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 877/1747] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:01:51 2022] POST /identity/v3/projects => generated 379 bytes in 590 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:51.878826 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca2508-f28e-4449-8f14-70c344e5fa91 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:51.890672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-65ca2508-f28e-4449-8f14-70c344e5fa91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:51.917202 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 871/1748] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:51.920648 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de2b68-e439-4ef8-b83f-2747633cac35 service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:51.967144 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de2b68-e439-4ef8-b83f-2747633cac35 service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:52.124089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb8b50-bf98-4969-90a2-145a9a359b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:52.124799 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb8b50-bf98-4969-90a2-145a9a359b20 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:52.125131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb8b50-bf98-4969-90a2-145a9a359b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:52.125364 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb8b50-bf98-4969-90a2-145a9a359b20 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:52.131758 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb8b50-bf98-4969-90a2-145a9a359b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:52.133720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb8b50-bf98-4969-90a2-145a9a359b20 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:52.159914 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca2508-f28e-4449-8f14-70c344e5fa91 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:52.170611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 872/1749] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:01:51 2022] POST /identity/v3/users => generated 296 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:52.172450 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb8b50-bf98-4969-90a2-145a9a359b20 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:52.180764 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86f418-c565-40c2-99e6-095dd7b7d1c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:52.181656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86f418-c565-40c2-99e6-095dd7b7d1c4 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:52.182162 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86f418-c565-40c2-99e6-095dd7b7d1c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:52.183082 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86f418-c565-40c2-99e6-095dd7b7d1c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:52.191492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-ab86f418-c565-40c2-99e6-095dd7b7d1c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:52.195758 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb8b50-bf98-4969-90a2-145a9a359b20 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:52.216313 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8bc2-29af-430a-9828-98bfa90b4294 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:52.216313 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8bc2-29af-430a-9828-98bfa90b4294 service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:52.216617 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8bc2-29af-430a-9828-98bfa90b4294 service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:52.216688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8bc2-29af-430a-9828-98bfa90b4294 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:52.218591 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-8f7c8bc2-29af-430a-9828-98bfa90b4294 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:52.345304 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c8bc2-29af-430a-9828-98bfa90b4294 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:52.347039 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c8bc2-29af-430a-9828-98bfa90b4294 service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:52.365373 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 873/1750] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:52.366987 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8bc2-29af-430a-9828-98bfa90b4294 service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:52.383429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8bc2-29af-430a-9828-98bfa90b4294 service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:52.394795 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c61ed7-fab2-4f16-8b6d-971b71d1e7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:52.395616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c61ed7-fab2-4f16-8b6d-971b71d1e7ee admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:52.396126 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c61ed7-fab2-4f16-8b6d-971b71d1e7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:52.396422 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c61ed7-fab2-4f16-8b6d-971b71d1e7ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:52.397428 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c61ed7-fab2-4f16-8b6d-971b71d1e7ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:52.401212 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86f418-c565-40c2-99e6-095dd7b7d1c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:52.405394 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86f418-c565-40c2-99e6-095dd7b7d1c4 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:52.408755 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c61ed7-fab2-4f16-8b6d-971b71d1e7ee admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:52.428009 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 874/1751] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:52.431832 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c61ed7-fab2-4f16-8b6d-971b71d1e7ee admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:52.450080 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c61ed7-fab2-4f16-8b6d-971b71d1e7ee admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:52.470136 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdd804-c575-4ea1-a581-6d5f9ab12e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:52.473775 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdd804-c575-4ea1-a581-6d5f9ab12e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:52.474317 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdd804-c575-4ea1-a581-6d5f9ab12e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:52.474769 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdd804-c575-4ea1-a581-6d5f9ab12e3d admin admin] PATH_INFO: `/v3/projects/7838c0f29c8a437395392cbcf32e3716/users/2e3e325a1d87453ba299a78e19f97237/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:52.483028 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 878/1752] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:52.516167 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fdd804-c575-4ea1-a581-6d5f9ab12e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7838c0f29c8a437395392cbcf32e3716, user_id=2e3e325a1d87453ba299a78e19f97237, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:52.526896 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fdd804-c575-4ea1-a581-6d5f9ab12e3d admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:52.577216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 875/1753] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:52 2022] PUT /identity/v3/projects/7838c0f29c8a437395392cbcf32e3716/users/2e3e325a1d87453ba299a78e19f97237/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:52.581987 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86f418-c565-40c2-99e6-095dd7b7d1c4 service cinder] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:52.607277 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86f418-c565-40c2-99e6-095dd7b7d1c4 service cinder] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:52.811023 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c8f56-e2cd-475e-bd8b-dd6abc726b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:52.812040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c8f56-e2cd-475e-bd8b-dd6abc726b0e admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:52.812490 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c8f56-e2cd-475e-bd8b-dd6abc726b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:52.812916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c8f56-e2cd-475e-bd8b-dd6abc726b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:52.814416 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c8f56-e2cd-475e-bd8b-dd6abc726b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:52.820239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c8f56-e2cd-475e-bd8b-dd6abc726b0e admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:52.839391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 879/1754] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:52.840073 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdd804-c575-4ea1-a581-6d5f9ab12e3d admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:52.854289 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdd804-c575-4ea1-a581-6d5f9ab12e3d admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:52.861730 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e844d-215c-4038-8f1a-c12fadb33a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:52.863186 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e844d-215c-4038-8f1a-c12fadb33a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:52.864470 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e844d-215c-4038-8f1a-c12fadb33a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:52.865953 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e844d-215c-4038-8f1a-c12fadb33a9f admin admin] PATH_INFO: `/v3/projects/7838c0f29c8a437395392cbcf32e3716/users/2e3e325a1d87453ba299a78e19f97237/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:52.868965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e844d-215c-4038-8f1a-c12fadb33a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7838c0f29c8a437395392cbcf32e3716, user_id=2e3e325a1d87453ba299a78e19f97237, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:52.872491 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e844d-215c-4038-8f1a-c12fadb33a9f admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:52.922716 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b327f4b-8df8-416b-8e06-a08ab3c87067 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:52.923010 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b327f4b-8df8-416b-8e06-a08ab3c87067 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:52.923295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b327f4b-8df8-416b-8e06-a08ab3c87067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:52.925523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 876/1755] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:01:52 2022] PUT /identity/v3/projects/7838c0f29c8a437395392cbcf32e3716/users/2e3e325a1d87453ba299a78e19f97237/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:53.003147 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-1b327f4b-8df8-416b-8e06-a08ab3c87067 None None] MFA Rules not processed for user `2e3e325a1d87453ba299a78e19f97237`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:53.004500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-1b327f4b-8df8-416b-8e06-a08ab3c87067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:53.241454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 880/1756] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:53.452674 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e844d-215c-4038-8f1a-c12fadb33a9f admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:53.668924 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e844d-215c-4038-8f1a-c12fadb33a9f admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:53.715896 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4fb74-cf89-4867-baa3-02cef57a8c9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:53.716687 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4fb74-cf89-4867-baa3-02cef57a8c9d service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:53.716868 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4fb74-cf89-4867-baa3-02cef57a8c9d service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:53.717144 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4fb74-cf89-4867-baa3-02cef57a8c9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:53.771972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4fb74-cf89-4867-baa3-02cef57a8c9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:53.773521 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4fb74-cf89-4867-baa3-02cef57a8c9d service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:53.832804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661e0bb-39a7-4441-b054-ef09f16af2a4 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:53.834023 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661e0bb-39a7-4441-b054-ef09f16af2a4 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:53.834530 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661e0bb-39a7-4441-b054-ef09f16af2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:53.850115 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 877/1757] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:53.882500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-0661e0bb-39a7-4441-b054-ef09f16af2a4 None None] MFA Rules not processed for user `c98a5fc7863942c5b389aa9766d31129`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:53.883863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-0661e0bb-39a7-4441-b054-ef09f16af2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:54.088493 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4fb74-cf89-4867-baa3-02cef57a8c9d service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:54.100417 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4fb74-cf89-4867-baa3-02cef57a8c9d service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:54.116648 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013da6b-9fab-45d9-a2b3-f87e0b4eb4c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:54.117330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013da6b-9fab-45d9-a2b3-f87e0b4eb4c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:54.117970 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013da6b-9fab-45d9-a2b3-f87e0b4eb4c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:54.119493 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013da6b-9fab-45d9-a2b3-f87e0b4eb4c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:54.135365 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 881/1758] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:01:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:54.294159 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013da6b-9fab-45d9-a2b3-f87e0b4eb4c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:54.296715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013da6b-9fab-45d9-a2b3-f87e0b4eb4c7 service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:54.311667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 878/1759] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:01:54.557976 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f479c-91b5-4af6-bd3f-e32f4f6c67ee None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:54.559779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f479c-91b5-4af6-bd3f-e32f4f6c67ee None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:54.560066 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f479c-91b5-4af6-bd3f-e32f4f6c67ee None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:54.561966 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 882/1760] 10.222.0.32 () {54 vars in 921 bytes} [Tue May 10 14:01:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:01:54.615941 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494353d-b1f9-4f95-82cc-fdd35022a28f None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:54.616712 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494353d-b1f9-4f95-82cc-fdd35022a28f None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:54.617151 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494353d-b1f9-4f95-82cc-fdd35022a28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:54.644128 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-7494353d-b1f9-4f95-82cc-fdd35022a28f None None] MFA Rules not processed for user `e5d4fd26c21f4170a6790369344f8334`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:54.646901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-7494353d-b1f9-4f95-82cc-fdd35022a28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:54.736797 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 879/1761] 10.222.0.32 () {58 vars in 1018 bytes} [Tue May 10 14:01:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:54.763884 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f479c-91b5-4af6-bd3f-e32f4f6c67ee None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:54.766091 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-075f479c-91b5-4af6-bd3f-e32f4f6c67ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:54.785444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f479c-91b5-4af6-bd3f-e32f4f6c67ee None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:54.791661 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511de2c-c5d0-46ae-b5b6-c052ec3bef5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:54.792320 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511de2c-c5d0-46ae-b5b6-c052ec3bef5d service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:54.792601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511de2c-c5d0-46ae-b5b6-c052ec3bef5d service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:54.792872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511de2c-c5d0-46ae-b5b6-c052ec3bef5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:54.802621 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511de2c-c5d0-46ae-b5b6-c052ec3bef5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:54.804255 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511de2c-c5d0-46ae-b5b6-c052ec3bef5d service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:54.815625 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 883/1762] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:01:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:02:06.533726 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494353d-b1f9-4f95-82cc-fdd35022a28f None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:06.535443 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-7494353d-b1f9-4f95-82cc-fdd35022a28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:06.624331 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494353d-b1f9-4f95-82cc-fdd35022a28f None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:06.632452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185fa5e-1a9c-4c53-8054-bef977296542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:06.634237 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185fa5e-1a9c-4c53-8054-bef977296542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:06.634696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185fa5e-1a9c-4c53-8054-bef977296542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:06.635119 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185fa5e-1a9c-4c53-8054-bef977296542 admin admin] PATH_INFO: `/v3/users/a4118c10f3b842919b5e615300c485be` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:06.636569 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185fa5e-1a9c-4c53-8054-bef977296542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4118c10f3b842919b5e615300c485be)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:06.639153 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185fa5e-1a9c-4c53-8054-bef977296542 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:06.715240 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2185fa5e-1a9c-4c53-8054-bef977296542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4118c10f3b842919b5e615300c485be'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:06.730697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2185fa5e-1a9c-4c53-8054-bef977296542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4118c10f3b842919b5e615300c485be'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:06.748778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2185fa5e-1a9c-4c53-8054-bef977296542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4118c10f3b842919b5e615300c485be'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:06.749541 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2185fa5e-1a9c-4c53-8054-bef977296542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4118c10f3b842919b5e615300c485be'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:06.750309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2185fa5e-1a9c-4c53-8054-bef977296542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4118c10f3b842919b5e615300c485be'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:06.770250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 880/1763] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:02:06 2022] DELETE /identity/v3/users/a4118c10f3b842919b5e615300c485be => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:06.774525 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d130c-f9fe-4948-8c4a-6ee98ad2c5dd None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:06.775042 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d130c-f9fe-4948-8c4a-6ee98ad2c5dd None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:06.775157 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d130c-f9fe-4948-8c4a-6ee98ad2c5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:06.831668 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-021d130c-f9fe-4948-8c4a-6ee98ad2c5dd None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:06.833171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-021d130c-f9fe-4948-8c4a-6ee98ad2c5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:06.984708 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 884/1764] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:07.003127 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185fa5e-1a9c-4c53-8054-bef977296542 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:07.006130 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-2185fa5e-1a9c-4c53-8054-bef977296542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:07.147916 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185fa5e-1a9c-4c53-8054-bef977296542 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:07.153357 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af6408-63d0-4980-8c4e-f60d3f4521ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:07.154384 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af6408-63d0-4980-8c4e-f60d3f4521ed service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:07.154830 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af6408-63d0-4980-8c4e-f60d3f4521ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:07.155259 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af6408-63d0-4980-8c4e-f60d3f4521ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:07.184295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af6408-63d0-4980-8c4e-f60d3f4521ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:07.185957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af6408-63d0-4980-8c4e-f60d3f4521ed service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:07.211231 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 881/1765] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:07.220563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7c839-847b-463c-a922-819748b36b96 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:07.220949 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7c839-847b-463c-a922-819748b36b96 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:07.221304 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7c839-847b-463c-a922-819748b36b96 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:07.224251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 885/1766] 10.222.0.32 () {54 vars in 921 bytes} [Tue May 10 14:02:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:02:07.243152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b2f2b-1c58-4c77-a090-459a8b2dc585 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:07.243734 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b2f2b-1c58-4c77-a090-459a8b2dc585 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:07.244200 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b2f2b-1c58-4c77-a090-459a8b2dc585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:07.319605 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-7c9b2f2b-1c58-4c77-a090-459a8b2dc585 None None] MFA Rules not processed for user `e5d4fd26c21f4170a6790369344f8334`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:07.320868 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-7c9b2f2b-1c58-4c77-a090-459a8b2dc585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:07.491110 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 882/1767] 10.222.0.32 () {58 vars in 1018 bytes} [Tue May 10 14:02:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:07.666367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7c839-847b-463c-a922-819748b36b96 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:07.668066 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-bcb7c839-847b-463c-a922-819748b36b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:07.687280 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7c839-847b-463c-a922-819748b36b96 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:07.693971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15413e-ac93-4c74-8889-6de1dea40054 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:07.694822 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15413e-ac93-4c74-8889-6de1dea40054 service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:07.695171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15413e-ac93-4c74-8889-6de1dea40054 service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:07.695614 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15413e-ac93-4c74-8889-6de1dea40054 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:07.706046 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15413e-ac93-4c74-8889-6de1dea40054 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:07.708705 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15413e-ac93-4c74-8889-6de1dea40054 service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:07.720370 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 886/1768] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:07.946615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b2f2b-1c58-4c77-a090-459a8b2dc585 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:07.948144 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-7c9b2f2b-1c58-4c77-a090-459a8b2dc585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:07.969850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b2f2b-1c58-4c77-a090-459a8b2dc585 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:07.975252 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29ca8d-2155-4354-ad63-f5f0a51b162d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:07.976104 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29ca8d-2155-4354-ad63-f5f0a51b162d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:07.976391 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29ca8d-2155-4354-ad63-f5f0a51b162d admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:07.976669 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29ca8d-2155-4354-ad63-f5f0a51b162d admin admin] PATH_INFO: `/v3/projects/435c45880e46461bb8d4c7de37658929` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:07.977843 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29ca8d-2155-4354-ad63-f5f0a51b162d admin admin] RBAC: Authorizing `identity:delete_project(project_id=435c45880e46461bb8d4c7de37658929)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:07.979785 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29ca8d-2155-4354-ad63-f5f0a51b162d admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:08.026826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ba29ca8d-2155-4354-ad63-f5f0a51b162d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435c45880e46461bb8d4c7de37658929', 'request_id': 'req-ba29ca8d-2155-4354-ad63-f5f0a51b162d'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:08.032114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ba29ca8d-2155-4354-ad63-f5f0a51b162d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435c45880e46461bb8d4c7de37658929', 'request_id': 'req-ba29ca8d-2155-4354-ad63-f5f0a51b162d'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:08.038047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ba29ca8d-2155-4354-ad63-f5f0a51b162d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435c45880e46461bb8d4c7de37658929', 'request_id': 'req-ba29ca8d-2155-4354-ad63-f5f0a51b162d'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:08.049232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ba29ca8d-2155-4354-ad63-f5f0a51b162d admin admin] The token cache is being invalidate because project 435c45880e46461bb8d4c7de37658929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:02:08.049522 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ba29ca8d-2155-4354-ad63-f5f0a51b162d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:08.050170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ba29ca8d-2155-4354-ad63-f5f0a51b162d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:08.052315 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 883/1769] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:02:07 2022] DELETE /identity/v3/projects/435c45880e46461bb8d4c7de37658929 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:08.057124 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3cffa-ba33-4f4a-820b-7b15c70c1c09 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:08.057596 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3cffa-ba33-4f4a-820b-7b15c70c1c09 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:08.057678 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3cffa-ba33-4f4a-820b-7b15c70c1c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:08.075936 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-32f3cffa-ba33-4f4a-820b-7b15c70c1c09 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:08.077117 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-32f3cffa-ba33-4f4a-820b-7b15c70c1c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:08.134081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 887/1770] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:08.142418 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1afd88-65ce-44c5-9d19-43593f6b0142 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:08.142709 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1afd88-65ce-44c5-9d19-43593f6b0142 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:08.142982 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1afd88-65ce-44c5-9d19-43593f6b0142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:08.161154 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-af1afd88-65ce-44c5-9d19-43593f6b0142 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:08.162358 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-af1afd88-65ce-44c5-9d19-43593f6b0142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:08.170038 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 884/1771] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:08.174063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3cffa-ba33-4f4a-820b-7b15c70c1c09 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:08.184030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3cffa-ba33-4f4a-820b-7b15c70c1c09 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:08.188513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35f32c-4920-408b-8d64-0a643478fd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:08.189161 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35f32c-4920-408b-8d64-0a643478fd0d admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:08.189440 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35f32c-4920-408b-8d64-0a643478fd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:08.189714 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35f32c-4920-408b-8d64-0a643478fd0d admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:08.190461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35f32c-4920-408b-8d64-0a643478fd0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:02:08.190768 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35f32c-4920-408b-8d64-0a643478fd0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:08.192354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35f32c-4920-408b-8d64-0a643478fd0d admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:08.203897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 888/1772] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:02:08.208290 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1afd88-65ce-44c5-9d19-43593f6b0142 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:08.217623 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1afd88-65ce-44c5-9d19-43593f6b0142 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:08.222132 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e01970-c3ca-4970-af3a-270bf563de2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:08.222816 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e01970-c3ca-4970-af3a-270bf563de2e admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:08.223633 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e01970-c3ca-4970-af3a-270bf563de2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:08.223905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e01970-c3ca-4970-af3a-270bf563de2e admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:08.224590 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e01970-c3ca-4970-af3a-270bf563de2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:08.226707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e01970-c3ca-4970-af3a-270bf563de2e admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:08.252885 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 885/1773] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:02:08 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:08.257015 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35f32c-4920-408b-8d64-0a643478fd0d admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:08.266558 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35f32c-4920-408b-8d64-0a643478fd0d admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:08.320561 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10d892-d88c-4571-86c3-672c03bebc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:08.321261 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10d892-d88c-4571-86c3-672c03bebc8e admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:08.321546 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10d892-d88c-4571-86c3-672c03bebc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:08.321820 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10d892-d88c-4571-86c3-672c03bebc8e admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:08.322550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10d892-d88c-4571-86c3-672c03bebc8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:08.324447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10d892-d88c-4571-86c3-672c03bebc8e admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:08.343146 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 889/1774] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:02:08 2022] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:08.347387 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e01970-c3ca-4970-af3a-270bf563de2e admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:08.358471 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e01970-c3ca-4970-af3a-270bf563de2e admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:08.363033 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83711c4c-b6df-48cb-9b99-645fdfdb986a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:08.364301 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83711c4c-b6df-48cb-9b99-645fdfdb986a admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:08.364583 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83711c4c-b6df-48cb-9b99-645fdfdb986a admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:08.364860 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83711c4c-b6df-48cb-9b99-645fdfdb986a admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:08.365582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83711c4c-b6df-48cb-9b99-645fdfdb986a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:08.367453 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83711c4c-b6df-48cb-9b99-645fdfdb986a admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:08.377934 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 886/1775] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:08.381976 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10d892-d88c-4571-86c3-672c03bebc8e admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:08.391913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10d892-d88c-4571-86c3-672c03bebc8e admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:08.397176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63653e20-177d-46d7-b6d2-2f61caf900e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:08.398136 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63653e20-177d-46d7-b6d2-2f61caf900e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:08.398373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63653e20-177d-46d7-b6d2-2f61caf900e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:08.398692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63653e20-177d-46d7-b6d2-2f61caf900e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:08.399438 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63653e20-177d-46d7-b6d2-2f61caf900e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:08.401353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63653e20-177d-46d7-b6d2-2f61caf900e7 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:08.415858 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 890/1776] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:08.420051 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83711c4c-b6df-48cb-9b99-645fdfdb986a admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:08.430309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83711c4c-b6df-48cb-9b99-645fdfdb986a admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:08.434830 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62d70d-7789-4f72-a8ec-3579ff566322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:08.435712 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62d70d-7789-4f72-a8ec-3579ff566322 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:08.435994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62d70d-7789-4f72-a8ec-3579ff566322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:08.436269 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62d70d-7789-4f72-a8ec-3579ff566322 admin admin] PATH_INFO: `/v3/projects/5f14f6aed5a54725ad484a0e34fd51e1/users/ee2bc982cea44dac9006ac9e93579ff9/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:08.450174 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62d70d-7789-4f72-a8ec-3579ff566322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f14f6aed5a54725ad484a0e34fd51e1, user_id=ee2bc982cea44dac9006ac9e93579ff9, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:08.452827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62d70d-7789-4f72-a8ec-3579ff566322 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:08.465067 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 887/1777] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:02:08 2022] PUT /identity/v3/projects/5f14f6aed5a54725ad484a0e34fd51e1/users/ee2bc982cea44dac9006ac9e93579ff9/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:08.475604 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60198d-71ee-49d2-8570-32bba1a36581 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:08.475898 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60198d-71ee-49d2-8570-32bba1a36581 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:08.476180 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60198d-71ee-49d2-8570-32bba1a36581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:08.502785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-4d60198d-71ee-49d2-8570-32bba1a36581 None None] MFA Rules not processed for user `ee2bc982cea44dac9006ac9e93579ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:08.503975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-4d60198d-71ee-49d2-8570-32bba1a36581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:08.566717 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 891/1778] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:08.571283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62d70d-7789-4f72-a8ec-3579ff566322 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:08.631075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62d70d-7789-4f72-a8ec-3579ff566322 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:08.635756 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba039d21-590b-48c5-9042-094c8fc136de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:08.636430 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba039d21-590b-48c5-9042-094c8fc136de admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:08.636711 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba039d21-590b-48c5-9042-094c8fc136de admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:08.636981 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba039d21-590b-48c5-9042-094c8fc136de admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:08.637667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba039d21-590b-48c5-9042-094c8fc136de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:08.639591 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba039d21-590b-48c5-9042-094c8fc136de admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:08.666090 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 888/1779] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:02:08 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:08.669898 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60198d-71ee-49d2-8570-32bba1a36581 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:08.681090 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60198d-71ee-49d2-8570-32bba1a36581 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:08.747873 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312469b-3275-4b06-8553-8cf85038f5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:08.748564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312469b-3275-4b06-8553-8cf85038f5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:08.748851 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312469b-3275-4b06-8553-8cf85038f5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:08.749131 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312469b-3275-4b06-8553-8cf85038f5b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:08.749825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312469b-3275-4b06-8553-8cf85038f5b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:08.751792 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312469b-3275-4b06-8553-8cf85038f5b6 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:08.776538 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 892/1780] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:02:08 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:08.777754 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba039d21-590b-48c5-9042-094c8fc136de admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:08.788870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba039d21-590b-48c5-9042-094c8fc136de admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:08.793664 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecdb48-a297-484f-b477-054aac697b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:08.794496 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecdb48-a297-484f-b477-054aac697b67 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:08.795418 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecdb48-a297-484f-b477-054aac697b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:08.795418 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecdb48-a297-484f-b477-054aac697b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:08.796052 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecdb48-a297-484f-b477-054aac697b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:08.797756 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecdb48-a297-484f-b477-054aac697b67 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:08.810225 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 889/1781] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:08.814403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312469b-3275-4b06-8553-8cf85038f5b6 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:08.825704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312469b-3275-4b06-8553-8cf85038f5b6 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:08.830808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595db86-7cec-4d0b-ad78-764037b91b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:08.836224 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595db86-7cec-4d0b-ad78-764037b91b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:08.836224 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595db86-7cec-4d0b-ad78-764037b91b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:08.836224 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595db86-7cec-4d0b-ad78-764037b91b5f admin admin] PATH_INFO: `/v3/projects/e3345ec02ae24f1abacfe76f7152095a/users/d351dcf8af374e24b2ab43a204e7a712/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:08.847118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595db86-7cec-4d0b-ad78-764037b91b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3345ec02ae24f1abacfe76f7152095a, user_id=d351dcf8af374e24b2ab43a204e7a712, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:08.849811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595db86-7cec-4d0b-ad78-764037b91b5f admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:08.862297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 893/1782] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:02:08 2022] PUT /identity/v3/projects/e3345ec02ae24f1abacfe76f7152095a/users/d351dcf8af374e24b2ab43a204e7a712/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:08.867141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecdb48-a297-484f-b477-054aac697b67 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:08.877088 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecdb48-a297-484f-b477-054aac697b67 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:08.932088 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e2ff3-30dc-41a2-a45d-82de4d8d5706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:08.932678 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e2ff3-30dc-41a2-a45d-82de4d8d5706 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:08.932960 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e2ff3-30dc-41a2-a45d-82de4d8d5706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:08.933238 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e2ff3-30dc-41a2-a45d-82de4d8d5706 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:08.933958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e2ff3-30dc-41a2-a45d-82de4d8d5706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:08.935590 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e2ff3-30dc-41a2-a45d-82de4d8d5706 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:08.944976 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 890/1783] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:08.949143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595db86-7cec-4d0b-ad78-764037b91b5f admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:08.959357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595db86-7cec-4d0b-ad78-764037b91b5f admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:08.963982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8824b4-0a82-4bdb-858e-a7a6bb5004f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:08.964867 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8824b4-0a82-4bdb-858e-a7a6bb5004f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:08.965154 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8824b4-0a82-4bdb-858e-a7a6bb5004f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:08.965432 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8824b4-0a82-4bdb-858e-a7a6bb5004f3 admin admin] PATH_INFO: `/v3/projects/e3345ec02ae24f1abacfe76f7152095a/users/d351dcf8af374e24b2ab43a204e7a712/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:08.967424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8824b4-0a82-4bdb-858e-a7a6bb5004f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3345ec02ae24f1abacfe76f7152095a, user_id=d351dcf8af374e24b2ab43a204e7a712, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:08.970053 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8824b4-0a82-4bdb-858e-a7a6bb5004f3 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:08.981088 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 894/1784] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:02:08 2022] PUT /identity/v3/projects/e3345ec02ae24f1abacfe76f7152095a/users/d351dcf8af374e24b2ab43a204e7a712/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:08.992245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4a61c-7eb4-4d38-aab6-81b3f523318a None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:08.992717 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4a61c-7eb4-4d38-aab6-81b3f523318a None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:08.992890 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4a61c-7eb4-4d38-aab6-81b3f523318a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:09.020832 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-01a4a61c-7eb4-4d38-aab6-81b3f523318a None None] MFA Rules not processed for user `d351dcf8af374e24b2ab43a204e7a712`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:09.022125 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-01a4a61c-7eb4-4d38-aab6-81b3f523318a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:09.090727 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 891/1785] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:09.108184 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8824b4-0a82-4bdb-858e-a7a6bb5004f3 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:09.109909 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-3c8824b4-0a82-4bdb-858e-a7a6bb5004f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:09.167000 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8824b4-0a82-4bdb-858e-a7a6bb5004f3 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:09.170591 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70630fde-9f97-4abc-8b01-9035fb4f4df3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:09.171233 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70630fde-9f97-4abc-8b01-9035fb4f4df3 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:09.171522 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70630fde-9f97-4abc-8b01-9035fb4f4df3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:09.171797 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70630fde-9f97-4abc-8b01-9035fb4f4df3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:09.181288 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70630fde-9f97-4abc-8b01-9035fb4f4df3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:09.182813 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70630fde-9f97-4abc-8b01-9035fb4f4df3 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:09.191889 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 895/1786] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:09.513741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4a61c-7eb4-4d38-aab6-81b3f523318a None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:09.522742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4a61c-7eb4-4d38-aab6-81b3f523318a None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:09.531721 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba126f23-f5e1-4e40-8079-5c46830e0a85 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd351dcf8af374e24b2ab43a204e7a712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3345ec02ae24f1abacfe76f7152095a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:09.532394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba126f23-f5e1-4e40-8079-5c46830e0a85 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:09.532696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba126f23-f5e1-4e40-8079-5c46830e0a85 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:09.532969 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba126f23-f5e1-4e40-8079-5c46830e0a85 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:09.533712 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba126f23-f5e1-4e40-8079-5c46830e0a85 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:02:09.534020 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba126f23-f5e1-4e40-8079-5c46830e0a85 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:09.535952 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba126f23-f5e1-4e40-8079-5c46830e0a85 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:09.552011 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 892/1787] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:02:09.556302 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70630fde-9f97-4abc-8b01-9035fb4f4df3 service cinder] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:09.565332 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70630fde-9f97-4abc-8b01-9035fb4f4df3 service cinder] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:09.570553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1251ccd-9058-4218-aa6c-53761e7b1bef tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd351dcf8af374e24b2ab43a204e7a712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3345ec02ae24f1abacfe76f7152095a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:09.571236 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1251ccd-9058-4218-aa6c-53761e7b1bef tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:09.571526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1251ccd-9058-4218-aa6c-53761e7b1bef tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:09.571825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1251ccd-9058-4218-aa6c-53761e7b1bef tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:09.572510 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1251ccd-9058-4218-aa6c-53761e7b1bef tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:09.574437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1251ccd-9058-4218-aa6c-53761e7b1bef tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:09.602218 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 896/1788] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:02:09 2022] POST /identity/v3/projects => generated 353 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:02:09.606490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba126f23-f5e1-4e40-8079-5c46830e0a85 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:09.617504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba126f23-f5e1-4e40-8079-5c46830e0a85 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:09.673671 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eda2c3-1c88-4aa8-8869-32bc7b86a2b3 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd351dcf8af374e24b2ab43a204e7a712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3345ec02ae24f1abacfe76f7152095a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:09.674368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eda2c3-1c88-4aa8-8869-32bc7b86a2b3 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:09.674656 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eda2c3-1c88-4aa8-8869-32bc7b86a2b3 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:09.674932 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eda2c3-1c88-4aa8-8869-32bc7b86a2b3 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:09.675656 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eda2c3-1c88-4aa8-8869-32bc7b86a2b3 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:02:09.675960 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eda2c3-1c88-4aa8-8869-32bc7b86a2b3 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:09.678120 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eda2c3-1c88-4aa8-8869-32bc7b86a2b3 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:09.689074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 893/1789] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:02:09.730132 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1251ccd-9058-4218-aa6c-53761e7b1bef tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:09.740694 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1251ccd-9058-4218-aa6c-53761e7b1bef tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:09.745457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb3aed-9b80-4bc2-8efe-8c8cc87a2444 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd351dcf8af374e24b2ab43a204e7a712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3345ec02ae24f1abacfe76f7152095a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:09.746340 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb3aed-9b80-4bc2-8efe-8c8cc87a2444 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:09.746733 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb3aed-9b80-4bc2-8efe-8c8cc87a2444 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:09.747014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb3aed-9b80-4bc2-8efe-8c8cc87a2444 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] PATH_INFO: `/v3/projects/644716fa966c46e582243ac14f223151` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:09.748181 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb3aed-9b80-4bc2-8efe-8c8cc87a2444 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] RBAC: Authorizing `identity:delete_project(project_id=644716fa966c46e582243ac14f223151)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:09.750048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb3aed-9b80-4bc2-8efe-8c8cc87a2444 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:09.795452 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-9edb3aed-9b80-4bc2-8efe-8c8cc87a2444 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '644716fa966c46e582243ac14f223151', 'request_id': 'req-9edb3aed-9b80-4bc2-8efe-8c8cc87a2444'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:09.800818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-9edb3aed-9b80-4bc2-8efe-8c8cc87a2444 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '644716fa966c46e582243ac14f223151', 'request_id': 'req-9edb3aed-9b80-4bc2-8efe-8c8cc87a2444'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:09.807608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-9edb3aed-9b80-4bc2-8efe-8c8cc87a2444 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '644716fa966c46e582243ac14f223151', 'request_id': 'req-9edb3aed-9b80-4bc2-8efe-8c8cc87a2444'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:09.819845 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-9edb3aed-9b80-4bc2-8efe-8c8cc87a2444 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] The token cache is being invalidate because project 644716fa966c46e582243ac14f223151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:02:09.820130 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-9edb3aed-9b80-4bc2-8efe-8c8cc87a2444 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:09.820837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-9edb3aed-9b80-4bc2-8efe-8c8cc87a2444 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:09.822465 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 897/1790] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:02:09 2022] DELETE /identity/v3/projects/644716fa966c46e582243ac14f223151 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:10.030834 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eda2c3-1c88-4aa8-8869-32bc7b86a2b3 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:10.032630 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a8eda2c3-1c88-4aa8-8869-32bc7b86a2b3 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:10.101964 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eda2c3-1c88-4aa8-8869-32bc7b86a2b3 tempest-VolumeQuotaClassesTest-711887316 tempest-VolumeQuotaClassesTest-711887316-project-admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:10.179602 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9c9c1-bce7-4969-a691-daf66eca8ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:10.180489 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9c9c1-bce7-4969-a691-daf66eca8ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:10.180773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9c9c1-bce7-4969-a691-daf66eca8ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:10.181049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9c9c1-bce7-4969-a691-daf66eca8ebb admin admin] PATH_INFO: `/v3/users/ee2bc982cea44dac9006ac9e93579ff9` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:10.182287 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9c9c1-bce7-4969-a691-daf66eca8ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee2bc982cea44dac9006ac9e93579ff9)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:10.184214 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9c9c1-bce7-4969-a691-daf66eca8ebb admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:10.230483 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-88f9c9c1-bce7-4969-a691-daf66eca8ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee2bc982cea44dac9006ac9e93579ff9'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:10.238575 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-88f9c9c1-bce7-4969-a691-daf66eca8ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee2bc982cea44dac9006ac9e93579ff9'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:10.251002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-88f9c9c1-bce7-4969-a691-daf66eca8ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee2bc982cea44dac9006ac9e93579ff9'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:10.251706 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-88f9c9c1-bce7-4969-a691-daf66eca8ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee2bc982cea44dac9006ac9e93579ff9'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:10.252494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-88f9c9c1-bce7-4969-a691-daf66eca8ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee2bc982cea44dac9006ac9e93579ff9'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:10.264770 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 894/1791] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:02:10 2022] DELETE /identity/v3/users/ee2bc982cea44dac9006ac9e93579ff9 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:10.269216 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992beae-b737-443e-814c-5e928456fbd0 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:10.269658 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992beae-b737-443e-814c-5e928456fbd0 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:10.270368 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992beae-b737-443e-814c-5e928456fbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:10.288988 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-f992beae-b737-443e-814c-5e928456fbd0 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:10.290235 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f992beae-b737-443e-814c-5e928456fbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:10.349006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 898/1792] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:10.358553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9c9c1-bce7-4969-a691-daf66eca8ebb admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:10.359920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-88f9c9c1-bce7-4969-a691-daf66eca8ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:10.416415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9c9c1-bce7-4969-a691-daf66eca8ebb admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:10.420029 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259fc0b-89ed-4ce9-8a77-a47f13ab84cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:10.420679 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259fc0b-89ed-4ce9-8a77-a47f13ab84cc service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:10.420960 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259fc0b-89ed-4ce9-8a77-a47f13ab84cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:10.421234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259fc0b-89ed-4ce9-8a77-a47f13ab84cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:10.431094 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259fc0b-89ed-4ce9-8a77-a47f13ab84cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:10.432526 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259fc0b-89ed-4ce9-8a77-a47f13ab84cc service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:10.441788 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 895/1793] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:10.704323 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992beae-b737-443e-814c-5e928456fbd0 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:10.705959 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f992beae-b737-443e-814c-5e928456fbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:10.718708 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992beae-b737-443e-814c-5e928456fbd0 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:10.724425 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75504ee-3ce1-4de3-865f-286b80d0a7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:10.725310 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75504ee-3ce1-4de3-865f-286b80d0a7eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:10.725596 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75504ee-3ce1-4de3-865f-286b80d0a7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:10.725876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75504ee-3ce1-4de3-865f-286b80d0a7eb admin admin] PATH_INFO: `/v3/projects/5f14f6aed5a54725ad484a0e34fd51e1` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:10.727115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75504ee-3ce1-4de3-865f-286b80d0a7eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f14f6aed5a54725ad484a0e34fd51e1)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:10.729076 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75504ee-3ce1-4de3-865f-286b80d0a7eb admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:10.775910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a75504ee-3ce1-4de3-865f-286b80d0a7eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f14f6aed5a54725ad484a0e34fd51e1', 'request_id': 'req-a75504ee-3ce1-4de3-865f-286b80d0a7eb'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:10.781167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a75504ee-3ce1-4de3-865f-286b80d0a7eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f14f6aed5a54725ad484a0e34fd51e1', 'request_id': 'req-a75504ee-3ce1-4de3-865f-286b80d0a7eb'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:10.787954 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a75504ee-3ce1-4de3-865f-286b80d0a7eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f14f6aed5a54725ad484a0e34fd51e1', 'request_id': 'req-a75504ee-3ce1-4de3-865f-286b80d0a7eb'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:10.801221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a75504ee-3ce1-4de3-865f-286b80d0a7eb admin admin] The token cache is being invalidate because project 5f14f6aed5a54725ad484a0e34fd51e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:02:10.801504 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a75504ee-3ce1-4de3-865f-286b80d0a7eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:10.802132 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a75504ee-3ce1-4de3-865f-286b80d0a7eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:10.803748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 899/1794] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:02:10 2022] DELETE /identity/v3/projects/5f14f6aed5a54725ad484a0e34fd51e1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:10.807746 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259fc0b-89ed-4ce9-8a77-a47f13ab84cc service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:10.817258 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259fc0b-89ed-4ce9-8a77-a47f13ab84cc service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:10.872259 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492d0bf-ddb3-48b9-a196-7e7da8848302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:10.873140 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492d0bf-ddb3-48b9-a196-7e7da8848302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:10.873441 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492d0bf-ddb3-48b9-a196-7e7da8848302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:10.873715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492d0bf-ddb3-48b9-a196-7e7da8848302 admin admin] PATH_INFO: `/v3/users/d351dcf8af374e24b2ab43a204e7a712` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:10.874908 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492d0bf-ddb3-48b9-a196-7e7da8848302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d351dcf8af374e24b2ab43a204e7a712)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:10.876807 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492d0bf-ddb3-48b9-a196-7e7da8848302 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:10.922049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0492d0bf-ddb3-48b9-a196-7e7da8848302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd351dcf8af374e24b2ab43a204e7a712'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:10.930677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0492d0bf-ddb3-48b9-a196-7e7da8848302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd351dcf8af374e24b2ab43a204e7a712'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:10.943761 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0492d0bf-ddb3-48b9-a196-7e7da8848302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd351dcf8af374e24b2ab43a204e7a712'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:10.944430 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0492d0bf-ddb3-48b9-a196-7e7da8848302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd351dcf8af374e24b2ab43a204e7a712'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:10.945071 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0492d0bf-ddb3-48b9-a196-7e7da8848302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd351dcf8af374e24b2ab43a204e7a712'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:10.956705 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 896/1795] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:02:10 2022] DELETE /identity/v3/users/d351dcf8af374e24b2ab43a204e7a712 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:02:11.221017 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75504ee-3ce1-4de3-865f-286b80d0a7eb admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:11.222471 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-a75504ee-3ce1-4de3-865f-286b80d0a7eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:11.245092 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75504ee-3ce1-4de3-865f-286b80d0a7eb admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:11.323444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015a7a3-4d2c-4038-9989-7841df581e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:11.325944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015a7a3-4d2c-4038-9989-7841df581e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:11.327159 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015a7a3-4d2c-4038-9989-7841df581e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:11.327545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015a7a3-4d2c-4038-9989-7841df581e2e admin admin] PATH_INFO: `/v3/projects/e3345ec02ae24f1abacfe76f7152095a` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:11.330252 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015a7a3-4d2c-4038-9989-7841df581e2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3345ec02ae24f1abacfe76f7152095a)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:11.333124 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015a7a3-4d2c-4038-9989-7841df581e2e admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:11.384422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-9015a7a3-4d2c-4038-9989-7841df581e2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3345ec02ae24f1abacfe76f7152095a', 'request_id': 'req-9015a7a3-4d2c-4038-9989-7841df581e2e'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:11.389977 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-9015a7a3-4d2c-4038-9989-7841df581e2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3345ec02ae24f1abacfe76f7152095a', 'request_id': 'req-9015a7a3-4d2c-4038-9989-7841df581e2e'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:11.397101 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-9015a7a3-4d2c-4038-9989-7841df581e2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3345ec02ae24f1abacfe76f7152095a', 'request_id': 'req-9015a7a3-4d2c-4038-9989-7841df581e2e'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:11.413391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-9015a7a3-4d2c-4038-9989-7841df581e2e admin admin] The token cache is being invalidate because project e3345ec02ae24f1abacfe76f7152095a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:02:11.413679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-9015a7a3-4d2c-4038-9989-7841df581e2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:11.414683 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-9015a7a3-4d2c-4038-9989-7841df581e2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:11.416616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 900/1796] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:02:11 2022] DELETE /identity/v3/projects/e3345ec02ae24f1abacfe76f7152095a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:11.421337 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994fb3-a6b3-436e-affe-a9e6ceee59ef None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:11.421775 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994fb3-a6b3-436e-affe-a9e6ceee59ef None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:11.421881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994fb3-a6b3-436e-affe-a9e6ceee59ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:11.449020 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-28994fb3-a6b3-436e-affe-a9e6ceee59ef None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:11.450572 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-28994fb3-a6b3-436e-affe-a9e6ceee59ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:11.520623 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 897/1797] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:11.529597 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b54041-525a-492d-b57f-19e63e527f71 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:11.529886 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b54041-525a-492d-b57f-19e63e527f71 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:11.530188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b54041-525a-492d-b57f-19e63e527f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:11.548949 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-c8b54041-525a-492d-b57f-19e63e527f71 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:11.552024 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c8b54041-525a-492d-b57f-19e63e527f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:11.564176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 901/1798] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:11.568866 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28994fb3-a6b3-436e-affe-a9e6ceee59ef None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:11.579335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28994fb3-a6b3-436e-affe-a9e6ceee59ef None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:11.584431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041568a4-a130-4776-8ba3-f7d66d9f76ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:11.584969 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041568a4-a130-4776-8ba3-f7d66d9f76ed admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:11.585352 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041568a4-a130-4776-8ba3-f7d66d9f76ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:11.585746 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041568a4-a130-4776-8ba3-f7d66d9f76ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:11.586693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041568a4-a130-4776-8ba3-f7d66d9f76ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:02:11.587150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041568a4-a130-4776-8ba3-f7d66d9f76ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:11.590405 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041568a4-a130-4776-8ba3-f7d66d9f76ed admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:11.602164 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 898/1799] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:02:11.606702 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b54041-525a-492d-b57f-19e63e527f71 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:11.616246 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b54041-525a-492d-b57f-19e63e527f71 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:11.621304 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ea21f-835b-426a-a65f-667151806e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:11.621950 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ea21f-835b-426a-a65f-667151806e3d admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:11.622263 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ea21f-835b-426a-a65f-667151806e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:11.622534 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ea21f-835b-426a-a65f-667151806e3d admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:11.623226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ea21f-835b-426a-a65f-667151806e3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:11.625135 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ea21f-835b-426a-a65f-667151806e3d admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:11.654002 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 902/1800] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:02:11 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:11.655350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041568a4-a130-4776-8ba3-f7d66d9f76ed admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:11.665472 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041568a4-a130-4776-8ba3-f7d66d9f76ed admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:11.720935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475e218-c63b-4eae-8da2-8fad1d9a3351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:11.721604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475e218-c63b-4eae-8da2-8fad1d9a3351 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:11.721883 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475e218-c63b-4eae-8da2-8fad1d9a3351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:11.722182 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475e218-c63b-4eae-8da2-8fad1d9a3351 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:11.722986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475e218-c63b-4eae-8da2-8fad1d9a3351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:11.724880 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475e218-c63b-4eae-8da2-8fad1d9a3351 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:11.746413 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 899/1801] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:02:11 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:02:11.750367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ea21f-835b-426a-a65f-667151806e3d admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:11.761785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ea21f-835b-426a-a65f-667151806e3d admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:11.775263 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bbc22-fcda-435e-8c16-c05f40dfe8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:11.776321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bbc22-fcda-435e-8c16-c05f40dfe8df admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:11.777184 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bbc22-fcda-435e-8c16-c05f40dfe8df admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:11.777649 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bbc22-fcda-435e-8c16-c05f40dfe8df admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:11.778631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bbc22-fcda-435e-8c16-c05f40dfe8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:11.780674 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bbc22-fcda-435e-8c16-c05f40dfe8df admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:11.794978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 903/1802] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:02:11.797195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475e218-c63b-4eae-8da2-8fad1d9a3351 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:11.808316 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475e218-c63b-4eae-8da2-8fad1d9a3351 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:11.813169 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f48b1-86d5-409b-ae96-c43fa37a9b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:11.813891 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f48b1-86d5-409b-ae96-c43fa37a9b50 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:11.814274 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f48b1-86d5-409b-ae96-c43fa37a9b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:11.814614 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f48b1-86d5-409b-ae96-c43fa37a9b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:11.815467 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f48b1-86d5-409b-ae96-c43fa37a9b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:11.818234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f48b1-86d5-409b-ae96-c43fa37a9b50 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:11.830322 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 900/1803] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:11.832665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bbc22-fcda-435e-8c16-c05f40dfe8df admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:11.842883 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bbc22-fcda-435e-8c16-c05f40dfe8df admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:11.847646 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16793c40-14ec-4b69-a833-a39384552630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:11.848567 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16793c40-14ec-4b69-a833-a39384552630 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:11.849467 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16793c40-14ec-4b69-a833-a39384552630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:11.849756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16793c40-14ec-4b69-a833-a39384552630 admin admin] PATH_INFO: `/v3/projects/ad6bf0fcfc024ed881fa29df9540c6a1/users/d84367b1295b4b49a07b7fee3dea87d4/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:11.865140 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16793c40-14ec-4b69-a833-a39384552630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad6bf0fcfc024ed881fa29df9540c6a1, user_id=d84367b1295b4b49a07b7fee3dea87d4, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:11.868043 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16793c40-14ec-4b69-a833-a39384552630 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:11.881604 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 904/1804] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:02:11 2022] PUT /identity/v3/projects/ad6bf0fcfc024ed881fa29df9540c6a1/users/d84367b1295b4b49a07b7fee3dea87d4/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:11.891625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f9315-c042-44d0-a118-7b8cf4739fc9 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:11.891911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f9315-c042-44d0-a118-7b8cf4739fc9 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:11.892209 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f9315-c042-44d0-a118-7b8cf4739fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:11.918470 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-9a6f9315-c042-44d0-a118-7b8cf4739fc9 None None] MFA Rules not processed for user `d84367b1295b4b49a07b7fee3dea87d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:11.919672 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-9a6f9315-c042-44d0-a118-7b8cf4739fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:11.980277 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 901/1805] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:11.984648 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16793c40-14ec-4b69-a833-a39384552630 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:12.044448 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16793c40-14ec-4b69-a833-a39384552630 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:12.049006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559826f7-fea4-4d4e-a09b-a09ab65cd19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:12.049659 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559826f7-fea4-4d4e-a09b-a09ab65cd19c admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:12.049948 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559826f7-fea4-4d4e-a09b-a09ab65cd19c admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:12.050250 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559826f7-fea4-4d4e-a09b-a09ab65cd19c admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:12.051058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559826f7-fea4-4d4e-a09b-a09ab65cd19c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:12.053561 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559826f7-fea4-4d4e-a09b-a09ab65cd19c admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:12.078971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 905/1806] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:02:11 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:12.082957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f9315-c042-44d0-a118-7b8cf4739fc9 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:12.093250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f9315-c042-44d0-a118-7b8cf4739fc9 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:12.148491 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b419dad-93c6-4966-bbdf-c2ee1c043b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:12.149172 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b419dad-93c6-4966-bbdf-c2ee1c043b20 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:12.149455 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b419dad-93c6-4966-bbdf-c2ee1c043b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:12.149730 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b419dad-93c6-4966-bbdf-c2ee1c043b20 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:12.150449 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b419dad-93c6-4966-bbdf-c2ee1c043b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:12.152355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b419dad-93c6-4966-bbdf-c2ee1c043b20 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:12.172530 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 902/1807] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:02:12 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:12.177740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559826f7-fea4-4d4e-a09b-a09ab65cd19c admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:12.188922 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559826f7-fea4-4d4e-a09b-a09ab65cd19c admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:12.193686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f15668-b932-4ded-80f7-e7af3fad874e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:12.194548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f15668-b932-4ded-80f7-e7af3fad874e admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:12.194858 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f15668-b932-4ded-80f7-e7af3fad874e admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:12.195138 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f15668-b932-4ded-80f7-e7af3fad874e admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:12.195894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f15668-b932-4ded-80f7-e7af3fad874e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:12.197584 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f15668-b932-4ded-80f7-e7af3fad874e admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:12.209590 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 906/1808] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:12.213749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b419dad-93c6-4966-bbdf-c2ee1c043b20 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:12.224464 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b419dad-93c6-4966-bbdf-c2ee1c043b20 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:12.229250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501e03f-c73f-41b6-bdf1-968e75e20d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:12.229906 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501e03f-c73f-41b6-bdf1-968e75e20d03 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:12.230183 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501e03f-c73f-41b6-bdf1-968e75e20d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:12.230480 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501e03f-c73f-41b6-bdf1-968e75e20d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:12.231206 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501e03f-c73f-41b6-bdf1-968e75e20d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:12.232859 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501e03f-c73f-41b6-bdf1-968e75e20d03 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:12.244076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 903/1809] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:12.251414 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f15668-b932-4ded-80f7-e7af3fad874e admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:12.261430 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f15668-b932-4ded-80f7-e7af3fad874e admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:12.266055 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7152a7-cc30-45a9-baea-5314714179c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:12.266969 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7152a7-cc30-45a9-baea-5314714179c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:12.267249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7152a7-cc30-45a9-baea-5314714179c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:12.267526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7152a7-cc30-45a9-baea-5314714179c7 admin admin] PATH_INFO: `/v3/projects/bcd1c509c43f4a9f95b8fba591b0090f/users/454c461bfdd54c4aa63fa2a934bd2474/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:12.282553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7152a7-cc30-45a9-baea-5314714179c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd1c509c43f4a9f95b8fba591b0090f, user_id=454c461bfdd54c4aa63fa2a934bd2474, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:12.285170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7152a7-cc30-45a9-baea-5314714179c7 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:12.299814 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 907/1810] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:02:12 2022] PUT /identity/v3/projects/bcd1c509c43f4a9f95b8fba591b0090f/users/454c461bfdd54c4aa63fa2a934bd2474/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:12.312747 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67e229-7070-4fcb-a354-008e111afb30 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:12.313037 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67e229-7070-4fcb-a354-008e111afb30 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:12.313315 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67e229-7070-4fcb-a354-008e111afb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:12.339902 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-6e67e229-7070-4fcb-a354-008e111afb30 None None] MFA Rules not processed for user `454c461bfdd54c4aa63fa2a934bd2474`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:12.341052 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-6e67e229-7070-4fcb-a354-008e111afb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:12.406731 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 904/1811] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:12.412544 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7152a7-cc30-45a9-baea-5314714179c7 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:12.472068 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7152a7-cc30-45a9-baea-5314714179c7 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:12.477905 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8feaf-3b60-4be1-a029-57edbb7d93cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:12.478611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8feaf-3b60-4be1-a029-57edbb7d93cd admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:12.478899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8feaf-3b60-4be1-a029-57edbb7d93cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:12.479191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8feaf-3b60-4be1-a029-57edbb7d93cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:12.479887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8feaf-3b60-4be1-a029-57edbb7d93cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:12.482080 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8feaf-3b60-4be1-a029-57edbb7d93cd admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:12.514733 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 908/1812] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:02:12 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:02:12.515876 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67e229-7070-4fcb-a354-008e111afb30 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:12.527231 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67e229-7070-4fcb-a354-008e111afb30 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:12.583598 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ee064-747f-44c6-bf94-a21e10992d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:12.584395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ee064-747f-44c6-bf94-a21e10992d06 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:12.584541 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ee064-747f-44c6-bf94-a21e10992d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:12.584807 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ee064-747f-44c6-bf94-a21e10992d06 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:12.585496 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ee064-747f-44c6-bf94-a21e10992d06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:12.587442 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ee064-747f-44c6-bf94-a21e10992d06 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:12.612398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 905/1813] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:02:12 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:12.614113 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8feaf-3b60-4be1-a029-57edbb7d93cd admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:12.624762 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8feaf-3b60-4be1-a029-57edbb7d93cd admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:12.632062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72145f5d-8a90-4343-87ec-9bbe5e1bfac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:12.633120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72145f5d-8a90-4343-87ec-9bbe5e1bfac2 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:12.633455 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72145f5d-8a90-4343-87ec-9bbe5e1bfac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:12.633738 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72145f5d-8a90-4343-87ec-9bbe5e1bfac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:12.634498 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72145f5d-8a90-4343-87ec-9bbe5e1bfac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:12.636082 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72145f5d-8a90-4343-87ec-9bbe5e1bfac2 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:12.646971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 909/1814] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:12.656970 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ee064-747f-44c6-bf94-a21e10992d06 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:12.667853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ee064-747f-44c6-bf94-a21e10992d06 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:12.672435 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1d11e-e3d0-45c6-9b1b-14d4d80632d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:12.673359 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1d11e-e3d0-45c6-9b1b-14d4d80632d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:12.673641 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1d11e-e3d0-45c6-9b1b-14d4d80632d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:12.673913 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1d11e-e3d0-45c6-9b1b-14d4d80632d3 admin admin] PATH_INFO: `/v3/projects/3e783bb3eb664335aa89e468147e0634/users/3cdf8f2a7d2640c78bb7f7a71a9f44b7/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:12.688740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1d11e-e3d0-45c6-9b1b-14d4d80632d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e783bb3eb664335aa89e468147e0634, user_id=3cdf8f2a7d2640c78bb7f7a71a9f44b7, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:12.691397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1d11e-e3d0-45c6-9b1b-14d4d80632d3 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:12.704163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 906/1815] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:02:12 2022] PUT /identity/v3/projects/3e783bb3eb664335aa89e468147e0634/users/3cdf8f2a7d2640c78bb7f7a71a9f44b7/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:12.708140 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72145f5d-8a90-4343-87ec-9bbe5e1bfac2 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:12.717808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72145f5d-8a90-4343-87ec-9bbe5e1bfac2 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:12.771588 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef355f-1b49-4d38-9e24-5ce971b23dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:12.772250 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef355f-1b49-4d38-9e24-5ce971b23dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:12.772535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef355f-1b49-4d38-9e24-5ce971b23dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:12.772812 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef355f-1b49-4d38-9e24-5ce971b23dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:12.773533 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef355f-1b49-4d38-9e24-5ce971b23dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:12.775150 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef355f-1b49-4d38-9e24-5ce971b23dc0 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:12.784439 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 910/1816] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:12.789112 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1d11e-e3d0-45c6-9b1b-14d4d80632d3 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:12.799060 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1d11e-e3d0-45c6-9b1b-14d4d80632d3 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:12.804667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c038f-6e94-4e78-bf8a-bd0b081ea008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:12.805584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c038f-6e94-4e78-bf8a-bd0b081ea008 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:12.805863 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c038f-6e94-4e78-bf8a-bd0b081ea008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:12.806166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c038f-6e94-4e78-bf8a-bd0b081ea008 admin admin] PATH_INFO: `/v3/projects/3e783bb3eb664335aa89e468147e0634/users/3cdf8f2a7d2640c78bb7f7a71a9f44b7/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:12.808306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c038f-6e94-4e78-bf8a-bd0b081ea008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e783bb3eb664335aa89e468147e0634, user_id=3cdf8f2a7d2640c78bb7f7a71a9f44b7, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:12.811036 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c038f-6e94-4e78-bf8a-bd0b081ea008 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:12.821588 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 907/1817] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:02:12 2022] PUT /identity/v3/projects/3e783bb3eb664335aa89e468147e0634/users/3cdf8f2a7d2640c78bb7f7a71a9f44b7/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:12.832138 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfb73d-0371-4e58-9d30-35d3f6c80488 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:12.832478 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfb73d-0371-4e58-9d30-35d3f6c80488 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:12.832791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfb73d-0371-4e58-9d30-35d3f6c80488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:12.868112 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-adbfb73d-0371-4e58-9d30-35d3f6c80488 None None] MFA Rules not processed for user `3cdf8f2a7d2640c78bb7f7a71a9f44b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:12.869417 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-adbfb73d-0371-4e58-9d30-35d3f6c80488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:12.936583 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 911/1818] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:12.947642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c038f-6e94-4e78-bf8a-bd0b081ea008 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:12.949290 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-d88c038f-6e94-4e78-bf8a-bd0b081ea008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:13.003171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c038f-6e94-4e78-bf8a-bd0b081ea008 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:13.007083 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c6f8c-a1eb-4ac0-81f0-48a80d5028e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:13.007785 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c6f8c-a1eb-4ac0-81f0-48a80d5028e4 service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:13.008098 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c6f8c-a1eb-4ac0-81f0-48a80d5028e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:13.008407 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c6f8c-a1eb-4ac0-81f0-48a80d5028e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:13.017488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c6f8c-a1eb-4ac0-81f0-48a80d5028e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:13.018969 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c6f8c-a1eb-4ac0-81f0-48a80d5028e4 service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:13.028812 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 908/1819] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:13.070632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbfb73d-0371-4e58-9d30-35d3f6c80488 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:13.072042 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-adbfb73d-0371-4e58-9d30-35d3f6c80488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:13.084130 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbfb73d-0371-4e58-9d30-35d3f6c80488 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:13.087688 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487412c-1d96-42bc-b76a-79f0d6210305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:13.088333 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487412c-1d96-42bc-b76a-79f0d6210305 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:13.088618 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487412c-1d96-42bc-b76a-79f0d6210305 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:13.088919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487412c-1d96-42bc-b76a-79f0d6210305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:13.143194 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487412c-1d96-42bc-b76a-79f0d6210305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:13.144553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487412c-1d96-42bc-b76a-79f0d6210305 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:13.153669 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 912/1820] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:18.221145 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c6f8c-a1eb-4ac0-81f0-48a80d5028e4 service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:18.222795 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-030c6f8c-a1eb-4ac0-81f0-48a80d5028e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:18.343912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c6f8c-a1eb-4ac0-81f0-48a80d5028e4 service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:18.351831 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428890c-40da-4393-9acb-29f7d8f1ef98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:18.353218 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428890c-40da-4393-9acb-29f7d8f1ef98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:18.353592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428890c-40da-4393-9acb-29f7d8f1ef98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:18.353960 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428890c-40da-4393-9acb-29f7d8f1ef98 admin admin] PATH_INFO: `/v3/users/c18aa0966c8c42a895ced7945d2bcf67` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:18.355652 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428890c-40da-4393-9acb-29f7d8f1ef98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c18aa0966c8c42a895ced7945d2bcf67)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:18.358762 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428890c-40da-4393-9acb-29f7d8f1ef98 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:18.451203 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-c428890c-40da-4393-9acb-29f7d8f1ef98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c18aa0966c8c42a895ced7945d2bcf67'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:18.469487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-c428890c-40da-4393-9acb-29f7d8f1ef98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c18aa0966c8c42a895ced7945d2bcf67'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:18.491201 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-c428890c-40da-4393-9acb-29f7d8f1ef98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c18aa0966c8c42a895ced7945d2bcf67'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:18.492188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-c428890c-40da-4393-9acb-29f7d8f1ef98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c18aa0966c8c42a895ced7945d2bcf67'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:18.492884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-c428890c-40da-4393-9acb-29f7d8f1ef98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c18aa0966c8c42a895ced7945d2bcf67'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:18.510275 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 909/1821] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:02:18 2022] DELETE /identity/v3/users/c18aa0966c8c42a895ced7945d2bcf67 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:18.514467 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52643281-56ad-44af-ba03-38a4dc6d5492 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:18.515429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52643281-56ad-44af-ba03-38a4dc6d5492 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:18.515845 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52643281-56ad-44af-ba03-38a4dc6d5492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:18.552393 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-52643281-56ad-44af-ba03-38a4dc6d5492 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:18.554547 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-52643281-56ad-44af-ba03-38a4dc6d5492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:18.773916 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428890c-40da-4393-9acb-29f7d8f1ef98 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:18.774215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 913/1822] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:18.774709 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-c428890c-40da-4393-9acb-29f7d8f1ef98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:18.887488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428890c-40da-4393-9acb-29f7d8f1ef98 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:18.892852 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bc845-640a-43b4-9dc9-370ddcc8e6fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:18.893755 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bc845-640a-43b4-9dc9-370ddcc8e6fd service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:18.894092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bc845-640a-43b4-9dc9-370ddcc8e6fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:18.894511 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bc845-640a-43b4-9dc9-370ddcc8e6fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:18.907783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427bc845-640a-43b4-9dc9-370ddcc8e6fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:18.909545 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427bc845-640a-43b4-9dc9-370ddcc8e6fd service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:18.928364 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 910/1823] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:18.946130 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52643281-56ad-44af-ba03-38a4dc6d5492 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:18.947787 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-52643281-56ad-44af-ba03-38a4dc6d5492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:18.971305 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52643281-56ad-44af-ba03-38a4dc6d5492 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:18.989584 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00340da6-ee24-4abf-b4c3-29737d4302fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:18.992235 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00340da6-ee24-4abf-b4c3-29737d4302fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:18.992529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00340da6-ee24-4abf-b4c3-29737d4302fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:18.992811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00340da6-ee24-4abf-b4c3-29737d4302fb admin admin] PATH_INFO: `/v3/users/f0cbe00f23f74e528b95e85984d10d80` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:18.994109 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00340da6-ee24-4abf-b4c3-29737d4302fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0cbe00f23f74e528b95e85984d10d80)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:18.996292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00340da6-ee24-4abf-b4c3-29737d4302fb admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:19.072739 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-00340da6-ee24-4abf-b4c3-29737d4302fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0cbe00f23f74e528b95e85984d10d80'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:19.073931 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-00340da6-ee24-4abf-b4c3-29737d4302fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0cbe00f23f74e528b95e85984d10d80'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:19.088609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-00340da6-ee24-4abf-b4c3-29737d4302fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0cbe00f23f74e528b95e85984d10d80'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:19.098529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-00340da6-ee24-4abf-b4c3-29737d4302fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0cbe00f23f74e528b95e85984d10d80'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:19.110598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-00340da6-ee24-4abf-b4c3-29737d4302fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0cbe00f23f74e528b95e85984d10d80'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:19.120653 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 914/1824] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:02:18 2022] DELETE /identity/v3/users/f0cbe00f23f74e528b95e85984d10d80 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:19.125983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd324a7a-a32c-4954-abe2-cb2a64f6f069 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:19.126588 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd324a7a-a32c-4954-abe2-cb2a64f6f069 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:19.127067 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd324a7a-a32c-4954-abe2-cb2a64f6f069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:19.152723 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-fd324a7a-a32c-4954-abe2-cb2a64f6f069 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:19.154128 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-fd324a7a-a32c-4954-abe2-cb2a64f6f069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:19.242332 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 911/1825] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:02:19.258864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00340da6-ee24-4abf-b4c3-29737d4302fb admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:19.260330 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-00340da6-ee24-4abf-b4c3-29737d4302fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:19.341966 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00340da6-ee24-4abf-b4c3-29737d4302fb admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:19.345694 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffbce6-1c24-4bac-9ead-2202c568ac10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:19.346313 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffbce6-1c24-4bac-9ead-2202c568ac10 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:19.346590 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffbce6-1c24-4bac-9ead-2202c568ac10 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:19.346862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffbce6-1c24-4bac-9ead-2202c568ac10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:19.357639 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffbce6-1c24-4bac-9ead-2202c568ac10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:19.359109 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffbce6-1c24-4bac-9ead-2202c568ac10 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:19.370241 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 915/1826] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:19.443913 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd324a7a-a32c-4954-abe2-cb2a64f6f069 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:19.446039 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-fd324a7a-a32c-4954-abe2-cb2a64f6f069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:19.461243 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd324a7a-a32c-4954-abe2-cb2a64f6f069 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:19.466675 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec266296-c659-498b-930c-f10c11637f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:19.467754 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec266296-c659-498b-930c-f10c11637f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:19.468220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec266296-c659-498b-930c-f10c11637f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:19.468639 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec266296-c659-498b-930c-f10c11637f82 admin admin] PATH_INFO: `/v3/projects/258cea3bff244e188a1e92b8a55a2219` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:19.470186 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec266296-c659-498b-930c-f10c11637f82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=258cea3bff244e188a1e92b8a55a2219)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:19.472672 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec266296-c659-498b-930c-f10c11637f82 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:19.523088 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ec266296-c659-498b-930c-f10c11637f82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '258cea3bff244e188a1e92b8a55a2219', 'request_id': 'req-ec266296-c659-498b-930c-f10c11637f82'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:19.528287 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ec266296-c659-498b-930c-f10c11637f82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '258cea3bff244e188a1e92b8a55a2219', 'request_id': 'req-ec266296-c659-498b-930c-f10c11637f82'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:19.534628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ec266296-c659-498b-930c-f10c11637f82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '258cea3bff244e188a1e92b8a55a2219', 'request_id': 'req-ec266296-c659-498b-930c-f10c11637f82'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:19.549226 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ec266296-c659-498b-930c-f10c11637f82 admin admin] The token cache is being invalidate because project 258cea3bff244e188a1e92b8a55a2219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:02:19.549521 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ec266296-c659-498b-930c-f10c11637f82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:19.550163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ec266296-c659-498b-930c-f10c11637f82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:19.554632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 912/1827] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:02:19 2022] DELETE /identity/v3/projects/258cea3bff244e188a1e92b8a55a2219 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:19.558575 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffbce6-1c24-4bac-9ead-2202c568ac10 service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:19.568304 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffbce6-1c24-4bac-9ead-2202c568ac10 service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:19.636911 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56684c61-b60e-432e-857b-3ed864b12d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:19.637798 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56684c61-b60e-432e-857b-3ed864b12d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:19.638083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56684c61-b60e-432e-857b-3ed864b12d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:19.638409 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56684c61-b60e-432e-857b-3ed864b12d2c admin admin] PATH_INFO: `/v3/users/8ca31ea3c27b4a00a62d84e302a76ec6` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:19.639689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56684c61-b60e-432e-857b-3ed864b12d2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ca31ea3c27b4a00a62d84e302a76ec6)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:19.641724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56684c61-b60e-432e-857b-3ed864b12d2c admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:19.693117 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-56684c61-b60e-432e-857b-3ed864b12d2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ca31ea3c27b4a00a62d84e302a76ec6'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:19.694282 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-56684c61-b60e-432e-857b-3ed864b12d2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ca31ea3c27b4a00a62d84e302a76ec6'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:19.695871 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec266296-c659-498b-930c-f10c11637f82 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:19.698611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-ec266296-c659-498b-930c-f10c11637f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:19.710877 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-56684c61-b60e-432e-857b-3ed864b12d2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ca31ea3c27b4a00a62d84e302a76ec6'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:19.718052 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec266296-c659-498b-930c-f10c11637f82 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:19.719136 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-56684c61-b60e-432e-857b-3ed864b12d2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ca31ea3c27b4a00a62d84e302a76ec6'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:19.725977 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3476e-8b9f-4b94-88d8-43f64442ac3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:19.727339 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3476e-8b9f-4b94-88d8-43f64442ac3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:19.727422 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3476e-8b9f-4b94-88d8-43f64442ac3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:19.727862 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3476e-8b9f-4b94-88d8-43f64442ac3e admin admin] PATH_INFO: `/v3/projects/f4c8b4d897af41e48334a798e0a40c7c` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:19.727965 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-56684c61-b60e-432e-857b-3ed864b12d2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ca31ea3c27b4a00a62d84e302a76ec6'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:19.729494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3476e-8b9f-4b94-88d8-43f64442ac3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4c8b4d897af41e48334a798e0a40c7c)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:19.731839 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3476e-8b9f-4b94-88d8-43f64442ac3e admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:19.734144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 916/1828] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:02:19 2022] DELETE /identity/v3/users/8ca31ea3c27b4a00a62d84e302a76ec6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:19.793993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-d1e3476e-8b9f-4b94-88d8-43f64442ac3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4c8b4d897af41e48334a798e0a40c7c', 'request_id': 'req-d1e3476e-8b9f-4b94-88d8-43f64442ac3e'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:19.801179 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-d1e3476e-8b9f-4b94-88d8-43f64442ac3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4c8b4d897af41e48334a798e0a40c7c', 'request_id': 'req-d1e3476e-8b9f-4b94-88d8-43f64442ac3e'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:19.808813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-d1e3476e-8b9f-4b94-88d8-43f64442ac3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4c8b4d897af41e48334a798e0a40c7c', 'request_id': 'req-d1e3476e-8b9f-4b94-88d8-43f64442ac3e'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:19.821541 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-d1e3476e-8b9f-4b94-88d8-43f64442ac3e admin admin] The token cache is being invalidate because project f4c8b4d897af41e48334a798e0a40c7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:02:19.821857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-d1e3476e-8b9f-4b94-88d8-43f64442ac3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:19.822539 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-d1e3476e-8b9f-4b94-88d8-43f64442ac3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:19.824148 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 913/1829] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:02:19 2022] DELETE /identity/v3/projects/f4c8b4d897af41e48334a798e0a40c7c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:02:19.828229 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56684c61-b60e-432e-857b-3ed864b12d2c admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:19.829682 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-56684c61-b60e-432e-857b-3ed864b12d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:19.898678 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56684c61-b60e-432e-857b-3ed864b12d2c admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:19.964023 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5da04-da61-4732-abff-f2614e6eabc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:19.964921 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5da04-da61-4732-abff-f2614e6eabc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:19.965183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5da04-da61-4732-abff-f2614e6eabc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:19.965458 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5da04-da61-4732-abff-f2614e6eabc3 admin admin] PATH_INFO: `/v3/users/2e3e325a1d87453ba299a78e19f97237` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:19.966687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5da04-da61-4732-abff-f2614e6eabc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e3e325a1d87453ba299a78e19f97237)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:19.968599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5da04-da61-4732-abff-f2614e6eabc3 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:20.026762 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-ead5da04-da61-4732-abff-f2614e6eabc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e3e325a1d87453ba299a78e19f97237'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:20.027780 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-ead5da04-da61-4732-abff-f2614e6eabc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e3e325a1d87453ba299a78e19f97237'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:20.039979 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-ead5da04-da61-4732-abff-f2614e6eabc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e3e325a1d87453ba299a78e19f97237'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:20.065166 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-ead5da04-da61-4732-abff-f2614e6eabc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e3e325a1d87453ba299a78e19f97237'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:20.084773 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-ead5da04-da61-4732-abff-f2614e6eabc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e3e325a1d87453ba299a78e19f97237'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:20.097085 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 917/1830] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:02:19 2022] DELETE /identity/v3/users/2e3e325a1d87453ba299a78e19f97237 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:20.145566 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3476e-8b9f-4b94-88d8-43f64442ac3e admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:20.147538 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-d1e3476e-8b9f-4b94-88d8-43f64442ac3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:20.169831 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3476e-8b9f-4b94-88d8-43f64442ac3e admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:20.233091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22316d-758c-46c6-9800-d61e47fc7d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:20.233980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22316d-758c-46c6-9800-d61e47fc7d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:20.234286 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22316d-758c-46c6-9800-d61e47fc7d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:20.234561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22316d-758c-46c6-9800-d61e47fc7d52 admin admin] PATH_INFO: `/v3/projects/f4b2ad4cd1f74fc8bf99d935a2d6309f` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:20.235873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22316d-758c-46c6-9800-d61e47fc7d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4b2ad4cd1f74fc8bf99d935a2d6309f)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:20.237777 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22316d-758c-46c6-9800-d61e47fc7d52 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:20.290779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ba22316d-758c-46c6-9800-d61e47fc7d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b2ad4cd1f74fc8bf99d935a2d6309f', 'request_id': 'req-ba22316d-758c-46c6-9800-d61e47fc7d52'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:20.296670 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ba22316d-758c-46c6-9800-d61e47fc7d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b2ad4cd1f74fc8bf99d935a2d6309f', 'request_id': 'req-ba22316d-758c-46c6-9800-d61e47fc7d52'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:20.303129 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ba22316d-758c-46c6-9800-d61e47fc7d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b2ad4cd1f74fc8bf99d935a2d6309f', 'request_id': 'req-ba22316d-758c-46c6-9800-d61e47fc7d52'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:20.315643 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ba22316d-758c-46c6-9800-d61e47fc7d52 admin admin] The token cache is being invalidate because project f4b2ad4cd1f74fc8bf99d935a2d6309f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:02:20.315926 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ba22316d-758c-46c6-9800-d61e47fc7d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:20.316536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ba22316d-758c-46c6-9800-d61e47fc7d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:20.322968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 914/1831] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:02:20 2022] DELETE /identity/v3/projects/f4b2ad4cd1f74fc8bf99d935a2d6309f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:20.326177 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20287e6e-5f66-407a-b5bf-b0391443200f None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:20.326498 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20287e6e-5f66-407a-b5bf-b0391443200f None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:20.326778 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20287e6e-5f66-407a-b5bf-b0391443200f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:20.345747 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-20287e6e-5f66-407a-b5bf-b0391443200f None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:20.347066 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-20287e6e-5f66-407a-b5bf-b0391443200f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:20.412140 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 918/1832] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:20.420140 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84ec99-cbd8-4ae2-bb36-58a2a06e3678 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:20.420348 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84ec99-cbd8-4ae2-bb36-58a2a06e3678 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:20.420625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84ec99-cbd8-4ae2-bb36-58a2a06e3678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:20.439811 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-af84ec99-cbd8-4ae2-bb36-58a2a06e3678 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:20.441149 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-af84ec99-cbd8-4ae2-bb36-58a2a06e3678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:20.454308 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 915/1833] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:20.455604 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20287e6e-5f66-407a-b5bf-b0391443200f None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:20.466804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20287e6e-5f66-407a-b5bf-b0391443200f None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:20.473628 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5d558-9e06-49a1-8f0c-2f1f5baf2908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:20.474538 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5d558-9e06-49a1-8f0c-2f1f5baf2908 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:20.475196 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5d558-9e06-49a1-8f0c-2f1f5baf2908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:20.475480 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5d558-9e06-49a1-8f0c-2f1f5baf2908 admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:20.476237 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5d558-9e06-49a1-8f0c-2f1f5baf2908 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:02:20.476700 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5d558-9e06-49a1-8f0c-2f1f5baf2908 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:20.478414 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5d558-9e06-49a1-8f0c-2f1f5baf2908 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:20.492715 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 919/1834] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:02:20.497081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84ec99-cbd8-4ae2-bb36-58a2a06e3678 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:20.506994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84ec99-cbd8-4ae2-bb36-58a2a06e3678 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:20.511684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ebb2f-2b06-457d-8f1c-0ab404ea3e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:20.512350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ebb2f-2b06-457d-8f1c-0ab404ea3e98 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:20.512629 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ebb2f-2b06-457d-8f1c-0ab404ea3e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:20.512899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ebb2f-2b06-457d-8f1c-0ab404ea3e98 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:20.513587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ebb2f-2b06-457d-8f1c-0ab404ea3e98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:20.515561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ebb2f-2b06-457d-8f1c-0ab404ea3e98 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:20.542147 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 916/1835] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:02:20 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:20.546369 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5d558-9e06-49a1-8f0c-2f1f5baf2908 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:20.557532 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5d558-9e06-49a1-8f0c-2f1f5baf2908 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:20.615445 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d26dd-6723-4582-b6a0-758080c00be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:20.616135 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d26dd-6723-4582-b6a0-758080c00be9 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:20.616422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d26dd-6723-4582-b6a0-758080c00be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:20.616952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d26dd-6723-4582-b6a0-758080c00be9 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:20.617657 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d26dd-6723-4582-b6a0-758080c00be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:20.619724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d26dd-6723-4582-b6a0-758080c00be9 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:20.643750 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 920/1836] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:02:20 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:20.645218 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ebb2f-2b06-457d-8f1c-0ab404ea3e98 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:20.656305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ebb2f-2b06-457d-8f1c-0ab404ea3e98 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:20.661234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8446f-e222-4617-950c-0ee12eaa456a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:20.662846 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8446f-e222-4617-950c-0ee12eaa456a admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:20.663151 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8446f-e222-4617-950c-0ee12eaa456a admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:20.663411 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8446f-e222-4617-950c-0ee12eaa456a admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:20.664150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8446f-e222-4617-950c-0ee12eaa456a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:20.665806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8446f-e222-4617-950c-0ee12eaa456a admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:20.678232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 917/1837] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:20.680999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d26dd-6723-4582-b6a0-758080c00be9 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:20.691490 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d26dd-6723-4582-b6a0-758080c00be9 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:20.697068 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7884b89-545c-40df-a25f-da906e69319d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:20.697748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7884b89-545c-40df-a25f-da906e69319d admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:20.698017 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7884b89-545c-40df-a25f-da906e69319d admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:20.698328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7884b89-545c-40df-a25f-da906e69319d admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:20.699064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7884b89-545c-40df-a25f-da906e69319d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:20.700724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7884b89-545c-40df-a25f-da906e69319d admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:20.702829 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8446f-e222-4617-950c-0ee12eaa456a admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:20.705769 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-58a8446f-e222-4617-950c-0ee12eaa456a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:20.717988 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 921/1838] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:02:20.720502 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8446f-e222-4617-950c-0ee12eaa456a admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:20.722258 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7884b89-545c-40df-a25f-da906e69319d admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:20.726599 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a002ce-aace-4bbc-ab92-2ed49ae84af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:20.727476 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a002ce-aace-4bbc-ab92-2ed49ae84af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:20.727852 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a002ce-aace-4bbc-ab92-2ed49ae84af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:20.728012 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a002ce-aace-4bbc-ab92-2ed49ae84af4 admin admin] PATH_INFO: `/v3/projects/7838c0f29c8a437395392cbcf32e3716` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:20.729203 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a002ce-aace-4bbc-ab92-2ed49ae84af4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7838c0f29c8a437395392cbcf32e3716)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:20.731122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a002ce-aace-4bbc-ab92-2ed49ae84af4 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:20.733614 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7884b89-545c-40df-a25f-da906e69319d admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:20.738383 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6aed1b-5829-4538-91a0-fbe9a5faef48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:20.739496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6aed1b-5829-4538-91a0-fbe9a5faef48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:20.739669 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6aed1b-5829-4538-91a0-fbe9a5faef48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:20.740115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6aed1b-5829-4538-91a0-fbe9a5faef48 admin admin] PATH_INFO: `/v3/projects/5744bd217e014d878c13abe56cd0f7ae/users/97054dcf6f804f5cb745ebdef98bea6d/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:20.755154 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6aed1b-5829-4538-91a0-fbe9a5faef48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5744bd217e014d878c13abe56cd0f7ae, user_id=97054dcf6f804f5cb745ebdef98bea6d, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:20.758027 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6aed1b-5829-4538-91a0-fbe9a5faef48 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:20.771635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 922/1839] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:02:20 2022] PUT /identity/v3/projects/5744bd217e014d878c13abe56cd0f7ae/users/97054dcf6f804f5cb745ebdef98bea6d/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:20.778928 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b3a002ce-aace-4bbc-ab92-2ed49ae84af4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7838c0f29c8a437395392cbcf32e3716', 'request_id': 'req-b3a002ce-aace-4bbc-ab92-2ed49ae84af4'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:20.782176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec24597-723b-4934-a259-bf3d89ca1ff0 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:20.782560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec24597-723b-4934-a259-bf3d89ca1ff0 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:20.782770 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec24597-723b-4934-a259-bf3d89ca1ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:20.786861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b3a002ce-aace-4bbc-ab92-2ed49ae84af4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7838c0f29c8a437395392cbcf32e3716', 'request_id': 'req-b3a002ce-aace-4bbc-ab92-2ed49ae84af4'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:20.792658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b3a002ce-aace-4bbc-ab92-2ed49ae84af4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7838c0f29c8a437395392cbcf32e3716', 'request_id': 'req-b3a002ce-aace-4bbc-ab92-2ed49ae84af4'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:20.807826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b3a002ce-aace-4bbc-ab92-2ed49ae84af4 admin admin] The token cache is being invalidate because project 7838c0f29c8a437395392cbcf32e3716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:02:20.808115 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b3a002ce-aace-4bbc-ab92-2ed49ae84af4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:20.808773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b3a002ce-aace-4bbc-ab92-2ed49ae84af4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:20.810382 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 918/1840] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:02:20 2022] DELETE /identity/v3/projects/7838c0f29c8a437395392cbcf32e3716 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:20.815294 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67739ef7-4f9b-4b67-860b-e818ce52d97d None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:20.816045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67739ef7-4f9b-4b67-860b-e818ce52d97d None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:20.816621 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67739ef7-4f9b-4b67-860b-e818ce52d97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:20.820238 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-aec24597-723b-4934-a259-bf3d89ca1ff0 None None] MFA Rules not processed for user `97054dcf6f804f5cb745ebdef98bea6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:20.822724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-aec24597-723b-4934-a259-bf3d89ca1ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:20.836118 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-67739ef7-4f9b-4b67-860b-e818ce52d97d None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:20.837597 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-67739ef7-4f9b-4b67-860b-e818ce52d97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:20.890786 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 923/1841] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:02:20.895231 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec24597-723b-4934-a259-bf3d89ca1ff0 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:20.896586 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-aec24597-723b-4934-a259-bf3d89ca1ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:20.896930 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 919/1842] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:02:20.905432 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562f412-4153-45af-aef5-adfa74053773 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:20.905722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562f412-4153-45af-aef5-adfa74053773 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:20.906029 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562f412-4153-45af-aef5-adfa74053773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:20.909788 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec24597-723b-4934-a259-bf3d89ca1ff0 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:20.914897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fcb82-cc37-4a8e-8853-ee24ac027928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:20.915553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fcb82-cc37-4a8e-8853-ee24ac027928 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:20.915849 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fcb82-cc37-4a8e-8853-ee24ac027928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:20.916117 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fcb82-cc37-4a8e-8853-ee24ac027928 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:20.916837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fcb82-cc37-4a8e-8853-ee24ac027928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:20.918767 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fcb82-cc37-4a8e-8853-ee24ac027928 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:20.924511 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-6562f412-4153-45af-aef5-adfa74053773 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:20.925704 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-6562f412-4153-45af-aef5-adfa74053773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:20.934600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 920/1843] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:02:20.939255 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562f412-4153-45af-aef5-adfa74053773 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:20.948746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 924/1844] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:02:20 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:02:20.949751 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fcb82-cc37-4a8e-8853-ee24ac027928 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:20.951504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562f412-4153-45af-aef5-adfa74053773 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:21.009827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6941607-0c86-44fd-86b9-139c44690cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:21.010531 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6941607-0c86-44fd-86b9-139c44690cea admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:21.010717 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fcb82-cc37-4a8e-8853-ee24ac027928 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:21.010816 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6941607-0c86-44fd-86b9-139c44690cea admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:21.011077 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6941607-0c86-44fd-86b9-139c44690cea admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:21.011921 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6941607-0c86-44fd-86b9-139c44690cea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:02:21.012230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6941607-0c86-44fd-86b9-139c44690cea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:21.013829 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6941607-0c86-44fd-86b9-139c44690cea admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:21.015358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227f4ac-53e9-49fb-a0a2-34bd1728500b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:21.016454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227f4ac-53e9-49fb-a0a2-34bd1728500b admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:21.016454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227f4ac-53e9-49fb-a0a2-34bd1728500b admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:21.016850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227f4ac-53e9-49fb-a0a2-34bd1728500b admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:21.017622 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227f4ac-53e9-49fb-a0a2-34bd1728500b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:21.019623 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227f4ac-53e9-49fb-a0a2-34bd1728500b admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:21.029595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 921/1845] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:02:21.030980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6941607-0c86-44fd-86b9-139c44690cea admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:21.041381 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6941607-0c86-44fd-86b9-139c44690cea admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:21.043450 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 925/1846] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:02:20 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:21.047171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227f4ac-53e9-49fb-a0a2-34bd1728500b admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:21.049213 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e0729-2cb2-4afa-bfee-28bb78acd978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:21.049849 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e0729-2cb2-4afa-bfee-28bb78acd978 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:21.050181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e0729-2cb2-4afa-bfee-28bb78acd978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:21.050487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e0729-2cb2-4afa-bfee-28bb78acd978 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:21.051173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e0729-2cb2-4afa-bfee-28bb78acd978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:21.053224 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e0729-2cb2-4afa-bfee-28bb78acd978 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:21.057401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227f4ac-53e9-49fb-a0a2-34bd1728500b admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:21.062358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdd83b-e8d4-4882-b095-b70192709e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:21.063032 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdd83b-e8d4-4882-b095-b70192709e20 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:21.063320 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdd83b-e8d4-4882-b095-b70192709e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:21.063599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdd83b-e8d4-4882-b095-b70192709e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:21.064327 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdd83b-e8d4-4882-b095-b70192709e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:21.065940 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdd83b-e8d4-4882-b095-b70192709e20 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:21.078231 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 926/1847] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:21.082360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdd83b-e8d4-4882-b095-b70192709e20 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:21.088494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 922/1848] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:02:21 2022] POST /identity/v3/projects => generated 363 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:21.092322 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e0729-2cb2-4afa-bfee-28bb78acd978 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:21.097034 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdd83b-e8d4-4882-b095-b70192709e20 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:21.185158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e0729-2cb2-4afa-bfee-28bb78acd978 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:21.188749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262885ed-a617-40ff-97cf-f82adf2e5d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:21.189775 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262885ed-a617-40ff-97cf-f82adf2e5d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:21.189900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88816f11-2809-4c35-8968-ff91a52abee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:21.190523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88816f11-2809-4c35-8968-ff91a52abee5 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:21.190684 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262885ed-a617-40ff-97cf-f82adf2e5d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:21.190832 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88816f11-2809-4c35-8968-ff91a52abee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:21.191013 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262885ed-a617-40ff-97cf-f82adf2e5d25 admin admin] PATH_INFO: `/v3/projects/dbcc3a4c024e41fb8a9faec11f72a5f3/users/675bced5ded745a994acf3792ae3c4f6/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:21.191103 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88816f11-2809-4c35-8968-ff91a52abee5 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:21.191888 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88816f11-2809-4c35-8968-ff91a52abee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:21.195790 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88816f11-2809-4c35-8968-ff91a52abee5 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:21.207569 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262885ed-a617-40ff-97cf-f82adf2e5d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbcc3a4c024e41fb8a9faec11f72a5f3, user_id=675bced5ded745a994acf3792ae3c4f6, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:21.211335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262885ed-a617-40ff-97cf-f82adf2e5d25 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:21.225663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 923/1849] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:02:21 2022] POST /identity/v3/users => generated 282 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:02:21.227372 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 927/1850] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:02:21 2022] PUT /identity/v3/projects/dbcc3a4c024e41fb8a9faec11f72a5f3/users/675bced5ded745a994acf3792ae3c4f6/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:21.231374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88816f11-2809-4c35-8968-ff91a52abee5 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:21.232217 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262885ed-a617-40ff-97cf-f82adf2e5d25 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:21.243064 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88816f11-2809-4c35-8968-ff91a52abee5 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:21.308009 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f489475-ccca-49bc-8647-e75ce3432259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:21.308699 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f489475-ccca-49bc-8647-e75ce3432259 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:21.309609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f489475-ccca-49bc-8647-e75ce3432259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:21.309900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f489475-ccca-49bc-8647-e75ce3432259 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:21.311404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f489475-ccca-49bc-8647-e75ce3432259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:21.314362 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f489475-ccca-49bc-8647-e75ce3432259 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:21.316874 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262885ed-a617-40ff-97cf-f82adf2e5d25 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:21.323181 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d80b55-bbc8-416c-8c07-cd6e9c195df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:21.323855 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d80b55-bbc8-416c-8c07-cd6e9c195df1 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:21.324129 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d80b55-bbc8-416c-8c07-cd6e9c195df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:21.324401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d80b55-bbc8-416c-8c07-cd6e9c195df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:21.325202 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d80b55-bbc8-416c-8c07-cd6e9c195df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:21.327817 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d80b55-bbc8-416c-8c07-cd6e9c195df1 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:21.330983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 924/1851] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:21.334005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f489475-ccca-49bc-8647-e75ce3432259 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:21.340503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 928/1852] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:02:21.342928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d80b55-bbc8-416c-8c07-cd6e9c195df1 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:21.347117 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f489475-ccca-49bc-8647-e75ce3432259 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:21.352244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7e9ce-a7ee-4333-a6dc-82e4c27ae23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:21.353423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7e9ce-a7ee-4333-a6dc-82e4c27ae23d admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:21.354593 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7e9ce-a7ee-4333-a6dc-82e4c27ae23d admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:21.354834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d80b55-bbc8-416c-8c07-cd6e9c195df1 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:21.355402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7e9ce-a7ee-4333-a6dc-82e4c27ae23d admin admin] PATH_INFO: `/v3/projects/dbcc3a4c024e41fb8a9faec11f72a5f3/users/675bced5ded745a994acf3792ae3c4f6/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:21.359140 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7e9ce-a7ee-4333-a6dc-82e4c27ae23d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbcc3a4c024e41fb8a9faec11f72a5f3, user_id=675bced5ded745a994acf3792ae3c4f6, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:21.360662 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e16651-963c-4fa3-b5c4-8ec265c37fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:21.361647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e16651-963c-4fa3-b5c4-8ec265c37fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:21.361647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e16651-963c-4fa3-b5c4-8ec265c37fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:21.361946 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e16651-963c-4fa3-b5c4-8ec265c37fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:21.362633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e16651-963c-4fa3-b5c4-8ec265c37fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:21.364208 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e16651-963c-4fa3-b5c4-8ec265c37fa7 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:21.365421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7e9ce-a7ee-4333-a6dc-82e4c27ae23d admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:21.378434 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 929/1853] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:21.379829 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e16651-963c-4fa3-b5c4-8ec265c37fa7 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:21.392870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 925/1854] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:02:21 2022] PUT /identity/v3/projects/dbcc3a4c024e41fb8a9faec11f72a5f3/users/675bced5ded745a994acf3792ae3c4f6/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:21.396241 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe1191-ee3b-4da9-989f-d8a8507c0e2e None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:21.396540 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe1191-ee3b-4da9-989f-d8a8507c0e2e None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:21.397281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe1191-ee3b-4da9-989f-d8a8507c0e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:21.404544 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e16651-963c-4fa3-b5c4-8ec265c37fa7 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:21.443785 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-ebfe1191-ee3b-4da9-989f-d8a8507c0e2e None None] MFA Rules not processed for user `675bced5ded745a994acf3792ae3c4f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:21.445664 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-ebfe1191-ee3b-4da9-989f-d8a8507c0e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:21.493538 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247b90e-489a-4e49-8ce5-b4a5c7552fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:21.494494 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247b90e-489a-4e49-8ce5-b4a5c7552fde admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:21.494753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247b90e-489a-4e49-8ce5-b4a5c7552fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:21.495048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247b90e-489a-4e49-8ce5-b4a5c7552fde admin admin] PATH_INFO: `/v3/projects/5b185dbc9cfb4847838591f61765b3b9/users/1bdf197475b6421ea6da006128c2a402/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:21.511142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247b90e-489a-4e49-8ce5-b4a5c7552fde admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b185dbc9cfb4847838591f61765b3b9, user_id=1bdf197475b6421ea6da006128c2a402, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:21.513792 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247b90e-489a-4e49-8ce5-b4a5c7552fde admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:21.521098 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 926/1855] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:02:21.528996 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 930/1856] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:02:21 2022] PUT /identity/v3/projects/5b185dbc9cfb4847838591f61765b3b9/users/1bdf197475b6421ea6da006128c2a402/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:21.532154 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe1191-ee3b-4da9-989f-d8a8507c0e2e None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:21.533527 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-ebfe1191-ee3b-4da9-989f-d8a8507c0e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:21.539071 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e6ba1-d83e-49db-8fd9-b13cce384e89 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:21.539363 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e6ba1-d83e-49db-8fd9-b13cce384e89 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:21.539723 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e6ba1-d83e-49db-8fd9-b13cce384e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:21.565600 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-924e6ba1-d83e-49db-8fd9-b13cce384e89 None None] MFA Rules not processed for user `1bdf197475b6421ea6da006128c2a402`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:21.566839 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-924e6ba1-d83e-49db-8fd9-b13cce384e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:21.589976 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe1191-ee3b-4da9-989f-d8a8507c0e2e None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:21.630863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 931/1857] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:02:21.635499 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e6ba1-d83e-49db-8fd9-b13cce384e89 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:21.639784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36b03c-f91f-47d6-a145-79d4e935befc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:21.640444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36b03c-f91f-47d6-a145-79d4e935befc service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:21.640729 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36b03c-f91f-47d6-a145-79d4e935befc service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:21.641001 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36b03c-f91f-47d6-a145-79d4e935befc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:21.703548 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36b03c-f91f-47d6-a145-79d4e935befc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:21.704838 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e6ba1-d83e-49db-8fd9-b13cce384e89 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:21.705247 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36b03c-f91f-47d6-a145-79d4e935befc service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:21.712648 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a09a1-4ca6-4c16-a418-4bad699047a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:21.713330 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a09a1-4ca6-4c16-a418-4bad699047a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:21.713619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a09a1-4ca6-4c16-a418-4bad699047a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:21.713900 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a09a1-4ca6-4c16-a418-4bad699047a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:21.714634 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a09a1-4ca6-4c16-a418-4bad699047a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:21.715765 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 927/1858] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:21.716553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a09a1-4ca6-4c16-a418-4bad699047a9 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:21.749225 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 932/1859] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:02:21 2022] POST /identity/v3/projects => generated 363 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:02:21.750389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36b03c-f91f-47d6-a145-79d4e935befc service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:21.761311 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36b03c-f91f-47d6-a145-79d4e935befc service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:21.830183 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c18f19-2b5d-4b6b-bde2-effb6fb6eb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:21.831003 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c18f19-2b5d-4b6b-bde2-effb6fb6eb32 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:21.831362 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c18f19-2b5d-4b6b-bde2-effb6fb6eb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:21.831711 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c18f19-2b5d-4b6b-bde2-effb6fb6eb32 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:21.832537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c18f19-2b5d-4b6b-bde2-effb6fb6eb32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:21.835056 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c18f19-2b5d-4b6b-bde2-effb6fb6eb32 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:21.865724 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 928/1860] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:02:21 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:02:21.867803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a09a1-4ca6-4c16-a418-4bad699047a9 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:21.880626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a09a1-4ca6-4c16-a418-4bad699047a9 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:21.888683 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdac9f2-9898-41be-a844-6a7154d7c3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:21.889599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdac9f2-9898-41be-a844-6a7154d7c3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:21.890068 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdac9f2-9898-41be-a844-6a7154d7c3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:21.890551 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdac9f2-9898-41be-a844-6a7154d7c3a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:21.891406 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdac9f2-9898-41be-a844-6a7154d7c3a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:21.892959 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdac9f2-9898-41be-a844-6a7154d7c3a7 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:21.904519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 933/1861] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:21.908748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c18f19-2b5d-4b6b-bde2-effb6fb6eb32 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:21.919361 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c18f19-2b5d-4b6b-bde2-effb6fb6eb32 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:21.924156 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b7a8b-d8f3-4147-aba6-793cfb8c6751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:21.928585 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b7a8b-d8f3-4147-aba6-793cfb8c6751 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:21.928585 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b7a8b-d8f3-4147-aba6-793cfb8c6751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:21.928585 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b7a8b-d8f3-4147-aba6-793cfb8c6751 admin admin] PATH_INFO: `/v3/projects/0d990e545e02451c874a1d38c966fdf3/users/5d2939f4c527444084c9f2fbb00adcd2/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:21.942509 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b7a8b-d8f3-4147-aba6-793cfb8c6751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d990e545e02451c874a1d38c966fdf3, user_id=5d2939f4c527444084c9f2fbb00adcd2, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:21.946241 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b7a8b-d8f3-4147-aba6-793cfb8c6751 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:21.963664 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 929/1862] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:02:21 2022] PUT /identity/v3/projects/0d990e545e02451c874a1d38c966fdf3/users/5d2939f4c527444084c9f2fbb00adcd2/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:21.967709 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdac9f2-9898-41be-a844-6a7154d7c3a7 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:21.978689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdac9f2-9898-41be-a844-6a7154d7c3a7 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:22.037429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50b5f8-176c-40d9-8a63-4a286e8e8584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:22.038353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50b5f8-176c-40d9-8a63-4a286e8e8584 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:22.038665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50b5f8-176c-40d9-8a63-4a286e8e8584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:22.038947 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50b5f8-176c-40d9-8a63-4a286e8e8584 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:22.039690 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50b5f8-176c-40d9-8a63-4a286e8e8584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:22.041282 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50b5f8-176c-40d9-8a63-4a286e8e8584 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:22.051057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 934/1863] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:22.055160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b7a8b-d8f3-4147-aba6-793cfb8c6751 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:22.065774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b7a8b-d8f3-4147-aba6-793cfb8c6751 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:22.071218 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4c202-08d3-4c1b-af3a-e7773525c2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:22.072178 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4c202-08d3-4c1b-af3a-e7773525c2fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:22.072462 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4c202-08d3-4c1b-af3a-e7773525c2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:22.072732 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4c202-08d3-4c1b-af3a-e7773525c2fc admin admin] PATH_INFO: `/v3/projects/0d990e545e02451c874a1d38c966fdf3/users/5d2939f4c527444084c9f2fbb00adcd2/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:22.075498 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4c202-08d3-4c1b-af3a-e7773525c2fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d990e545e02451c874a1d38c966fdf3, user_id=5d2939f4c527444084c9f2fbb00adcd2, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:22.078225 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4c202-08d3-4c1b-af3a-e7773525c2fc admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:22.089722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 930/1864] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:02:22 2022] PUT /identity/v3/projects/0d990e545e02451c874a1d38c966fdf3/users/5d2939f4c527444084c9f2fbb00adcd2/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:02:22.102490 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab5634-c8ea-4e11-940c-d300e8c7d0fd None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:22.102800 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab5634-c8ea-4e11-940c-d300e8c7d0fd None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:22.103071 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab5634-c8ea-4e11-940c-d300e8c7d0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:22.129735 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-43ab5634-c8ea-4e11-940c-d300e8c7d0fd None None] MFA Rules not processed for user `5d2939f4c527444084c9f2fbb00adcd2`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:22.131046 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-43ab5634-c8ea-4e11-940c-d300e8c7d0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:22.202068 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 935/1865] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:22 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:22.229266 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4c202-08d3-4c1b-af3a-e7773525c2fc admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:22.293171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4c202-08d3-4c1b-af3a-e7773525c2fc admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:22.296975 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95f51c-252d-4304-b11b-b17e4bbdf8ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:22.297634 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95f51c-252d-4304-b11b-b17e4bbdf8ba service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:22.297917 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95f51c-252d-4304-b11b-b17e4bbdf8ba service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:22.298214 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95f51c-252d-4304-b11b-b17e4bbdf8ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:22.307892 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95f51c-252d-4304-b11b-b17e4bbdf8ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:22.309337 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95f51c-252d-4304-b11b-b17e4bbdf8ba service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:22.321814 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 931/1866] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:22 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:22.365756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab5634-c8ea-4e11-940c-d300e8c7d0fd None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:22.441598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab5634-c8ea-4e11-940c-d300e8c7d0fd None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:22.446915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a96dd2-d065-4c76-9068-6d28acefbb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:22.447841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a96dd2-d065-4c76-9068-6d28acefbb4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:22.448056 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a96dd2-d065-4c76-9068-6d28acefbb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:22.448330 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a96dd2-d065-4c76-9068-6d28acefbb4c admin admin] PATH_INFO: `/v3/users/97054dcf6f804f5cb745ebdef98bea6d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:22.449549 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a96dd2-d065-4c76-9068-6d28acefbb4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=97054dcf6f804f5cb745ebdef98bea6d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:22.451545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a96dd2-d065-4c76-9068-6d28acefbb4c admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:22.500625 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-19a96dd2-d065-4c76-9068-6d28acefbb4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97054dcf6f804f5cb745ebdef98bea6d'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:22.501340 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-19a96dd2-d065-4c76-9068-6d28acefbb4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97054dcf6f804f5cb745ebdef98bea6d'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:22.521502 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-19a96dd2-d065-4c76-9068-6d28acefbb4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97054dcf6f804f5cb745ebdef98bea6d'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:22.532534 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-19a96dd2-d065-4c76-9068-6d28acefbb4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97054dcf6f804f5cb745ebdef98bea6d'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:22.546476 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-19a96dd2-d065-4c76-9068-6d28acefbb4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97054dcf6f804f5cb745ebdef98bea6d'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:22.554416 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 936/1867] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:02:22 2022] DELETE /identity/v3/users/97054dcf6f804f5cb745ebdef98bea6d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:22.559036 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e0918-a3b7-4fea-9c26-86c34cf80604 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:22.560029 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e0918-a3b7-4fea-9c26-86c34cf80604 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:22.560565 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e0918-a3b7-4fea-9c26-86c34cf80604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:22.580540 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-c57e0918-a3b7-4fea-9c26-86c34cf80604 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:22.582086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-c57e0918-a3b7-4fea-9c26-86c34cf80604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:22.668653 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 932/1868] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:22.686859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a96dd2-d065-4c76-9068-6d28acefbb4c admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:22.690881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-19a96dd2-d065-4c76-9068-6d28acefbb4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:22.768165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a96dd2-d065-4c76-9068-6d28acefbb4c admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:22.777712 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29895f5-b990-416c-b438-ba310695d1af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:22.778468 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29895f5-b990-416c-b438-ba310695d1af service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:22.778739 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29895f5-b990-416c-b438-ba310695d1af service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:22.779013 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29895f5-b990-416c-b438-ba310695d1af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:22.790276 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29895f5-b990-416c-b438-ba310695d1af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:22.791753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29895f5-b990-416c-b438-ba310695d1af service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:22.803778 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 937/1869] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:22.848143 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e0918-a3b7-4fea-9c26-86c34cf80604 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:22.849931 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-c57e0918-a3b7-4fea-9c26-86c34cf80604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:22.863261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e0918-a3b7-4fea-9c26-86c34cf80604 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:22.869105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258aa0c-43f9-4046-bcce-b9974151991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:22.869985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258aa0c-43f9-4046-bcce-b9974151991c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:22.870956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258aa0c-43f9-4046-bcce-b9974151991c admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:22.871243 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258aa0c-43f9-4046-bcce-b9974151991c admin admin] PATH_INFO: `/v3/users/1bdf197475b6421ea6da006128c2a402` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:22.872604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258aa0c-43f9-4046-bcce-b9974151991c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bdf197475b6421ea6da006128c2a402)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:22.874579 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258aa0c-43f9-4046-bcce-b9974151991c admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:22.974556 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b258aa0c-43f9-4046-bcce-b9974151991c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bdf197475b6421ea6da006128c2a402'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:22.993331 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b258aa0c-43f9-4046-bcce-b9974151991c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bdf197475b6421ea6da006128c2a402'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:23.008638 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b258aa0c-43f9-4046-bcce-b9974151991c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bdf197475b6421ea6da006128c2a402'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:23.009450 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b258aa0c-43f9-4046-bcce-b9974151991c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bdf197475b6421ea6da006128c2a402'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:23.010867 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b258aa0c-43f9-4046-bcce-b9974151991c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bdf197475b6421ea6da006128c2a402'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:23.029395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 933/1870] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:02:22 2022] DELETE /identity/v3/users/1bdf197475b6421ea6da006128c2a402 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:23.034166 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb346c-9071-4985-b9a4-20acd91f071f None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:23.034703 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb346c-9071-4985-b9a4-20acd91f071f None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:23.035203 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb346c-9071-4985-b9a4-20acd91f071f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:23.058440 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-9ddb346c-9071-4985-b9a4-20acd91f071f None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:23.060669 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-9ddb346c-9071-4985-b9a4-20acd91f071f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:23.268747 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 938/1871] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:23.278582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258aa0c-43f9-4046-bcce-b9974151991c admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:23.279966 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b258aa0c-43f9-4046-bcce-b9974151991c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:23.344537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258aa0c-43f9-4046-bcce-b9974151991c admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:23.348773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e65a10-2e36-43f3-967e-c946508082c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:23.349726 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e65a10-2e36-43f3-967e-c946508082c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:23.350298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e65a10-2e36-43f3-967e-c946508082c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:23.350674 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e65a10-2e36-43f3-967e-c946508082c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:23.360852 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e65a10-2e36-43f3-967e-c946508082c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:23.362718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e65a10-2e36-43f3-967e-c946508082c5 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:23.373078 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 934/1872] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:23.557515 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb346c-9071-4985-b9a4-20acd91f071f None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:23.558852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-9ddb346c-9071-4985-b9a4-20acd91f071f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:23.585596 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb346c-9071-4985-b9a4-20acd91f071f None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:23.591967 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11e6dd-b261-4299-8aa2-ee066a39faab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:23.593763 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11e6dd-b261-4299-8aa2-ee066a39faab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:23.593926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11e6dd-b261-4299-8aa2-ee066a39faab admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:23.595261 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11e6dd-b261-4299-8aa2-ee066a39faab admin admin] PATH_INFO: `/v3/projects/5744bd217e014d878c13abe56cd0f7ae` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:23.596518 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11e6dd-b261-4299-8aa2-ee066a39faab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5744bd217e014d878c13abe56cd0f7ae)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:23.598439 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11e6dd-b261-4299-8aa2-ee066a39faab admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:23.665703 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1a11e6dd-b261-4299-8aa2-ee066a39faab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5744bd217e014d878c13abe56cd0f7ae', 'request_id': 'req-1a11e6dd-b261-4299-8aa2-ee066a39faab'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:23.672975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1a11e6dd-b261-4299-8aa2-ee066a39faab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5744bd217e014d878c13abe56cd0f7ae', 'request_id': 'req-1a11e6dd-b261-4299-8aa2-ee066a39faab'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:23.683542 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1a11e6dd-b261-4299-8aa2-ee066a39faab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5744bd217e014d878c13abe56cd0f7ae', 'request_id': 'req-1a11e6dd-b261-4299-8aa2-ee066a39faab'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:23.710947 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1a11e6dd-b261-4299-8aa2-ee066a39faab admin admin] The token cache is being invalidate because project 5744bd217e014d878c13abe56cd0f7ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:02:23.711827 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1a11e6dd-b261-4299-8aa2-ee066a39faab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:23.711962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1a11e6dd-b261-4299-8aa2-ee066a39faab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:23.713825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 939/1873] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:02:23 2022] DELETE /identity/v3/projects/5744bd217e014d878c13abe56cd0f7ae => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:23.717758 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e65a10-2e36-43f3-967e-c946508082c5 service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:23.730119 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e65a10-2e36-43f3-967e-c946508082c5 service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:23.799463 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94589422-21f2-4772-b820-3ed1ab33aa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:23.800271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94589422-21f2-4772-b820-3ed1ab33aa44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:23.800556 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94589422-21f2-4772-b820-3ed1ab33aa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:23.800836 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94589422-21f2-4772-b820-3ed1ab33aa44 admin admin] PATH_INFO: `/v3/users/675bced5ded745a994acf3792ae3c4f6` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:23.802639 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94589422-21f2-4772-b820-3ed1ab33aa44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=675bced5ded745a994acf3792ae3c4f6)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:23.805307 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94589422-21f2-4772-b820-3ed1ab33aa44 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:23.884387 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-94589422-21f2-4772-b820-3ed1ab33aa44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '675bced5ded745a994acf3792ae3c4f6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:23.893170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-94589422-21f2-4772-b820-3ed1ab33aa44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '675bced5ded745a994acf3792ae3c4f6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:23.905898 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11e6dd-b261-4299-8aa2-ee066a39faab admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:23.907363 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-1a11e6dd-b261-4299-8aa2-ee066a39faab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:23.908590 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-94589422-21f2-4772-b820-3ed1ab33aa44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '675bced5ded745a994acf3792ae3c4f6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:23.909723 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-94589422-21f2-4772-b820-3ed1ab33aa44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '675bced5ded745a994acf3792ae3c4f6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:23.910984 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-94589422-21f2-4772-b820-3ed1ab33aa44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '675bced5ded745a994acf3792ae3c4f6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:23.921752 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11e6dd-b261-4299-8aa2-ee066a39faab admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:23.926701 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c9d67-34ae-4542-8748-b8bbb48b86be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:23.928336 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c9d67-34ae-4542-8748-b8bbb48b86be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:23.928695 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c9d67-34ae-4542-8748-b8bbb48b86be admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:23.929036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c9d67-34ae-4542-8748-b8bbb48b86be admin admin] PATH_INFO: `/v3/projects/5b185dbc9cfb4847838591f61765b3b9` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:23.930859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c9d67-34ae-4542-8748-b8bbb48b86be admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b185dbc9cfb4847838591f61765b3b9)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:23.930936 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 935/1874] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:02:23 2022] DELETE /identity/v3/users/675bced5ded745a994acf3792ae3c4f6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:02:23.932497 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c9d67-34ae-4542-8748-b8bbb48b86be admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:23.991802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-c23c9d67-34ae-4542-8748-b8bbb48b86be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b185dbc9cfb4847838591f61765b3b9', 'request_id': 'req-c23c9d67-34ae-4542-8748-b8bbb48b86be'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:23.998687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-c23c9d67-34ae-4542-8748-b8bbb48b86be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b185dbc9cfb4847838591f61765b3b9', 'request_id': 'req-c23c9d67-34ae-4542-8748-b8bbb48b86be'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.010080 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-c23c9d67-34ae-4542-8748-b8bbb48b86be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b185dbc9cfb4847838591f61765b3b9', 'request_id': 'req-c23c9d67-34ae-4542-8748-b8bbb48b86be'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.025398 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-c23c9d67-34ae-4542-8748-b8bbb48b86be admin admin] The token cache is being invalidate because project 5b185dbc9cfb4847838591f61765b3b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:02:24.025720 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-c23c9d67-34ae-4542-8748-b8bbb48b86be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.026733 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-c23c9d67-34ae-4542-8748-b8bbb48b86be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.029343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 940/1875] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:02:23 2022] DELETE /identity/v3/projects/5b185dbc9cfb4847838591f61765b3b9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:02:24.033297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94589422-21f2-4772-b820-3ed1ab33aa44 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:24.034848 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-94589422-21f2-4772-b820-3ed1ab33aa44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:24.088289 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c9d67-34ae-4542-8748-b8bbb48b86be admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:24.089741 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c23c9d67-34ae-4542-8748-b8bbb48b86be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:24.114671 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94589422-21f2-4772-b820-3ed1ab33aa44 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:24.168151 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c9d67-34ae-4542-8748-b8bbb48b86be admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:24.173613 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a735c-793f-4e3f-953b-92e91b30e8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:24.174606 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a735c-793f-4e3f-953b-92e91b30e8e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:24.174956 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a735c-793f-4e3f-953b-92e91b30e8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:24.175298 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a735c-793f-4e3f-953b-92e91b30e8e9 admin admin] PATH_INFO: `/v3/users/d84367b1295b4b49a07b7fee3dea87d4` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:24.176992 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a735c-793f-4e3f-953b-92e91b30e8e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d84367b1295b4b49a07b7fee3dea87d4)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:24.179149 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a735c-793f-4e3f-953b-92e91b30e8e9 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:24.190143 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd029b4-0615-40b0-a540-86cd285ed971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:24.194222 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd029b4-0615-40b0-a540-86cd285ed971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:24.194629 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd029b4-0615-40b0-a540-86cd285ed971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:24.195032 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd029b4-0615-40b0-a540-86cd285ed971 admin admin] PATH_INFO: `/v3/users/5d2939f4c527444084c9f2fbb00adcd2` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:24.197119 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd029b4-0615-40b0-a540-86cd285ed971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d2939f4c527444084c9f2fbb00adcd2)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:24.200121 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd029b4-0615-40b0-a540-86cd285ed971 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:24.246609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-c40a735c-793f-4e3f-953b-92e91b30e8e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd84367b1295b4b49a07b7fee3dea87d4'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.247358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-c40a735c-793f-4e3f-953b-92e91b30e8e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd84367b1295b4b49a07b7fee3dea87d4'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.260857 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-c40a735c-793f-4e3f-953b-92e91b30e8e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd84367b1295b4b49a07b7fee3dea87d4'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.261521 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2cd029b4-0615-40b0-a540-86cd285ed971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d2939f4c527444084c9f2fbb00adcd2'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.269753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-c40a735c-793f-4e3f-953b-92e91b30e8e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd84367b1295b4b49a07b7fee3dea87d4'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.273270 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2cd029b4-0615-40b0-a540-86cd285ed971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d2939f4c527444084c9f2fbb00adcd2'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.277922 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-c40a735c-793f-4e3f-953b-92e91b30e8e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd84367b1295b4b49a07b7fee3dea87d4'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.283813 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 941/1876] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:02:24 2022] DELETE /identity/v3/users/d84367b1295b4b49a07b7fee3dea87d4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:24.284603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a735c-793f-4e3f-953b-92e91b30e8e9 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:24.285930 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c40a735c-793f-4e3f-953b-92e91b30e8e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:24.288794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2cd029b4-0615-40b0-a540-86cd285ed971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d2939f4c527444084c9f2fbb00adcd2'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.289565 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2cd029b4-0615-40b0-a540-86cd285ed971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d2939f4c527444084c9f2fbb00adcd2'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.290411 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2cd029b4-0615-40b0-a540-86cd285ed971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d2939f4c527444084c9f2fbb00adcd2'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.302706 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 936/1877] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:02:24 2022] DELETE /identity/v3/users/5d2939f4c527444084c9f2fbb00adcd2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:24.304530 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137e4cd-9ade-4a3a-b80a-eaf4f21fbde8 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:24.304819 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137e4cd-9ade-4a3a-b80a-eaf4f21fbde8 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:24.305148 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137e4cd-9ade-4a3a-b80a-eaf4f21fbde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:24.330429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-c137e4cd-9ade-4a3a-b80a-eaf4f21fbde8 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:24.331947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-c137e4cd-9ade-4a3a-b80a-eaf4f21fbde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:24.369201 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a735c-793f-4e3f-953b-92e91b30e8e9 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:24.401624 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 937/1878] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:24.419432 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137e4cd-9ade-4a3a-b80a-eaf4f21fbde8 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:24.421343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-c137e4cd-9ade-4a3a-b80a-eaf4f21fbde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:24.457833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e48852-3117-4500-9941-8c7f0f16daf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:24.463589 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e48852-3117-4500-9941-8c7f0f16daf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:24.466634 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e48852-3117-4500-9941-8c7f0f16daf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:24.466936 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e48852-3117-4500-9941-8c7f0f16daf1 admin admin] PATH_INFO: `/v3/projects/dbcc3a4c024e41fb8a9faec11f72a5f3` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:24.469279 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e48852-3117-4500-9941-8c7f0f16daf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbcc3a4c024e41fb8a9faec11f72a5f3)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:24.471589 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e48852-3117-4500-9941-8c7f0f16daf1 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:24.503155 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137e4cd-9ade-4a3a-b80a-eaf4f21fbde8 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:24.507828 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79eb16-1308-4f45-b488-87b485b82ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:24.508499 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79eb16-1308-4f45-b488-87b485b82ecb service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:24.508782 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79eb16-1308-4f45-b488-87b485b82ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:24.509059 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79eb16-1308-4f45-b488-87b485b82ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:24.519698 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79eb16-1308-4f45-b488-87b485b82ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:24.522149 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79eb16-1308-4f45-b488-87b485b82ecb service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:24.529483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-75e48852-3117-4500-9941-8c7f0f16daf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbcc3a4c024e41fb8a9faec11f72a5f3', 'request_id': 'req-75e48852-3117-4500-9941-8c7f0f16daf1'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.535202 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-75e48852-3117-4500-9941-8c7f0f16daf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbcc3a4c024e41fb8a9faec11f72a5f3', 'request_id': 'req-75e48852-3117-4500-9941-8c7f0f16daf1'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.538515 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 938/1879] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:24.548787 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-75e48852-3117-4500-9941-8c7f0f16daf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbcc3a4c024e41fb8a9faec11f72a5f3', 'request_id': 'req-75e48852-3117-4500-9941-8c7f0f16daf1'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.565613 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-75e48852-3117-4500-9941-8c7f0f16daf1 admin admin] The token cache is being invalidate because project dbcc3a4c024e41fb8a9faec11f72a5f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:02:24.565613 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-75e48852-3117-4500-9941-8c7f0f16daf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.566345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-75e48852-3117-4500-9941-8c7f0f16daf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.568567 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 942/1880] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:02:24 2022] DELETE /identity/v3/projects/dbcc3a4c024e41fb8a9faec11f72a5f3 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:24.573360 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dc96c-67f7-4b28-8249-81366d9c7830 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:24.573624 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dc96c-67f7-4b28-8249-81366d9c7830 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:24.574141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dc96c-67f7-4b28-8249-81366d9c7830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:24.610463 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-a86dc96c-67f7-4b28-8249-81366d9c7830 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:24.614977 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a86dc96c-67f7-4b28-8249-81366d9c7830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:24.732299 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e48852-3117-4500-9941-8c7f0f16daf1 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:24.734878 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-75e48852-3117-4500-9941-8c7f0f16daf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:24.753594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 939/1881] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:24.756186 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda73aad-dd94-4961-9e9e-839ecd200b39 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:24.757175 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda73aad-dd94-4961-9e9e-839ecd200b39 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:24.757463 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda73aad-dd94-4961-9e9e-839ecd200b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:24.771782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e48852-3117-4500-9941-8c7f0f16daf1 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:24.793229 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-eda73aad-dd94-4961-9e9e-839ecd200b39 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:24.794488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-eda73aad-dd94-4961-9e9e-839ecd200b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:24.796376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c742b72-3a1d-4269-92b5-881cebf2dda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:24.810689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c742b72-3a1d-4269-92b5-881cebf2dda6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:24.811079 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c742b72-3a1d-4269-92b5-881cebf2dda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:24.811179 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 940/1882] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:24.813147 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c742b72-3a1d-4269-92b5-881cebf2dda6 admin admin] PATH_INFO: `/v3/projects/0d990e545e02451c874a1d38c966fdf3` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:24.816942 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda73aad-dd94-4961-9e9e-839ecd200b39 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:24.818785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c742b72-3a1d-4269-92b5-881cebf2dda6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d990e545e02451c874a1d38c966fdf3)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:24.823160 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c742b72-3a1d-4269-92b5-881cebf2dda6 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:24.830607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda73aad-dd94-4961-9e9e-839ecd200b39 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:24.839514 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d427c1-80f6-40f4-b107-4132aad88782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:24.840425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d427c1-80f6-40f4-b107-4132aad88782 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:24.840820 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d427c1-80f6-40f4-b107-4132aad88782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:24.841374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d427c1-80f6-40f4-b107-4132aad88782 admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:24.843496 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d427c1-80f6-40f4-b107-4132aad88782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:02:24.843965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d427c1-80f6-40f4-b107-4132aad88782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:24.846036 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d427c1-80f6-40f4-b107-4132aad88782 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:24.868238 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 941/1883] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:02:24.872389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d427c1-80f6-40f4-b107-4132aad88782 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:24.884092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d427c1-80f6-40f4-b107-4132aad88782 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:24.894020 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb26d8-73ea-495f-888c-b57e700e42ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:24.894774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb26d8-73ea-495f-888c-b57e700e42ca admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:24.895116 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb26d8-73ea-495f-888c-b57e700e42ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:24.895320 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb26d8-73ea-495f-888c-b57e700e42ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:24.896100 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb26d8-73ea-495f-888c-b57e700e42ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:24.898038 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb26d8-73ea-495f-888c-b57e700e42ca admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:24.915702 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-3c742b72-3a1d-4269-92b5-881cebf2dda6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d990e545e02451c874a1d38c966fdf3', 'request_id': 'req-3c742b72-3a1d-4269-92b5-881cebf2dda6'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.924428 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-3c742b72-3a1d-4269-92b5-881cebf2dda6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d990e545e02451c874a1d38c966fdf3', 'request_id': 'req-3c742b72-3a1d-4269-92b5-881cebf2dda6'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.934801 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 942/1884] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:02:24 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:02:24.937445 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-3c742b72-3a1d-4269-92b5-881cebf2dda6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d990e545e02451c874a1d38c966fdf3', 'request_id': 'req-3c742b72-3a1d-4269-92b5-881cebf2dda6'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.938734 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb26d8-73ea-495f-888c-b57e700e42ca admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:24.953951 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-3c742b72-3a1d-4269-92b5-881cebf2dda6 admin admin] The token cache is being invalidate because project 0d990e545e02451c874a1d38c966fdf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:02:24.954405 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-3c742b72-3a1d-4269-92b5-881cebf2dda6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.955159 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-3c742b72-3a1d-4269-92b5-881cebf2dda6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:24.957498 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 943/1885] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:02:24 2022] DELETE /identity/v3/projects/0d990e545e02451c874a1d38c966fdf3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:02:24.962470 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afbcc2-6d57-49cb-b418-e5b32e87bb60 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:24.962811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afbcc2-6d57-49cb-b418-e5b32e87bb60 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:24.963321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afbcc2-6d57-49cb-b418-e5b32e87bb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:24.984604 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-02afbcc2-6d57-49cb-b418-e5b32e87bb60 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:24.986048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-02afbcc2-6d57-49cb-b418-e5b32e87bb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:25.088684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb26d8-73ea-495f-888c-b57e700e42ca admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:25.098247 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 944/1886] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:25.103849 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad44ef8-8264-49fb-816e-98f0754e67a1 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:25.105752 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad44ef8-8264-49fb-816e-98f0754e67a1 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:25.106246 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad44ef8-8264-49fb-816e-98f0754e67a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:25.108267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5b1b2-fe25-4815-a2f1-80af8482aa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:25.110479 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5b1b2-fe25-4815-a2f1-80af8482aa64 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:25.111170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5b1b2-fe25-4815-a2f1-80af8482aa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:25.111475 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5b1b2-fe25-4815-a2f1-80af8482aa64 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:25.112476 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5b1b2-fe25-4815-a2f1-80af8482aa64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:25.115098 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5b1b2-fe25-4815-a2f1-80af8482aa64 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:25.136683 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-aad44ef8-8264-49fb-816e-98f0754e67a1 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:25.138820 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-aad44ef8-8264-49fb-816e-98f0754e67a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:25.150298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 943/1887] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:02:24 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:02:25.151952 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5b1b2-fe25-4815-a2f1-80af8482aa64 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:25.154190 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-17d5b1b2-fe25-4815-a2f1-80af8482aa64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:25.156128 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 945/1888] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:02:25.165017 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad44ef8-8264-49fb-816e-98f0754e67a1 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:25.182370 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad44ef8-8264-49fb-816e-98f0754e67a1 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:25.184471 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5b1b2-fe25-4815-a2f1-80af8482aa64 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:25.187978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec07fb-cba7-4a41-b41b-221cc6b37d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:25.189136 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec07fb-cba7-4a41-b41b-221cc6b37d9a admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:25.190161 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec07fb-cba7-4a41-b41b-221cc6b37d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:25.190593 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec07fb-cba7-4a41-b41b-221cc6b37d9a admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:25.191329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec07fb-cba7-4a41-b41b-221cc6b37d9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:02:25.191648 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec07fb-cba7-4a41-b41b-221cc6b37d9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:25.195137 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307644cb-ede5-4636-b298-979175a3636a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:25.196251 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307644cb-ede5-4636-b298-979175a3636a admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:25.196823 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307644cb-ede5-4636-b298-979175a3636a admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:25.197225 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307644cb-ede5-4636-b298-979175a3636a admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:25.198526 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307644cb-ede5-4636-b298-979175a3636a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:25.201124 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec07fb-cba7-4a41-b41b-221cc6b37d9a admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:25.201264 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307644cb-ede5-4636-b298-979175a3636a admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:25.220839 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 944/1889] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:02:25.222272 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307644cb-ede5-4636-b298-979175a3636a admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:25.225731 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-307644cb-ede5-4636-b298-979175a3636a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:25.231967 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 946/1890] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:02:25.233372 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec07fb-cba7-4a41-b41b-221cc6b37d9a admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:25.243181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307644cb-ede5-4636-b298-979175a3636a admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:25.245767 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec07fb-cba7-4a41-b41b-221cc6b37d9a admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:25.247979 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1109edc-8aea-4e74-9318-d8f5d82b5e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:25.249087 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1109edc-8aea-4e74-9318-d8f5d82b5e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:25.249520 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1109edc-8aea-4e74-9318-d8f5d82b5e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:25.249803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1109edc-8aea-4e74-9318-d8f5d82b5e80 admin admin] PATH_INFO: `/v3/projects/ad6bf0fcfc024ed881fa29df9540c6a1` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:25.250418 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039dc9fb-af51-4e2f-a4e0-2819560aef96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:25.251023 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1109edc-8aea-4e74-9318-d8f5d82b5e80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad6bf0fcfc024ed881fa29df9540c6a1)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:25.251122 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dc9fb-af51-4e2f-a4e0-2819560aef96 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:25.251348 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dc9fb-af51-4e2f-a4e0-2819560aef96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:25.251624 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dc9fb-af51-4e2f-a4e0-2819560aef96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:25.252344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039dc9fb-af51-4e2f-a4e0-2819560aef96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:25.252948 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1109edc-8aea-4e74-9318-d8f5d82b5e80 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:25.253934 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039dc9fb-af51-4e2f-a4e0-2819560aef96 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:25.265210 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 947/1891] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:25.266000 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039dc9fb-af51-4e2f-a4e0-2819560aef96 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:25.276995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039dc9fb-af51-4e2f-a4e0-2819560aef96 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:25.282536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859becf0-81a7-487c-82ef-d275921680d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:25.283218 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859becf0-81a7-487c-82ef-d275921680d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:25.283580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859becf0-81a7-487c-82ef-d275921680d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:25.283924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859becf0-81a7-487c-82ef-d275921680d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:25.284554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859becf0-81a7-487c-82ef-d275921680d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:25.286585 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859becf0-81a7-487c-82ef-d275921680d5 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:25.305781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-a1109edc-8aea-4e74-9318-d8f5d82b5e80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad6bf0fcfc024ed881fa29df9540c6a1', 'request_id': 'req-a1109edc-8aea-4e74-9318-d8f5d82b5e80'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:25.312178 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-a1109edc-8aea-4e74-9318-d8f5d82b5e80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad6bf0fcfc024ed881fa29df9540c6a1', 'request_id': 'req-a1109edc-8aea-4e74-9318-d8f5d82b5e80'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:25.316217 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 948/1892] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:02:25 2022] POST /identity/v3/projects => generated 357 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:25.317040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859becf0-81a7-487c-82ef-d275921680d5 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:25.324539 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-a1109edc-8aea-4e74-9318-d8f5d82b5e80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad6bf0fcfc024ed881fa29df9540c6a1', 'request_id': 'req-a1109edc-8aea-4e74-9318-d8f5d82b5e80'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:25.342286 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-a1109edc-8aea-4e74-9318-d8f5d82b5e80 admin admin] The token cache is being invalidate because project ad6bf0fcfc024ed881fa29df9540c6a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:02:25.342588 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-a1109edc-8aea-4e74-9318-d8f5d82b5e80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:25.343265 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-a1109edc-8aea-4e74-9318-d8f5d82b5e80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:25.348313 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 945/1893] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:02:25 2022] DELETE /identity/v3/projects/ad6bf0fcfc024ed881fa29df9540c6a1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:25.348313 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1109edc-8aea-4e74-9318-d8f5d82b5e80 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:25.348313 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a1109edc-8aea-4e74-9318-d8f5d82b5e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:25.386736 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859becf0-81a7-487c-82ef-d275921680d5 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:25.391692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8db68-1970-4c87-a435-c2f36623fae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:25.392603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8db68-1970-4c87-a435-c2f36623fae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:25.392886 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8db68-1970-4c87-a435-c2f36623fae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:25.393160 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8db68-1970-4c87-a435-c2f36623fae0 admin admin] PATH_INFO: `/v3/projects/9e3a63aa2c624d65afa1117255819584/users/42469b497102460ca1227f3f243e7fbf/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:25.417429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8db68-1970-4c87-a435-c2f36623fae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3a63aa2c624d65afa1117255819584, user_id=42469b497102460ca1227f3f243e7fbf, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:25.418820 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1109edc-8aea-4e74-9318-d8f5d82b5e80 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:25.423242 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8db68-1970-4c87-a435-c2f36623fae0 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:25.425772 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e010e-3ec8-412b-92fc-1844f1ae1b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:25.426473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e010e-3ec8-412b-92fc-1844f1ae1b77 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:25.426805 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e010e-3ec8-412b-92fc-1844f1ae1b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:25.427118 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e010e-3ec8-412b-92fc-1844f1ae1b77 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:25.428242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e010e-3ec8-412b-92fc-1844f1ae1b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:25.430553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e010e-3ec8-412b-92fc-1844f1ae1b77 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:25.440404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 949/1894] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:02:25 2022] PUT /identity/v3/projects/9e3a63aa2c624d65afa1117255819584/users/42469b497102460ca1227f3f243e7fbf/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:25.441408 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8db68-1970-4c87-a435-c2f36623fae0 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:25.444330 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-b8b8db68-1970-4c87-a435-c2f36623fae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:25.456945 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 946/1895] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:02:25 2022] POST /identity/v3/users => generated 279 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:25.460453 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76121dc-e192-4d8f-a628-7b0804ed89e9 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:25.460925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76121dc-e192-4d8f-a628-7b0804ed89e9 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:25.461203 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76121dc-e192-4d8f-a628-7b0804ed89e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:25.487870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-e76121dc-e192-4d8f-a628-7b0804ed89e9 None None] MFA Rules not processed for user `42469b497102460ca1227f3f243e7fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:25.489132 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-e76121dc-e192-4d8f-a628-7b0804ed89e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:25.511555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8db68-1970-4c87-a435-c2f36623fae0 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:25.516911 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43823987-e10a-40e6-9a17-1599f071429f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:25.517829 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43823987-e10a-40e6-9a17-1599f071429f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:25.518134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43823987-e10a-40e6-9a17-1599f071429f admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:25.518424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43823987-e10a-40e6-9a17-1599f071429f admin admin] PATH_INFO: `/v3/users/454c461bfdd54c4aa63fa2a934bd2474` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:25.519636 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43823987-e10a-40e6-9a17-1599f071429f admin admin] RBAC: Authorizing `identity:delete_user(user_id=454c461bfdd54c4aa63fa2a934bd2474)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:25.523256 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43823987-e10a-40e6-9a17-1599f071429f admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:25.563196 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 947/1896] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:25.563958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76121dc-e192-4d8f-a628-7b0804ed89e9 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:25.578332 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76121dc-e192-4d8f-a628-7b0804ed89e9 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:25.583482 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-43823987-e10a-40e6-9a17-1599f071429f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454c461bfdd54c4aa63fa2a934bd2474'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:25.584710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f99f99-b0ad-4316-9b57-6e126cc4c6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:25.584851 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-43823987-e10a-40e6-9a17-1599f071429f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454c461bfdd54c4aa63fa2a934bd2474'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:25.585266 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f99f99-b0ad-4316-9b57-6e126cc4c6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:25.585610 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f99f99-b0ad-4316-9b57-6e126cc4c6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:25.585821 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f99f99-b0ad-4316-9b57-6e126cc4c6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:25.586604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f99f99-b0ad-4316-9b57-6e126cc4c6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:25.588641 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f99f99-b0ad-4316-9b57-6e126cc4c6a8 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:25.598515 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-43823987-e10a-40e6-9a17-1599f071429f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454c461bfdd54c4aa63fa2a934bd2474'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:25.602938 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 948/1897] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:25.602938 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b74b7-d582-43c2-891f-9fe4233b0b36 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:25.602938 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b74b7-d582-43c2-891f-9fe4233b0b36 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:25.602938 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b74b7-d582-43c2-891f-9fe4233b0b36 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:25.604383 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 949/1898] 10.222.0.32 () {54 vars in 921 bytes} [Tue May 10 14:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:02:25.605316 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b74b7-d582-43c2-891f-9fe4233b0b36 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:25.607247 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-067b74b7-d582-43c2-891f-9fe4233b0b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:25.612213 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-43823987-e10a-40e6-9a17-1599f071429f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454c461bfdd54c4aa63fa2a934bd2474'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:25.621576 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-43823987-e10a-40e6-9a17-1599f071429f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454c461bfdd54c4aa63fa2a934bd2474'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:25.627659 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 950/1899] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:02:25 2022] DELETE /identity/v3/users/454c461bfdd54c4aa63fa2a934bd2474 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:25.628467 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43823987-e10a-40e6-9a17-1599f071429f admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:25.632000 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-43823987-e10a-40e6-9a17-1599f071429f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:25.685305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b74b7-d582-43c2-891f-9fe4233b0b36 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:25.728080 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43823987-e10a-40e6-9a17-1599f071429f admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:25.735422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfade26f-7f9f-4780-8a06-e2a6e6ae251f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:25.737677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfade26f-7f9f-4780-8a06-e2a6e6ae251f admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:25.738123 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfade26f-7f9f-4780-8a06-e2a6e6ae251f admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:25.741303 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfade26f-7f9f-4780-8a06-e2a6e6ae251f admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:25.742542 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfade26f-7f9f-4780-8a06-e2a6e6ae251f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:25.745436 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfade26f-7f9f-4780-8a06-e2a6e6ae251f admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:25.749873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65dbf4-9a56-437e-a948-42a15dfcefde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:25.751391 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65dbf4-9a56-437e-a948-42a15dfcefde service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:25.752302 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65dbf4-9a56-437e-a948-42a15dfcefde service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:25.752302 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65dbf4-9a56-437e-a948-42a15dfcefde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:25.754622 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-6f65dbf4-9a56-437e-a948-42a15dfcefde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:25.759004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 951/1900] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:25.760679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37f77e-7879-4da9-a6c3-baacf9456e0e None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:25.761176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37f77e-7879-4da9-a6c3-baacf9456e0e None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:25.761747 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37f77e-7879-4da9-a6c3-baacf9456e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:25.782562 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-8d37f77e-7879-4da9-a6c3-baacf9456e0e None None] MFA Rules not processed for user `e5d4fd26c21f4170a6790369344f8334`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:25.784085 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-8d37f77e-7879-4da9-a6c3-baacf9456e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:25.822879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65dbf4-9a56-437e-a948-42a15dfcefde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:25.825032 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65dbf4-9a56-437e-a948-42a15dfcefde service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:25.840511 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 950/1901] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:25.846914 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65dbf4-9a56-437e-a948-42a15dfcefde service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:25.859340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65dbf4-9a56-437e-a948-42a15dfcefde service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:25.876884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d9af4-b6a1-4000-a1bb-f693f8490e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:25.877802 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d9af4-b6a1-4000-a1bb-f693f8490e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:25.878079 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d9af4-b6a1-4000-a1bb-f693f8490e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:25.878375 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d9af4-b6a1-4000-a1bb-f693f8490e68 admin admin] PATH_INFO: `/v3/projects/d51c734a200d41d4aaa833b515aed47a/users/a2b3cb74e3b64d87903eb933adb4c01f/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:25.913586 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 952/1902] 10.222.0.32 () {58 vars in 1018 bytes} [Tue May 10 14:02:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:25.914325 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37f77e-7879-4da9-a6c3-baacf9456e0e None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:25.915755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-8d37f77e-7879-4da9-a6c3-baacf9456e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:25.939708 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37f77e-7879-4da9-a6c3-baacf9456e0e None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:25.945472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441fffb-a2e0-495a-8243-589abb7e0575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:25.947048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441fffb-a2e0-495a-8243-589abb7e0575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:25.947443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441fffb-a2e0-495a-8243-589abb7e0575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:25.947799 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441fffb-a2e0-495a-8243-589abb7e0575 admin admin] PATH_INFO: `/v3/users/42469b497102460ca1227f3f243e7fbf` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:25.949189 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441fffb-a2e0-495a-8243-589abb7e0575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42469b497102460ca1227f3f243e7fbf)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:25.951755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441fffb-a2e0-495a-8243-589abb7e0575 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:26.040301 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1441fffb-a2e0-495a-8243-589abb7e0575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42469b497102460ca1227f3f243e7fbf'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:26.040995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1441fffb-a2e0-495a-8243-589abb7e0575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42469b497102460ca1227f3f243e7fbf'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:26.069673 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1441fffb-a2e0-495a-8243-589abb7e0575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42469b497102460ca1227f3f243e7fbf'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:26.071030 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d9af4-b6a1-4000-a1bb-f693f8490e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51c734a200d41d4aaa833b515aed47a, user_id=a2b3cb74e3b64d87903eb933adb4c01f, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:26.073927 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d9af4-b6a1-4000-a1bb-f693f8490e68 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:26.082487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1441fffb-a2e0-495a-8243-589abb7e0575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42469b497102460ca1227f3f243e7fbf'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:26.090965 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1441fffb-a2e0-495a-8243-589abb7e0575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42469b497102460ca1227f3f243e7fbf'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:26.095050 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 951/1903] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:02:25 2022] PUT /identity/v3/projects/d51c734a200d41d4aaa833b515aed47a/users/a2b3cb74e3b64d87903eb933adb4c01f/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:26.096937 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d9af4-b6a1-4000-a1bb-f693f8490e68 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:26.098620 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-6a9d9af4-b6a1-4000-a1bb-f693f8490e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:26.104536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 953/1904] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:02:25 2022] DELETE /identity/v3/users/42469b497102460ca1227f3f243e7fbf => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:26.112733 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441fffb-a2e0-495a-8243-589abb7e0575 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:26.119546 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-1441fffb-a2e0-495a-8243-589abb7e0575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:26.206885 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d9af4-b6a1-4000-a1bb-f693f8490e68 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:26.210980 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441fffb-a2e0-495a-8243-589abb7e0575 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:26.217223 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d38808-9bb8-41e0-a0c0-e02330636df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:26.218724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d38808-9bb8-41e0-a0c0-e02330636df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:26.219094 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d38808-9bb8-41e0-a0c0-e02330636df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:26.219564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d38808-9bb8-41e0-a0c0-e02330636df6 admin admin] PATH_INFO: `/v3/projects/bcd1c509c43f4a9f95b8fba591b0090f` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:26.221142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d38808-9bb8-41e0-a0c0-e02330636df6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcd1c509c43f4a9f95b8fba591b0090f)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:26.223638 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d38808-9bb8-41e0-a0c0-e02330636df6 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:26.309343 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936c06f-2c0e-4eef-b12a-32c8cb86a5c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:26.310314 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936c06f-2c0e-4eef-b12a-32c8cb86a5c8 service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:26.310781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936c06f-2c0e-4eef-b12a-32c8cb86a5c8 service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:26.311070 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936c06f-2c0e-4eef-b12a-32c8cb86a5c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:26.313307 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-9936c06f-2c0e-4eef-b12a-32c8cb86a5c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:26.327793 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936c06f-2c0e-4eef-b12a-32c8cb86a5c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:26.329510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936c06f-2c0e-4eef-b12a-32c8cb86a5c8 service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:26.331860 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-e0d38808-9bb8-41e0-a0c0-e02330636df6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcd1c509c43f4a9f95b8fba591b0090f', 'request_id': 'req-e0d38808-9bb8-41e0-a0c0-e02330636df6'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:26.346686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-e0d38808-9bb8-41e0-a0c0-e02330636df6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcd1c509c43f4a9f95b8fba591b0090f', 'request_id': 'req-e0d38808-9bb8-41e0-a0c0-e02330636df6'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:26.357233 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 952/1905] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:26.360144 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6915c-0afe-46c1-8f0d-ac5015e4ef57 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:26.361666 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6915c-0afe-46c1-8f0d-ac5015e4ef57 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:26.361965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6915c-0afe-46c1-8f0d-ac5015e4ef57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:26.364371 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-e0d38808-9bb8-41e0-a0c0-e02330636df6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcd1c509c43f4a9f95b8fba591b0090f', 'request_id': 'req-e0d38808-9bb8-41e0-a0c0-e02330636df6'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:26.391935 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-e0d38808-9bb8-41e0-a0c0-e02330636df6 admin admin] The token cache is being invalidate because project bcd1c509c43f4a9f95b8fba591b0090f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:02:26.394394 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-e0d38808-9bb8-41e0-a0c0-e02330636df6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:26.395198 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-e0d38808-9bb8-41e0-a0c0-e02330636df6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:26.402745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-a0d6915c-0afe-46c1-8f0d-ac5015e4ef57 None None] MFA Rules not processed for user `a2b3cb74e3b64d87903eb933adb4c01f`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:26.403178 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 954/1906] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:02:26 2022] DELETE /identity/v3/projects/bcd1c509c43f4a9f95b8fba591b0090f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:26.404774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a0d6915c-0afe-46c1-8f0d-ac5015e4ef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:26.405496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9801b6b-e4b8-48c4-b313-f1b8cb7e92fb None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:26.405986 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9801b6b-e4b8-48c4-b313-f1b8cb7e92fb None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:26.406584 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9801b6b-e4b8-48c4-b313-f1b8cb7e92fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:26.425363 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-e9801b6b-e4b8-48c4-b313-f1b8cb7e92fb None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:26.426693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-e9801b6b-e4b8-48c4-b313-f1b8cb7e92fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:26.480982 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 953/1907] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:26 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:26.481828 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6915c-0afe-46c1-8f0d-ac5015e4ef57 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:26.483241 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a0d6915c-0afe-46c1-8f0d-ac5015e4ef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:26.488498 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 955/1908] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:26.490023 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9801b6b-e4b8-48c4-b313-f1b8cb7e92fb None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:26.491339 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-e9801b6b-e4b8-48c4-b313-f1b8cb7e92fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:26.500051 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6915c-0afe-46c1-8f0d-ac5015e4ef57 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:26.503760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9801b6b-e4b8-48c4-b313-f1b8cb7e92fb None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:26.505553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c636eeb-4124-4bce-b1b1-d84aa1477a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:26.506708 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c636eeb-4124-4bce-b1b1-d84aa1477a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:26.506987 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c636eeb-4124-4bce-b1b1-d84aa1477a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:26.507253 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c636eeb-4124-4bce-b1b1-d84aa1477a96 admin admin] PATH_INFO: `/v3/users/3cdf8f2a7d2640c78bb7f7a71a9f44b7` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:26.509200 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163b7d5-563d-4327-a84e-73539c386a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:26.509873 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163b7d5-563d-4327-a84e-73539c386a8d admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:26.510155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163b7d5-563d-4327-a84e-73539c386a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:26.510460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163b7d5-563d-4327-a84e-73539c386a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:26.510642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c636eeb-4124-4bce-b1b1-d84aa1477a96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cdf8f2a7d2640c78bb7f7a71a9f44b7)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:26.511153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163b7d5-563d-4327-a84e-73539c386a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:26.512584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c636eeb-4124-4bce-b1b1-d84aa1477a96 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:26.513064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163b7d5-563d-4327-a84e-73539c386a8d admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:26.540099 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 956/1909] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:02:26 2022] POST /identity/v3/projects => generated 355 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:26.540926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163b7d5-563d-4327-a84e-73539c386a8d admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:26.542652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-3163b7d5-563d-4327-a84e-73539c386a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:26.565712 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1c636eeb-4124-4bce-b1b1-d84aa1477a96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cdf8f2a7d2640c78bb7f7a71a9f44b7'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:26.573048 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1c636eeb-4124-4bce-b1b1-d84aa1477a96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cdf8f2a7d2640c78bb7f7a71a9f44b7'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:26.586358 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1c636eeb-4124-4bce-b1b1-d84aa1477a96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cdf8f2a7d2640c78bb7f7a71a9f44b7'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:26.587165 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1c636eeb-4124-4bce-b1b1-d84aa1477a96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cdf8f2a7d2640c78bb7f7a71a9f44b7'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:26.587797 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1c636eeb-4124-4bce-b1b1-d84aa1477a96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cdf8f2a7d2640c78bb7f7a71a9f44b7'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:26.600215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163b7d5-563d-4327-a84e-73539c386a8d admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:26.600778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 954/1910] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:02:26 2022] DELETE /identity/v3/users/3cdf8f2a7d2640c78bb7f7a71a9f44b7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:26.603751 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c636eeb-4124-4bce-b1b1-d84aa1477a96 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:26.603751 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-1c636eeb-4124-4bce-b1b1-d84aa1477a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:26.654349 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14393714-6f2a-465e-a2cd-a4c7a8b94ecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:26.655645 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14393714-6f2a-465e-a2cd-a4c7a8b94ecd service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:26.656176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14393714-6f2a-465e-a2cd-a4c7a8b94ecd service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:26.656438 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14393714-6f2a-465e-a2cd-a4c7a8b94ecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:26.658650 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-14393714-6f2a-465e-a2cd-a4c7a8b94ecd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:26.671038 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c636eeb-4124-4bce-b1b1-d84aa1477a96 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:26.673658 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14393714-6f2a-465e-a2cd-a4c7a8b94ecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:26.675466 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14393714-6f2a-465e-a2cd-a4c7a8b94ecd service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:26.680064 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd90fa-b9f8-4109-a12d-76c037543a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:26.681059 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd90fa-b9f8-4109-a12d-76c037543a47 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:26.681562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd90fa-b9f8-4109-a12d-76c037543a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:26.682454 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd90fa-b9f8-4109-a12d-76c037543a47 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:26.682853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd90fa-b9f8-4109-a12d-76c037543a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:26.685197 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd90fa-b9f8-4109-a12d-76c037543a47 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:26.687190 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 957/1911] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:26.705092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 955/1912] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:02:26 2022] POST /identity/v3/users => generated 284 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:26.709628 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14393714-6f2a-465e-a2cd-a4c7a8b94ecd service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:26.719116 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14393714-6f2a-465e-a2cd-a4c7a8b94ecd service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:26.723987 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1af79-559c-4404-925c-2f11c962ff0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:26.725250 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1af79-559c-4404-925c-2f11c962ff0a admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:26.725545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1af79-559c-4404-925c-2f11c962ff0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:26.725854 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1af79-559c-4404-925c-2f11c962ff0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:26.726873 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1af79-559c-4404-925c-2f11c962ff0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:26.728481 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1af79-559c-4404-925c-2f11c962ff0a admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:26.741499 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 958/1913] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:02:26.743635 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd90fa-b9f8-4109-a12d-76c037543a47 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:26.753864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd90fa-b9f8-4109-a12d-76c037543a47 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:26.758791 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898dfe6-3175-44f2-90fa-31750eb6fd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:26.759705 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898dfe6-3175-44f2-90fa-31750eb6fd25 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:26.759981 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898dfe6-3175-44f2-90fa-31750eb6fd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:26.760250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898dfe6-3175-44f2-90fa-31750eb6fd25 admin admin] PATH_INFO: `/v3/projects/90fe3efd0ca04f57b3e9bbde65e7e533/users/82ab2ff063094082b751b54d87de731a/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:26.775816 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898dfe6-3175-44f2-90fa-31750eb6fd25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90fe3efd0ca04f57b3e9bbde65e7e533, user_id=82ab2ff063094082b751b54d87de731a, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:26.780772 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898dfe6-3175-44f2-90fa-31750eb6fd25 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:26.799371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 956/1914] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:02:26 2022] PUT /identity/v3/projects/90fe3efd0ca04f57b3e9bbde65e7e533/users/82ab2ff063094082b751b54d87de731a/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:26.800689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1af79-559c-4404-925c-2f11c962ff0a admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:26.813647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1af79-559c-4404-925c-2f11c962ff0a admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:26.876631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca7f5d-8543-438e-b186-7ddb27ace3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:26.877318 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca7f5d-8543-438e-b186-7ddb27ace3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:26.877653 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca7f5d-8543-438e-b186-7ddb27ace3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:26.877931 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca7f5d-8543-438e-b186-7ddb27ace3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:26.878697 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca7f5d-8543-438e-b186-7ddb27ace3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:26.880819 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca7f5d-8543-438e-b186-7ddb27ace3d1 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:26.891562 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 959/1915] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:02:26.895682 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898dfe6-3175-44f2-90fa-31750eb6fd25 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:26.906878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898dfe6-3175-44f2-90fa-31750eb6fd25 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:26.912687 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076aff6-acef-4987-9f34-5a6c44276f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:26.913590 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076aff6-acef-4987-9f34-5a6c44276f16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:26.913874 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076aff6-acef-4987-9f34-5a6c44276f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:26.914152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076aff6-acef-4987-9f34-5a6c44276f16 admin admin] PATH_INFO: `/v3/projects/90fe3efd0ca04f57b3e9bbde65e7e533/users/82ab2ff063094082b751b54d87de731a/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:26.916281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076aff6-acef-4987-9f34-5a6c44276f16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90fe3efd0ca04f57b3e9bbde65e7e533, user_id=82ab2ff063094082b751b54d87de731a, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:26.919011 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076aff6-acef-4987-9f34-5a6c44276f16 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:26.930493 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 957/1916] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:02:26 2022] PUT /identity/v3/projects/90fe3efd0ca04f57b3e9bbde65e7e533/users/82ab2ff063094082b751b54d87de731a/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:02:26.941338 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67f53e-b4b1-4878-a4c9-29a49cf58c84 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:26.941624 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67f53e-b4b1-4878-a4c9-29a49cf58c84 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:26.941899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67f53e-b4b1-4878-a4c9-29a49cf58c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:26.971164 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-5a67f53e-b4b1-4878-a4c9-29a49cf58c84 None None] MFA Rules not processed for user `82ab2ff063094082b751b54d87de731a`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:26.972376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-5a67f53e-b4b1-4878-a4c9-29a49cf58c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:27.010414 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076aff6-acef-4987-9f34-5a6c44276f16 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:27.013242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-8076aff6-acef-4987-9f34-5a6c44276f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:27.098154 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 960/1917] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:26 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:27.099701 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67f53e-b4b1-4878-a4c9-29a49cf58c84 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:27.101075 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-5a67f53e-b4b1-4878-a4c9-29a49cf58c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:27.107395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076aff6-acef-4987-9f34-5a6c44276f16 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:27.116459 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54d4c8-5344-4cc4-ae87-fbaa9bbe14a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:27.117422 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54d4c8-5344-4cc4-ae87-fbaa9bbe14a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:27.117696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54d4c8-5344-4cc4-ae87-fbaa9bbe14a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:27.117982 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54d4c8-5344-4cc4-ae87-fbaa9bbe14a9 admin admin] PATH_INFO: `/v3/projects/3e783bb3eb664335aa89e468147e0634` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:27.119475 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54d4c8-5344-4cc4-ae87-fbaa9bbe14a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e783bb3eb664335aa89e468147e0634)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:27.122607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54d4c8-5344-4cc4-ae87-fbaa9bbe14a9 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:27.127157 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67f53e-b4b1-4878-a4c9-29a49cf58c84 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:27.134387 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73a7b8-7eb7-41f0-9e8a-4fde68f1a3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:27.135746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73a7b8-7eb7-41f0-9e8a-4fde68f1a3ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:27.136103 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73a7b8-7eb7-41f0-9e8a-4fde68f1a3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:27.136474 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73a7b8-7eb7-41f0-9e8a-4fde68f1a3ed admin admin] PATH_INFO: `/v3/projects/9e3a63aa2c624d65afa1117255819584` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:27.137904 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73a7b8-7eb7-41f0-9e8a-4fde68f1a3ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e3a63aa2c624d65afa1117255819584)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:27.140427 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73a7b8-7eb7-41f0-9e8a-4fde68f1a3ed admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:27.184573 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0a54d4c8-5344-4cc4-ae87-fbaa9bbe14a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e783bb3eb664335aa89e468147e0634', 'request_id': 'req-0a54d4c8-5344-4cc4-ae87-fbaa9bbe14a9'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:27.189893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0a54d4c8-5344-4cc4-ae87-fbaa9bbe14a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e783bb3eb664335aa89e468147e0634', 'request_id': 'req-0a54d4c8-5344-4cc4-ae87-fbaa9bbe14a9'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:27.196510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0a54d4c8-5344-4cc4-ae87-fbaa9bbe14a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e783bb3eb664335aa89e468147e0634', 'request_id': 'req-0a54d4c8-5344-4cc4-ae87-fbaa9bbe14a9'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:27.196682 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-7f73a7b8-7eb7-41f0-9e8a-4fde68f1a3ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e3a63aa2c624d65afa1117255819584', 'request_id': 'req-7f73a7b8-7eb7-41f0-9e8a-4fde68f1a3ed'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:27.201962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-7f73a7b8-7eb7-41f0-9e8a-4fde68f1a3ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e3a63aa2c624d65afa1117255819584', 'request_id': 'req-7f73a7b8-7eb7-41f0-9e8a-4fde68f1a3ed'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:27.208128 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-7f73a7b8-7eb7-41f0-9e8a-4fde68f1a3ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e3a63aa2c624d65afa1117255819584', 'request_id': 'req-7f73a7b8-7eb7-41f0-9e8a-4fde68f1a3ed'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:27.209507 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0a54d4c8-5344-4cc4-ae87-fbaa9bbe14a9 admin admin] The token cache is being invalidate because project 3e783bb3eb664335aa89e468147e0634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:02:27.209803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0a54d4c8-5344-4cc4-ae87-fbaa9bbe14a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:27.210519 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0a54d4c8-5344-4cc4-ae87-fbaa9bbe14a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:27.212204 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 958/1918] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:02:27 2022] DELETE /identity/v3/projects/3e783bb3eb664335aa89e468147e0634 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:27.213528 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54d4c8-5344-4cc4-ae87-fbaa9bbe14a9 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:27.215100 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-0a54d4c8-5344-4cc4-ae87-fbaa9bbe14a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:27.221454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-7f73a7b8-7eb7-41f0-9e8a-4fde68f1a3ed admin admin] The token cache is being invalidate because project 9e3a63aa2c624d65afa1117255819584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:02:27.221745 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-7f73a7b8-7eb7-41f0-9e8a-4fde68f1a3ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:27.222406 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-7f73a7b8-7eb7-41f0-9e8a-4fde68f1a3ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:27.227961 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 961/1919] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:02:27 2022] DELETE /identity/v3/projects/9e3a63aa2c624d65afa1117255819584 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:27.227961 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365662ad-a7b4-434e-bacf-09e919812021 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:27.227961 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365662ad-a7b4-434e-bacf-09e919812021 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:27.227961 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365662ad-a7b4-434e-bacf-09e919812021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:27.244944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-365662ad-a7b4-434e-bacf-09e919812021 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:27.246134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-365662ad-a7b4-434e-bacf-09e919812021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:27.276641 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54d4c8-5344-4cc4-ae87-fbaa9bbe14a9 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:27.305041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 962/1920] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:27.306383 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4c477-262e-4998-806e-50f4908ff670 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:27.306774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4c477-262e-4998-806e-50f4908ff670 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:27.307051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4c477-262e-4998-806e-50f4908ff670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:27.324204 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090d9c4-3ddd-4298-9e50-fc334effd1d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:27.324871 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090d9c4-3ddd-4298-9e50-fc334effd1d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:27.325148 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090d9c4-3ddd-4298-9e50-fc334effd1d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:27.325540 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090d9c4-3ddd-4298-9e50-fc334effd1d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:27.327139 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-63d4c477-262e-4998-806e-50f4908ff670 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:27.327287 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-d090d9c4-3ddd-4298-9e50-fc334effd1d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:27.328373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-63d4c477-262e-4998-806e-50f4908ff670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:27.344634 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 963/1921] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:27.344634 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e65047-78b6-425e-af7c-b6cebea3da52 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:27.344634 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e65047-78b6-425e-af7c-b6cebea3da52 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:27.344634 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e65047-78b6-425e-af7c-b6cebea3da52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:27.364742 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-f1e65047-78b6-425e-af7c-b6cebea3da52 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:27.366097 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f1e65047-78b6-425e-af7c-b6cebea3da52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:27.374713 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 964/1922] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:27.376211 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef90638-a5af-4acd-8557-ddbaef495993 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:27.376668 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef90638-a5af-4acd-8557-ddbaef495993 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:27.377005 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef90638-a5af-4acd-8557-ddbaef495993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:27.395215 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090d9c4-3ddd-4298-9e50-fc334effd1d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:27.395419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-6ef90638-a5af-4acd-8557-ddbaef495993 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:27.397409 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-6ef90638-a5af-4acd-8557-ddbaef495993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:27.398160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090d9c4-3ddd-4298-9e50-fc334effd1d3 service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:27.409894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 965/1923] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:27.409894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef90638-a5af-4acd-8557-ddbaef495993 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:27.413836 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 959/1924] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:27 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:27.419276 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090d9c4-3ddd-4298-9e50-fc334effd1d3 service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:27.427760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef90638-a5af-4acd-8557-ddbaef495993 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:27.433400 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9f1f1-8db1-4ba7-b822-a35b1290b106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:27.434188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9f1f1-8db1-4ba7-b822-a35b1290b106 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:27.434848 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9f1f1-8db1-4ba7-b822-a35b1290b106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:27.435002 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9f1f1-8db1-4ba7-b822-a35b1290b106 admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:27.435780 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9f1f1-8db1-4ba7-b822-a35b1290b106 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:02:27.436085 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9f1f1-8db1-4ba7-b822-a35b1290b106 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:27.438097 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9f1f1-8db1-4ba7-b822-a35b1290b106 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:27.440818 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090d9c4-3ddd-4298-9e50-fc334effd1d3 service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:27.449523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e6846-26b8-445e-bd5f-cdaa89d8158e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:27.450415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e6846-26b8-445e-bd5f-cdaa89d8158e admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:27.450825 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e6846-26b8-445e-bd5f-cdaa89d8158e admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:27.451222 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e6846-26b8-445e-bd5f-cdaa89d8158e admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:27.452083 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e6846-26b8-445e-bd5f-cdaa89d8158e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:02:27.452537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e6846-26b8-445e-bd5f-cdaa89d8158e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:27.454472 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e6846-26b8-445e-bd5f-cdaa89d8158e admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:27.457386 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 966/1925] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:02:27.462272 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9f1f1-8db1-4ba7-b822-a35b1290b106 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:27.473760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9f1f1-8db1-4ba7-b822-a35b1290b106 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:27.476945 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 960/1926] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:02:27.482833 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e6846-26b8-445e-bd5f-cdaa89d8158e admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:27.483680 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06690246-a054-406f-98ce-1d165c91e21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:27.484766 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06690246-a054-406f-98ce-1d165c91e21b admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:27.485176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06690246-a054-406f-98ce-1d165c91e21b admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:27.485457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06690246-a054-406f-98ce-1d165c91e21b admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:27.486159 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06690246-a054-406f-98ce-1d165c91e21b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:27.488530 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06690246-a054-406f-98ce-1d165c91e21b admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:27.499842 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e6846-26b8-445e-bd5f-cdaa89d8158e admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:27.505846 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d04aa-aaae-48c9-bd64-325dccc063e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:27.507172 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d04aa-aaae-48c9-bd64-325dccc063e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:27.507575 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d04aa-aaae-48c9-bd64-325dccc063e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:27.507929 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d04aa-aaae-48c9-bd64-325dccc063e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:27.508757 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d04aa-aaae-48c9-bd64-325dccc063e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:27.511365 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d04aa-aaae-48c9-bd64-325dccc063e1 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:27.526234 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 967/1927] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:02:27 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:27.526234 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06690246-a054-406f-98ce-1d165c91e21b admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:27.527240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-06690246-a054-406f-98ce-1d165c91e21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:27.546277 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 961/1928] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:02:27 2022] POST /identity/v3/projects => generated 363 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:02:27.547203 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d04aa-aaae-48c9-bd64-325dccc063e1 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:27.602337 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06690246-a054-406f-98ce-1d165c91e21b admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:27.613036 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d04aa-aaae-48c9-bd64-325dccc063e1 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:27.620761 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec7c30-ccb5-4bc6-96a3-608ed95feb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:27.621396 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec7c30-ccb5-4bc6-96a3-608ed95feb0e admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:27.621710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec7c30-ccb5-4bc6-96a3-608ed95feb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:27.622232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec7c30-ccb5-4bc6-96a3-608ed95feb0e admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:27.622906 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec7c30-ccb5-4bc6-96a3-608ed95feb0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:27.624679 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec7c30-ccb5-4bc6-96a3-608ed95feb0e admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:27.650240 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 962/1929] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:02:27 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:27.650240 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec7c30-ccb5-4bc6-96a3-608ed95feb0e admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:27.660364 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec7c30-ccb5-4bc6-96a3-608ed95feb0e admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:27.661540 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e257a05-c562-4cad-a5e7-9f4f3e8a325a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:27.662250 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e257a05-c562-4cad-a5e7-9f4f3e8a325a service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:27.662519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e257a05-c562-4cad-a5e7-9f4f3e8a325a service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:27.662795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e257a05-c562-4cad-a5e7-9f4f3e8a325a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:27.664602 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-4e257a05-c562-4cad-a5e7-9f4f3e8a325a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:27.666381 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a0a3c-e0e9-45eb-b9c0-92653cff88d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:27.667051 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a0a3c-e0e9-45eb-b9c0-92653cff88d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:27.667337 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a0a3c-e0e9-45eb-b9c0-92653cff88d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:27.667969 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a0a3c-e0e9-45eb-b9c0-92653cff88d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:27.668345 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a0a3c-e0e9-45eb-b9c0-92653cff88d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:27.670707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a0a3c-e0e9-45eb-b9c0-92653cff88d9 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:27.696784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 963/1930] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:02:27 2022] POST /identity/v3/users => generated 282 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:27.696784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a0a3c-e0e9-45eb-b9c0-92653cff88d9 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:27.704767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a0a3c-e0e9-45eb-b9c0-92653cff88d9 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:27.710429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e651f6-90ce-44b5-8163-38e7e49ada57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:27.711102 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e651f6-90ce-44b5-8163-38e7e49ada57 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:27.711387 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e651f6-90ce-44b5-8163-38e7e49ada57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:27.711665 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e651f6-90ce-44b5-8163-38e7e49ada57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:27.712395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e651f6-90ce-44b5-8163-38e7e49ada57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:27.718413 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e651f6-90ce-44b5-8163-38e7e49ada57 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:27.732917 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 964/1931] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:27.734974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e257a05-c562-4cad-a5e7-9f4f3e8a325a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:27.736414 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e257a05-c562-4cad-a5e7-9f4f3e8a325a service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:27.737038 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e651f6-90ce-44b5-8163-38e7e49ada57 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:27.747213 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 968/1932] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:27 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:27.749673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e651f6-90ce-44b5-8163-38e7e49ada57 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:27.751261 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e257a05-c562-4cad-a5e7-9f4f3e8a325a service cinder] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:27.757574 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a695d87-7fd1-4235-81f7-473b6c9627c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:27.757574 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a695d87-7fd1-4235-81f7-473b6c9627c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:27.757574 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a695d87-7fd1-4235-81f7-473b6c9627c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:27.757574 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a695d87-7fd1-4235-81f7-473b6c9627c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:27.757846 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a695d87-7fd1-4235-81f7-473b6c9627c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:27.760291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a695d87-7fd1-4235-81f7-473b6c9627c0 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:27.764224 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e257a05-c562-4cad-a5e7-9f4f3e8a325a service cinder] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:27.769301 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c534c-0c9d-49cf-87a4-429afc68468f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:27.770343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c534c-0c9d-49cf-87a4-429afc68468f admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:27.770652 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 965/1933] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:27.771962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c534c-0c9d-49cf-87a4-429afc68468f admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:27.772371 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c534c-0c9d-49cf-87a4-429afc68468f admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:27.773148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c534c-0c9d-49cf-87a4-429afc68468f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:27.774951 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c534c-0c9d-49cf-87a4-429afc68468f admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:27.775312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a695d87-7fd1-4235-81f7-473b6c9627c0 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:27.784634 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a695d87-7fd1-4235-81f7-473b6c9627c0 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:27.785773 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 969/1934] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:27.789808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c534c-0c9d-49cf-87a4-429afc68468f admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:27.792560 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d545f77-1aaa-435a-b2b6-8b2b7925e218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:27.793223 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d545f77-1aaa-435a-b2b6-8b2b7925e218 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:27.793503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d545f77-1aaa-435a-b2b6-8b2b7925e218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:27.793773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d545f77-1aaa-435a-b2b6-8b2b7925e218 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:27.794526 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d545f77-1aaa-435a-b2b6-8b2b7925e218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:27.796318 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d545f77-1aaa-435a-b2b6-8b2b7925e218 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:27.800100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c534c-0c9d-49cf-87a4-429afc68468f admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:27.805531 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb2b78-c4a7-44c6-958b-dc1d812f52a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:27.806511 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb2b78-c4a7-44c6-958b-dc1d812f52a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:27.806839 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb2b78-c4a7-44c6-958b-dc1d812f52a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:27.807144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb2b78-c4a7-44c6-958b-dc1d812f52a8 admin admin] PATH_INFO: `/v3/projects/1b006b5d944f4ad491298cb78ff3ef7a/users/5b6252f06de8429e90449c473a38a979/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:27.807378 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 966/1935] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:02:27.811723 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d545f77-1aaa-435a-b2b6-8b2b7925e218 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:27.822844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d545f77-1aaa-435a-b2b6-8b2b7925e218 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:27.825518 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb2b78-c4a7-44c6-958b-dc1d812f52a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b006b5d944f4ad491298cb78ff3ef7a, user_id=5b6252f06de8429e90449c473a38a979, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:27.828942 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f4f32-c9b0-4d7b-9fb6-3401a5ad2f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:27.829092 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb2b78-c4a7-44c6-958b-dc1d812f52a8 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:27.829396 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f4f32-c9b0-4d7b-9fb6-3401a5ad2f88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:27.829670 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f4f32-c9b0-4d7b-9fb6-3401a5ad2f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:27.829999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f4f32-c9b0-4d7b-9fb6-3401a5ad2f88 admin admin] PATH_INFO: `/v3/projects/ec945b6dd8c748c995d75462be200273/users/25c46273f24c40a8996a6da129fb8bd7/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:27.856341 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f4f32-c9b0-4d7b-9fb6-3401a5ad2f88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec945b6dd8c748c995d75462be200273, user_id=25c46273f24c40a8996a6da129fb8bd7, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:27.856341 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f4f32-c9b0-4d7b-9fb6-3401a5ad2f88 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:27.857892 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 970/1936] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:02:27 2022] PUT /identity/v3/projects/1b006b5d944f4ad491298cb78ff3ef7a/users/5b6252f06de8429e90449c473a38a979/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:02:27.859935 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491512fb-686c-4cac-8d5a-391023e6529e None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:27.860344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491512fb-686c-4cac-8d5a-391023e6529e None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:27.860640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491512fb-686c-4cac-8d5a-391023e6529e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:27.873860 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 967/1937] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:02:27 2022] PUT /identity/v3/projects/ec945b6dd8c748c995d75462be200273/users/25c46273f24c40a8996a6da129fb8bd7/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:02:27.884861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb16608-8ad3-419e-8abd-b9d31d88699f None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:27.885129 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb16608-8ad3-419e-8abd-b9d31d88699f None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:27.885410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb16608-8ad3-419e-8abd-b9d31d88699f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:27.893579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-491512fb-686c-4cac-8d5a-391023e6529e None None] MFA Rules not processed for user `5b6252f06de8429e90449c473a38a979`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:27.895083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-491512fb-686c-4cac-8d5a-391023e6529e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:27.915477 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-5fb16608-8ad3-419e-8abd-b9d31d88699f None None] MFA Rules not processed for user `25c46273f24c40a8996a6da129fb8bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:27.916840 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-5fb16608-8ad3-419e-8abd-b9d31d88699f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:27.965213 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 971/1938] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:27.976455 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491512fb-686c-4cac-8d5a-391023e6529e None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:27.977786 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-491512fb-686c-4cac-8d5a-391023e6529e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:27.982234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 968/1939] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:27 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:27.991535 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb16608-8ad3-419e-8abd-b9d31d88699f None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:28.037125 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491512fb-686c-4cac-8d5a-391023e6529e None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:28.041128 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cd033-26fe-4f61-b920-7782ba298b6f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada4e799ead24839b109377db3c6393b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:28.041823 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cd033-26fe-4f61-b920-7782ba298b6f service glance] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:28.042107 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cd033-26fe-4f61-b920-7782ba298b6f service glance] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:28.042415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cd033-26fe-4f61-b920-7782ba298b6f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:28.044811 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb16608-8ad3-419e-8abd-b9d31d88699f None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:28.048399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb148e59-f522-4463-a35c-6492a2a176a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:28.049054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb148e59-f522-4463-a35c-6492a2a176a7 service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:28.049335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb148e59-f522-4463-a35c-6492a2a176a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:28.049616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb148e59-f522-4463-a35c-6492a2a176a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:28.053020 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4cd033-26fe-4f61-b920-7782ba298b6f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:28.054857 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4cd033-26fe-4f61-b920-7782ba298b6f service glance] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:28.058889 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb148e59-f522-4463-a35c-6492a2a176a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:28.060316 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb148e59-f522-4463-a35c-6492a2a176a7 service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:28.065714 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 972/1940] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:02:28.070345 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 969/1941] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:27 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:34.691418 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cd033-26fe-4f61-b920-7782ba298b6f service glance] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:34.693500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-9a4cd033-26fe-4f61-b920-7782ba298b6f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:34.771496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cd033-26fe-4f61-b920-7782ba298b6f service glance] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:34.776167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ecae2-3526-4f75-87c8-efa8ffe47502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:34.777244 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ecae2-3526-4f75-87c8-efa8ffe47502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:34.777589 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ecae2-3526-4f75-87c8-efa8ffe47502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:34.777926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ecae2-3526-4f75-87c8-efa8ffe47502 admin admin] PATH_INFO: `/v3/users/d6415c26ae5b44d7800c8bbe0d9de823` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:34.779270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ecae2-3526-4f75-87c8-efa8ffe47502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6415c26ae5b44d7800c8bbe0d9de823)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:34.781316 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ecae2-3526-4f75-87c8-efa8ffe47502 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:34.839592 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-ee0ecae2-3526-4f75-87c8-efa8ffe47502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6415c26ae5b44d7800c8bbe0d9de823'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:34.840485 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-ee0ecae2-3526-4f75-87c8-efa8ffe47502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6415c26ae5b44d7800c8bbe0d9de823'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:34.862651 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-ee0ecae2-3526-4f75-87c8-efa8ffe47502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6415c26ae5b44d7800c8bbe0d9de823'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:34.873634 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-ee0ecae2-3526-4f75-87c8-efa8ffe47502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6415c26ae5b44d7800c8bbe0d9de823'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:34.882483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-ee0ecae2-3526-4f75-87c8-efa8ffe47502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6415c26ae5b44d7800c8bbe0d9de823'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:34.892355 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 973/1942] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:02:34 2022] DELETE /identity/v3/users/d6415c26ae5b44d7800c8bbe0d9de823 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:34.898616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b6ff2-44a8-4709-a1df-ef61c3468054 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:34.899614 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b6ff2-44a8-4709-a1df-ef61c3468054 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:34.899894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b6ff2-44a8-4709-a1df-ef61c3468054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:34.929333 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-126b6ff2-44a8-4709-a1df-ef61c3468054 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:34.932571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-126b6ff2-44a8-4709-a1df-ef61c3468054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:34.990707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 970/1943] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:35.000523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ecae2-3526-4f75-87c8-efa8ffe47502 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:35.001913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-ee0ecae2-3526-4f75-87c8-efa8ffe47502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:35.074512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ecae2-3526-4f75-87c8-efa8ffe47502 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:35.079955 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf17379-ed80-464a-9029-d7e17d663fb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:35.080934 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf17379-ed80-464a-9029-d7e17d663fb6 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:35.081408 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf17379-ed80-464a-9029-d7e17d663fb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:35.081802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf17379-ed80-464a-9029-d7e17d663fb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:35.094887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf17379-ed80-464a-9029-d7e17d663fb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:35.096346 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf17379-ed80-464a-9029-d7e17d663fb6 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:35.107950 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 974/1944] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:35.384783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b6ff2-44a8-4709-a1df-ef61c3468054 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:35.386215 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-126b6ff2-44a8-4709-a1df-ef61c3468054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:35.399938 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b6ff2-44a8-4709-a1df-ef61c3468054 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:35.413699 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd4441-0558-4af7-941f-918abb1f941a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:35.414644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd4441-0558-4af7-941f-918abb1f941a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:35.415478 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd4441-0558-4af7-941f-918abb1f941a admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:35.415693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd4441-0558-4af7-941f-918abb1f941a admin admin] PATH_INFO: `/v3/projects/fbc2c2bd10964440b9cd09048e68ab9e` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:35.417249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd4441-0558-4af7-941f-918abb1f941a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbc2c2bd10964440b9cd09048e68ab9e)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:35.419521 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd4441-0558-4af7-941f-918abb1f941a admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:35.484300 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-76bd4441-0558-4af7-941f-918abb1f941a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbc2c2bd10964440b9cd09048e68ab9e', 'request_id': 'req-76bd4441-0558-4af7-941f-918abb1f941a'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:35.490273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-76bd4441-0558-4af7-941f-918abb1f941a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbc2c2bd10964440b9cd09048e68ab9e', 'request_id': 'req-76bd4441-0558-4af7-941f-918abb1f941a'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:35.497362 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-76bd4441-0558-4af7-941f-918abb1f941a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbc2c2bd10964440b9cd09048e68ab9e', 'request_id': 'req-76bd4441-0558-4af7-941f-918abb1f941a'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:35.513100 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-76bd4441-0558-4af7-941f-918abb1f941a admin admin] The token cache is being invalidate because project fbc2c2bd10964440b9cd09048e68ab9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:02:35.513100 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-76bd4441-0558-4af7-941f-918abb1f941a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:35.513100 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-76bd4441-0558-4af7-941f-918abb1f941a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:35.514488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 971/1945] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:02:35 2022] DELETE /identity/v3/projects/fbc2c2bd10964440b9cd09048e68ab9e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:35.518541 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf17379-ed80-464a-9029-d7e17d663fb6 service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:35.537471 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf17379-ed80-464a-9029-d7e17d663fb6 service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:35.622091 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56401764-eb22-4e03-bcf0-7705f137650f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:35.623509 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56401764-eb22-4e03-bcf0-7705f137650f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:35.623509 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56401764-eb22-4e03-bcf0-7705f137650f admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:35.623509 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56401764-eb22-4e03-bcf0-7705f137650f admin admin] PATH_INFO: `/v3/users/cf32e9e8cc7b4dd88448583c397e1e96` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:35.625316 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56401764-eb22-4e03-bcf0-7705f137650f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf32e9e8cc7b4dd88448583c397e1e96)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:35.627351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56401764-eb22-4e03-bcf0-7705f137650f admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:35.722081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-56401764-eb22-4e03-bcf0-7705f137650f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf32e9e8cc7b4dd88448583c397e1e96'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:35.725127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-56401764-eb22-4e03-bcf0-7705f137650f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf32e9e8cc7b4dd88448583c397e1e96'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:35.741612 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-56401764-eb22-4e03-bcf0-7705f137650f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf32e9e8cc7b4dd88448583c397e1e96'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:35.751526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-56401764-eb22-4e03-bcf0-7705f137650f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf32e9e8cc7b4dd88448583c397e1e96'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:35.763222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-56401764-eb22-4e03-bcf0-7705f137650f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf32e9e8cc7b4dd88448583c397e1e96'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:35.772252 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 975/1946] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:02:35 2022] DELETE /identity/v3/users/cf32e9e8cc7b4dd88448583c397e1e96 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:36.245287 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd4441-0558-4af7-941f-918abb1f941a admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:36.248921 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-76bd4441-0558-4af7-941f-918abb1f941a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:36.265765 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd4441-0558-4af7-941f-918abb1f941a admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:36.324680 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cb623-bb08-4ec0-8c57-333dbe7872ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:36.325646 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cb623-bb08-4ec0-8c57-333dbe7872ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:36.325931 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cb623-bb08-4ec0-8c57-333dbe7872ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:36.326222 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cb623-bb08-4ec0-8c57-333dbe7872ff admin admin] PATH_INFO: `/v3/projects/56cccd1b02bc44358b588b3f9c22c8c8` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:36.327428 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145cb623-bb08-4ec0-8c57-333dbe7872ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=56cccd1b02bc44358b588b3f9c22c8c8)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:36.329337 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145cb623-bb08-4ec0-8c57-333dbe7872ff admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:36.388173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-145cb623-bb08-4ec0-8c57-333dbe7872ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56cccd1b02bc44358b588b3f9c22c8c8', 'request_id': 'req-145cb623-bb08-4ec0-8c57-333dbe7872ff'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:36.393742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-145cb623-bb08-4ec0-8c57-333dbe7872ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56cccd1b02bc44358b588b3f9c22c8c8', 'request_id': 'req-145cb623-bb08-4ec0-8c57-333dbe7872ff'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:36.401414 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-145cb623-bb08-4ec0-8c57-333dbe7872ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56cccd1b02bc44358b588b3f9c22c8c8', 'request_id': 'req-145cb623-bb08-4ec0-8c57-333dbe7872ff'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:36.418586 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-145cb623-bb08-4ec0-8c57-333dbe7872ff admin admin] The token cache is being invalidate because project 56cccd1b02bc44358b588b3f9c22c8c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:02:36.418887 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-145cb623-bb08-4ec0-8c57-333dbe7872ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:36.419634 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-145cb623-bb08-4ec0-8c57-333dbe7872ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:36.421542 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 972/1947] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:02:36 2022] DELETE /identity/v3/projects/56cccd1b02bc44358b588b3f9c22c8c8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:36.426469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea56e5-5a96-4c8c-97bc-03de658d1e5e None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:36.426764 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea56e5-5a96-4c8c-97bc-03de658d1e5e None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:36.427580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea56e5-5a96-4c8c-97bc-03de658d1e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:36.448310 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-24ea56e5-5a96-4c8c-97bc-03de658d1e5e None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:36.449619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-24ea56e5-5a96-4c8c-97bc-03de658d1e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:36.514623 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 976/1948] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:36.522911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816165de-432e-4ad8-8468-c796ba2b82ac None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:36.523191 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816165de-432e-4ad8-8468-c796ba2b82ac None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:36.523496 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816165de-432e-4ad8-8468-c796ba2b82ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:36.541726 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-816165de-432e-4ad8-8468-c796ba2b82ac None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:36.543065 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-816165de-432e-4ad8-8468-c796ba2b82ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:36.551485 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 973/1949] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:36.556433 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea56e5-5a96-4c8c-97bc-03de658d1e5e None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:36.566540 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea56e5-5a96-4c8c-97bc-03de658d1e5e None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:36.571802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719dac0b-a1a3-4673-be7d-2e7d46ff3bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:36.572633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dac0b-a1a3-4673-be7d-2e7d46ff3bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:36.572917 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dac0b-a1a3-4673-be7d-2e7d46ff3bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:36.573192 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dac0b-a1a3-4673-be7d-2e7d46ff3bf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:36.574103 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719dac0b-a1a3-4673-be7d-2e7d46ff3bf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:02:36.574399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719dac0b-a1a3-4673-be7d-2e7d46ff3bf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:36.576198 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719dac0b-a1a3-4673-be7d-2e7d46ff3bf1 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:36.588601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 977/1950] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:02:36.593131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816165de-432e-4ad8-8468-c796ba2b82ac None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:36.603005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816165de-432e-4ad8-8468-c796ba2b82ac None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:36.607412 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2180a8-876f-408e-9159-cac5e7e1c91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:36.608073 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2180a8-876f-408e-9159-cac5e7e1c91e admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:36.608351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2180a8-876f-408e-9159-cac5e7e1c91e admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:36.608621 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2180a8-876f-408e-9159-cac5e7e1c91e admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:36.609304 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2180a8-876f-408e-9159-cac5e7e1c91e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:36.611207 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2180a8-876f-408e-9159-cac5e7e1c91e admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:36.644198 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 974/1951] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:02:36 2022] POST /identity/v3/projects => generated 409 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:36.645286 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719dac0b-a1a3-4673-be7d-2e7d46ff3bf1 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:36.655368 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719dac0b-a1a3-4673-be7d-2e7d46ff3bf1 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:36.716468 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb52dd-8d1c-4434-9609-ff7298d54ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:36.717286 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb52dd-8d1c-4434-9609-ff7298d54ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:36.719182 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb52dd-8d1c-4434-9609-ff7298d54ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:36.719182 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb52dd-8d1c-4434-9609-ff7298d54ca7 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:36.719182 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb52dd-8d1c-4434-9609-ff7298d54ca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:36.727572 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb52dd-8d1c-4434-9609-ff7298d54ca7 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:36.750421 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 978/1952] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:02:36 2022] POST /identity/v3/users => generated 305 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:36.755142 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2180a8-876f-408e-9159-cac5e7e1c91e admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:36.773395 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2180a8-876f-408e-9159-cac5e7e1c91e admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:36.778770 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30eb52e-ba87-4321-b9a6-ab84f9ef0a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:36.779410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30eb52e-ba87-4321-b9a6-ab84f9ef0a2a admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:36.779740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30eb52e-ba87-4321-b9a6-ab84f9ef0a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:36.780018 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30eb52e-ba87-4321-b9a6-ab84f9ef0a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:36.782228 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30eb52e-ba87-4321-b9a6-ab84f9ef0a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:36.789246 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30eb52e-ba87-4321-b9a6-ab84f9ef0a2a admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:36.804084 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 975/1953] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:36.809773 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb52dd-8d1c-4434-9609-ff7298d54ca7 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:36.827757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb52dd-8d1c-4434-9609-ff7298d54ca7 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:36.838514 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ef8bd-8ed4-4156-9843-d686078a124b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:36.839217 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ef8bd-8ed4-4156-9843-d686078a124b admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:36.839503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ef8bd-8ed4-4156-9843-d686078a124b admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:36.839851 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ef8bd-8ed4-4156-9843-d686078a124b admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:36.843160 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ef8bd-8ed4-4156-9843-d686078a124b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:36.845124 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ef8bd-8ed4-4156-9843-d686078a124b admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:36.864016 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 979/1954] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:36.868801 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30eb52e-ba87-4321-b9a6-ab84f9ef0a2a admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:36.879059 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30eb52e-ba87-4321-b9a6-ab84f9ef0a2a admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:36.886211 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bc39e-123a-4f88-b392-fcc848e61eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:36.887125 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bc39e-123a-4f88-b392-fcc848e61eca admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:36.887402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bc39e-123a-4f88-b392-fcc848e61eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:36.887779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bc39e-123a-4f88-b392-fcc848e61eca admin admin] PATH_INFO: `/v3/projects/c9e0f039fe4d4d4294bdb98ac9ae8471/users/a7ac92c057c54eac98a33997a0e8e400/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:36.906735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bc39e-123a-4f88-b392-fcc848e61eca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e0f039fe4d4d4294bdb98ac9ae8471, user_id=a7ac92c057c54eac98a33997a0e8e400, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:36.909515 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bc39e-123a-4f88-b392-fcc848e61eca admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:36.933489 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 976/1955] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:02:36 2022] PUT /identity/v3/projects/c9e0f039fe4d4d4294bdb98ac9ae8471/users/a7ac92c057c54eac98a33997a0e8e400/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:36.945156 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8584bc-dfad-42c8-a5e9-b723e12b12a7 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:36.945470 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8584bc-dfad-42c8-a5e9-b723e12b12a7 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:36.945732 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8584bc-dfad-42c8-a5e9-b723e12b12a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:36.979491 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-ef8584bc-dfad-42c8-a5e9-b723e12b12a7 None None] MFA Rules not processed for user `a7ac92c057c54eac98a33997a0e8e400`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:36.980725 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-ef8584bc-dfad-42c8-a5e9-b723e12b12a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:37.080763 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 980/1956] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:36 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:37.085647 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bc39e-123a-4f88-b392-fcc848e61eca admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:37.169067 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bc39e-123a-4f88-b392-fcc848e61eca admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:37.175951 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c38d6-59eb-498a-b34a-3009b1d3a7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:37.176760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c38d6-59eb-498a-b34a-3009b1d3a7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:37.177976 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c38d6-59eb-498a-b34a-3009b1d3a7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:37.179045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c38d6-59eb-498a-b34a-3009b1d3a7d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:37.180055 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c38d6-59eb-498a-b34a-3009b1d3a7d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:37.182148 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c38d6-59eb-498a-b34a-3009b1d3a7d0 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:37.229885 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 977/1957] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:02:37 2022] POST /identity/v3/projects => generated 409 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:02:37.231960 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8584bc-dfad-42c8-a5e9-b723e12b12a7 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:37.250293 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8584bc-dfad-42c8-a5e9-b723e12b12a7 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:37.368721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4d906-9264-4cd6-8741-597ce616f603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:37.369687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4d906-9264-4cd6-8741-597ce616f603 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:37.369687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4d906-9264-4cd6-8741-597ce616f603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:37.370039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4d906-9264-4cd6-8741-597ce616f603 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:37.370763 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4d906-9264-4cd6-8741-597ce616f603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:37.374240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4d906-9264-4cd6-8741-597ce616f603 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:37.406249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 981/1958] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:02:37 2022] POST /identity/v3/users => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:37.413205 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c38d6-59eb-498a-b34a-3009b1d3a7d0 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:37.425967 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c38d6-59eb-498a-b34a-3009b1d3a7d0 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:37.433843 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3abb74-fc97-4d66-939e-cbfb6656c8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:37.434577 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3abb74-fc97-4d66-939e-cbfb6656c8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:37.434865 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3abb74-fc97-4d66-939e-cbfb6656c8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:37.435578 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3abb74-fc97-4d66-939e-cbfb6656c8b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:37.436625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3abb74-fc97-4d66-939e-cbfb6656c8b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:37.438525 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3abb74-fc97-4d66-939e-cbfb6656c8b6 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:37.450669 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 978/1959] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:37.455109 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4d906-9264-4cd6-8741-597ce616f603 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:37.466891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4d906-9264-4cd6-8741-597ce616f603 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:37.471707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9f948-e236-4d50-90d6-be3a7f626a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:37.472637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9f948-e236-4d50-90d6-be3a7f626a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:37.472920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9f948-e236-4d50-90d6-be3a7f626a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:37.473195 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9f948-e236-4d50-90d6-be3a7f626a16 admin admin] PATH_INFO: `/v3/projects/4a3e33c5c069498ea74095d4fe1af5e9/users/47fc7c78ecf9446ebbb82abccec694dd/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:37.489441 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9f948-e236-4d50-90d6-be3a7f626a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a3e33c5c069498ea74095d4fe1af5e9, user_id=47fc7c78ecf9446ebbb82abccec694dd, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:37.493024 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9f948-e236-4d50-90d6-be3a7f626a16 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:37.509856 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 982/1960] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:02:37 2022] PUT /identity/v3/projects/4a3e33c5c069498ea74095d4fe1af5e9/users/47fc7c78ecf9446ebbb82abccec694dd/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:37.514289 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3abb74-fc97-4d66-939e-cbfb6656c8b6 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:37.524363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3abb74-fc97-4d66-939e-cbfb6656c8b6 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:37.596941 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c7705-fee1-4ff3-8ce6-c8126772a000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:37.597643 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c7705-fee1-4ff3-8ce6-c8126772a000 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:37.597962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c7705-fee1-4ff3-8ce6-c8126772a000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:37.598276 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c7705-fee1-4ff3-8ce6-c8126772a000 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:37.599581 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c7705-fee1-4ff3-8ce6-c8126772a000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:37.601211 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c7705-fee1-4ff3-8ce6-c8126772a000 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:37.612489 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 979/1961] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:37.618169 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9f948-e236-4d50-90d6-be3a7f626a16 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:37.630081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9f948-e236-4d50-90d6-be3a7f626a16 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:37.636665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ac391-8638-497d-bca0-e1bd31613763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:37.637437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ac391-8638-497d-bca0-e1bd31613763 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:37.637762 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ac391-8638-497d-bca0-e1bd31613763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:37.638097 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ac391-8638-497d-bca0-e1bd31613763 admin admin] PATH_INFO: `/v3/projects/4a3e33c5c069498ea74095d4fe1af5e9/users/47fc7c78ecf9446ebbb82abccec694dd/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:37.640132 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ac391-8638-497d-bca0-e1bd31613763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a3e33c5c069498ea74095d4fe1af5e9, user_id=47fc7c78ecf9446ebbb82abccec694dd, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:37.644195 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ac391-8638-497d-bca0-e1bd31613763 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:37.660511 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 983/1962] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:02:37 2022] PUT /identity/v3/projects/4a3e33c5c069498ea74095d4fe1af5e9/users/47fc7c78ecf9446ebbb82abccec694dd/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:37.673299 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98354ec-5ae2-4287-8175-98f3836f90cf None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:37.673591 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98354ec-5ae2-4287-8175-98f3836f90cf None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:37.673884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98354ec-5ae2-4287-8175-98f3836f90cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:37.710291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-e98354ec-5ae2-4287-8175-98f3836f90cf None None] MFA Rules not processed for user `47fc7c78ecf9446ebbb82abccec694dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:37.711621 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-e98354ec-5ae2-4287-8175-98f3836f90cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:37.859361 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 980/1963] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:02:37 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:37.876412 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ac391-8638-497d-bca0-e1bd31613763 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:37.878462 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-205ac391-8638-497d-bca0-e1bd31613763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:37.986472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ac391-8638-497d-bca0-e1bd31613763 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:38.000685 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac194926-fba0-4ea2-8342-2b73012d7681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:38.002161 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac194926-fba0-4ea2-8342-2b73012d7681 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:38.002485 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac194926-fba0-4ea2-8342-2b73012d7681 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:38.002933 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac194926-fba0-4ea2-8342-2b73012d7681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:38.016528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac194926-fba0-4ea2-8342-2b73012d7681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:38.018182 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac194926-fba0-4ea2-8342-2b73012d7681 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:38.039711 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 984/1964] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:37 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:38.748587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98354ec-5ae2-4287-8175-98f3836f90cf None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:38.759238 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98354ec-5ae2-4287-8175-98f3836f90cf None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:38.774679 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9270c5-f251-4c2c-89bb-49d0e842439e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:38.775569 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9270c5-f251-4c2c-89bb-49d0e842439e service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:38.775853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9270c5-f251-4c2c-89bb-49d0e842439e service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:38.776312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9270c5-f251-4c2c-89bb-49d0e842439e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:38.893858 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9270c5-f251-4c2c-89bb-49d0e842439e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:38.895606 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9270c5-f251-4c2c-89bb-49d0e842439e service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:38.907039 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 981/1965] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:02:38 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:09.833485 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac194926-fba0-4ea2-8342-2b73012d7681 service cinder] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:09.914452 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac194926-fba0-4ea2-8342-2b73012d7681 service cinder] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:09.919362 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a97e0-dde3-4772-9f61-7bf3be53e22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:09.920241 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a97e0-dde3-4772-9f61-7bf3be53e22e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:09.920523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a97e0-dde3-4772-9f61-7bf3be53e22e admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:09.920799 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a97e0-dde3-4772-9f61-7bf3be53e22e admin admin] PATH_INFO: `/v3/users/a7ac92c057c54eac98a33997a0e8e400` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:09.922001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a97e0-dde3-4772-9f61-7bf3be53e22e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7ac92c057c54eac98a33997a0e8e400)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:09.923963 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a97e0-dde3-4772-9f61-7bf3be53e22e admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:09.976802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-de2a97e0-dde3-4772-9f61-7bf3be53e22e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7ac92c057c54eac98a33997a0e8e400'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:09.977779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-de2a97e0-dde3-4772-9f61-7bf3be53e22e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7ac92c057c54eac98a33997a0e8e400'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:09.990092 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-de2a97e0-dde3-4772-9f61-7bf3be53e22e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7ac92c057c54eac98a33997a0e8e400'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:09.999833 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9270c5-f251-4c2c-89bb-49d0e842439e service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:10.000742 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-de2a97e0-dde3-4772-9f61-7bf3be53e22e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7ac92c057c54eac98a33997a0e8e400'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:10.001363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-bc9270c5-f251-4c2c-89bb-49d0e842439e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:10.007873 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-de2a97e0-dde3-4772-9f61-7bf3be53e22e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7ac92c057c54eac98a33997a0e8e400'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:10.014879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 985/1966] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:09 2022] DELETE /identity/v3/users/a7ac92c057c54eac98a33997a0e8e400 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:10.015474 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9270c5-f251-4c2c-89bb-49d0e842439e service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:10.019143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5b929-b3c0-4b03-98ed-9b4e86405af9 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:10.019463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5b929-b3c0-4b03-98ed-9b4e86405af9 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:10.019704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5b929-b3c0-4b03-98ed-9b4e86405af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:10.039000 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-e8c5b929-b3c0-4b03-98ed-9b4e86405af9 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:10.040330 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-e8c5b929-b3c0-4b03-98ed-9b4e86405af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:10.076484 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f0c44-355d-4c15-9e1c-0f30800642d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:10.077569 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f0c44-355d-4c15-9e1c-0f30800642d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:10.077864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f0c44-355d-4c15-9e1c-0f30800642d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:10.078176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f0c44-355d-4c15-9e1c-0f30800642d3 admin admin] PATH_INFO: `/v3/users/a2b3cb74e3b64d87903eb933adb4c01f` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:10.079469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f0c44-355d-4c15-9e1c-0f30800642d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2b3cb74e3b64d87903eb933adb4c01f)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:10.081510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f0c44-355d-4c15-9e1c-0f30800642d3 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:10.109803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 986/1967] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:10.122041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5b929-b3c0-4b03-98ed-9b4e86405af9 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:10.123624 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-e8c5b929-b3c0-4b03-98ed-9b4e86405af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:10.141012 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ae5f0c44-355d-4c15-9e1c-0f30800642d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2b3cb74e3b64d87903eb933adb4c01f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:10.149537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ae5f0c44-355d-4c15-9e1c-0f30800642d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2b3cb74e3b64d87903eb933adb4c01f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:10.161724 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ae5f0c44-355d-4c15-9e1c-0f30800642d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2b3cb74e3b64d87903eb933adb4c01f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:10.162453 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ae5f0c44-355d-4c15-9e1c-0f30800642d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2b3cb74e3b64d87903eb933adb4c01f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:10.163065 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-ae5f0c44-355d-4c15-9e1c-0f30800642d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2b3cb74e3b64d87903eb933adb4c01f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:10.176812 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 982/1968] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:09 2022] DELETE /identity/v3/users/a2b3cb74e3b64d87903eb933adb4c01f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:10.181691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae0c55-083b-4504-956f-ad4be29871d7 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:10.181998 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae0c55-083b-4504-956f-ad4be29871d7 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:10.182324 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae0c55-083b-4504-956f-ad4be29871d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:10.192134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5b929-b3c0-4b03-98ed-9b4e86405af9 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:10.203550 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-74ae0c55-083b-4504-956f-ad4be29871d7 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:10.204734 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-74ae0c55-083b-4504-956f-ad4be29871d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:10.248335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a511b75-2303-4fd0-839e-f331bf57f90a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:10.249305 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a511b75-2303-4fd0-839e-f331bf57f90a service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:10.249795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a511b75-2303-4fd0-839e-f331bf57f90a service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:10.250277 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a511b75-2303-4fd0-839e-f331bf57f90a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:10.252286 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-1a511b75-2303-4fd0-839e-f331bf57f90a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:10.270044 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 983/1969] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:10.287093 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae0c55-083b-4504-956f-ad4be29871d7 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:10.291121 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-74ae0c55-083b-4504-956f-ad4be29871d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:10.305697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae0c55-083b-4504-956f-ad4be29871d7 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:10.311440 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7760f-a454-4cf5-b0b9-2b6b2606eb1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:10.312207 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7760f-a454-4cf5-b0b9-2b6b2606eb1d service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:10.312491 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7760f-a454-4cf5-b0b9-2b6b2606eb1d service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:10.312766 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7760f-a454-4cf5-b0b9-2b6b2606eb1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:10.320768 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a511b75-2303-4fd0-839e-f331bf57f90a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:10.322157 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a511b75-2303-4fd0-839e-f331bf57f90a service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:10.324535 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7760f-a454-4cf5-b0b9-2b6b2606eb1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:10.326458 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7760f-a454-4cf5-b0b9-2b6b2606eb1d service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:10.332917 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 987/1970] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:10.339168 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 984/1971] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:03:10.716559 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a511b75-2303-4fd0-839e-f331bf57f90a service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:10.717694 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-1a511b75-2303-4fd0-839e-f331bf57f90a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:10.731791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a511b75-2303-4fd0-839e-f331bf57f90a service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:10.738404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0da549-82b6-4893-95d0-87658516dc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:10.739229 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0da549-82b6-4893-95d0-87658516dc3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:10.739514 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0da549-82b6-4893-95d0-87658516dc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:10.739795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0da549-82b6-4893-95d0-87658516dc3d admin admin] PATH_INFO: `/v3/projects/d51c734a200d41d4aaa833b515aed47a` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:10.741090 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0da549-82b6-4893-95d0-87658516dc3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51c734a200d41d4aaa833b515aed47a)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:10.743887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0da549-82b6-4893-95d0-87658516dc3d admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:10.759918 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7760f-a454-4cf5-b0b9-2b6b2606eb1d service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:10.762624 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-5ed7760f-a454-4cf5-b0b9-2b6b2606eb1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:10.790692 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7760f-a454-4cf5-b0b9-2b6b2606eb1d service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:10.802155 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8c6dc-f8a5-417a-8aca-f3a1233b7795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:10.805059 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8c6dc-f8a5-417a-8aca-f3a1233b7795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:10.805355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8c6dc-f8a5-417a-8aca-f3a1233b7795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:10.805638 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8c6dc-f8a5-417a-8aca-f3a1233b7795 admin admin] PATH_INFO: `/v3/projects/c9e0f039fe4d4d4294bdb98ac9ae8471` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:10.808646 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8c6dc-f8a5-417a-8aca-f3a1233b7795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9e0f039fe4d4d4294bdb98ac9ae8471)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:10.812907 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8c6dc-f8a5-417a-8aca-f3a1233b7795 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:10.827010 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-de0da549-82b6-4893-95d0-87658516dc3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51c734a200d41d4aaa833b515aed47a', 'request_id': 'req-de0da549-82b6-4893-95d0-87658516dc3d'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:10.838692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-de0da549-82b6-4893-95d0-87658516dc3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51c734a200d41d4aaa833b515aed47a', 'request_id': 'req-de0da549-82b6-4893-95d0-87658516dc3d'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:10.845253 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-de0da549-82b6-4893-95d0-87658516dc3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51c734a200d41d4aaa833b515aed47a', 'request_id': 'req-de0da549-82b6-4893-95d0-87658516dc3d'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:10.862734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-de0da549-82b6-4893-95d0-87658516dc3d admin admin] The token cache is being invalidate because project d51c734a200d41d4aaa833b515aed47a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:10.863214 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-de0da549-82b6-4893-95d0-87658516dc3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:10.864429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-de0da549-82b6-4893-95d0-87658516dc3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:10.866166 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 988/1972] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:10 2022] DELETE /identity/v3/projects/d51c734a200d41d4aaa833b515aed47a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:10.870849 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0da549-82b6-4893-95d0-87658516dc3d admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:10.872461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-de0da549-82b6-4893-95d0-87658516dc3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:10.887054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b8d8c6dc-f8a5-417a-8aca-f3a1233b7795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9e0f039fe4d4d4294bdb98ac9ae8471', 'request_id': 'req-b8d8c6dc-f8a5-417a-8aca-f3a1233b7795'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:10.894869 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b8d8c6dc-f8a5-417a-8aca-f3a1233b7795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9e0f039fe4d4d4294bdb98ac9ae8471', 'request_id': 'req-b8d8c6dc-f8a5-417a-8aca-f3a1233b7795'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:10.907870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b8d8c6dc-f8a5-417a-8aca-f3a1233b7795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9e0f039fe4d4d4294bdb98ac9ae8471', 'request_id': 'req-b8d8c6dc-f8a5-417a-8aca-f3a1233b7795'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:10.925072 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b8d8c6dc-f8a5-417a-8aca-f3a1233b7795 admin admin] The token cache is being invalidate because project c9e0f039fe4d4d4294bdb98ac9ae8471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:10.925364 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b8d8c6dc-f8a5-417a-8aca-f3a1233b7795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:10.926619 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b8d8c6dc-f8a5-417a-8aca-f3a1233b7795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:10.928250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 985/1973] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:10 2022] DELETE /identity/v3/projects/c9e0f039fe4d4d4294bdb98ac9ae8471 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:10.933411 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8c6dc-f8a5-417a-8aca-f3a1233b7795 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:10.936003 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b8d8c6dc-f8a5-417a-8aca-f3a1233b7795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:10.976810 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0da549-82b6-4893-95d0-87658516dc3d admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:11.019402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8c6dc-f8a5-417a-8aca-f3a1233b7795 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:11.024287 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3340c0c-d104-4e9c-a1be-05eef25aaec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:11.025204 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3340c0c-d104-4e9c-a1be-05eef25aaec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:11.025442 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3340c0c-d104-4e9c-a1be-05eef25aaec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:11.025712 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3340c0c-d104-4e9c-a1be-05eef25aaec3 admin admin] PATH_INFO: `/v3/users/47fc7c78ecf9446ebbb82abccec694dd` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:11.026924 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3340c0c-d104-4e9c-a1be-05eef25aaec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47fc7c78ecf9446ebbb82abccec694dd)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:11.029030 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3340c0c-d104-4e9c-a1be-05eef25aaec3 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:11.061859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cc935-6b00-4bd6-acf0-74d392f3634d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:11.062743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cc935-6b00-4bd6-acf0-74d392f3634d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:11.063026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cc935-6b00-4bd6-acf0-74d392f3634d admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:11.063301 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cc935-6b00-4bd6-acf0-74d392f3634d admin admin] PATH_INFO: `/v3/users/82ab2ff063094082b751b54d87de731a` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:11.064575 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cc935-6b00-4bd6-acf0-74d392f3634d admin admin] RBAC: Authorizing `identity:delete_user(user_id=82ab2ff063094082b751b54d87de731a)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:11.066744 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cc935-6b00-4bd6-acf0-74d392f3634d admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:11.088470 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f3340c0c-d104-4e9c-a1be-05eef25aaec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47fc7c78ecf9446ebbb82abccec694dd'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:11.096487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f3340c0c-d104-4e9c-a1be-05eef25aaec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47fc7c78ecf9446ebbb82abccec694dd'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:11.111102 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f3340c0c-d104-4e9c-a1be-05eef25aaec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47fc7c78ecf9446ebbb82abccec694dd'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:11.112159 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f3340c0c-d104-4e9c-a1be-05eef25aaec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47fc7c78ecf9446ebbb82abccec694dd'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:11.113114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f3340c0c-d104-4e9c-a1be-05eef25aaec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47fc7c78ecf9446ebbb82abccec694dd'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:11.120252 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f46cc935-6b00-4bd6-acf0-74d392f3634d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82ab2ff063094082b751b54d87de731a'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:11.121169 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f46cc935-6b00-4bd6-acf0-74d392f3634d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82ab2ff063094082b751b54d87de731a'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:11.128044 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 986/1974] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:10 2022] DELETE /identity/v3/users/47fc7c78ecf9446ebbb82abccec694dd => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:11.138601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f46cc935-6b00-4bd6-acf0-74d392f3634d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82ab2ff063094082b751b54d87de731a'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:11.146758 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f46cc935-6b00-4bd6-acf0-74d392f3634d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82ab2ff063094082b751b54d87de731a'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:11.154899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f46cc935-6b00-4bd6-acf0-74d392f3634d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82ab2ff063094082b751b54d87de731a'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:11.161025 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 989/1975] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:10 2022] DELETE /identity/v3/users/82ab2ff063094082b751b54d87de731a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:11.471890 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3340c0c-d104-4e9c-a1be-05eef25aaec3 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:11.473349 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-f3340c0c-d104-4e9c-a1be-05eef25aaec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:11.555303 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cc935-6b00-4bd6-acf0-74d392f3634d admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:11.556780 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f46cc935-6b00-4bd6-acf0-74d392f3634d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:11.579895 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3340c0c-d104-4e9c-a1be-05eef25aaec3 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:11.635336 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cc935-6b00-4bd6-acf0-74d392f3634d admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:11.642116 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fc49c-71f9-414e-8ac5-737efa67f972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:11.643013 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fc49c-71f9-414e-8ac5-737efa67f972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:11.643299 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fc49c-71f9-414e-8ac5-737efa67f972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:11.643575 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fc49c-71f9-414e-8ac5-737efa67f972 admin admin] PATH_INFO: `/v3/projects/90fe3efd0ca04f57b3e9bbde65e7e533` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:11.644757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930fc49c-71f9-414e-8ac5-737efa67f972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90fe3efd0ca04f57b3e9bbde65e7e533)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:11.646461 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1448e98-a534-4cf9-843c-0764aaddda1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:11.646699 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930fc49c-71f9-414e-8ac5-737efa67f972 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:11.647322 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1448e98-a534-4cf9-843c-0764aaddda1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:11.648201 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1448e98-a534-4cf9-843c-0764aaddda1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:11.648606 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1448e98-a534-4cf9-843c-0764aaddda1f admin admin] PATH_INFO: `/v3/projects/4a3e33c5c069498ea74095d4fe1af5e9` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:11.649866 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1448e98-a534-4cf9-843c-0764aaddda1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a3e33c5c069498ea74095d4fe1af5e9)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:11.651817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1448e98-a534-4cf9-843c-0764aaddda1f admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:11.701059 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-930fc49c-71f9-414e-8ac5-737efa67f972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90fe3efd0ca04f57b3e9bbde65e7e533', 'request_id': 'req-930fc49c-71f9-414e-8ac5-737efa67f972'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:11.707676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-930fc49c-71f9-414e-8ac5-737efa67f972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90fe3efd0ca04f57b3e9bbde65e7e533', 'request_id': 'req-930fc49c-71f9-414e-8ac5-737efa67f972'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:11.723444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-930fc49c-71f9-414e-8ac5-737efa67f972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90fe3efd0ca04f57b3e9bbde65e7e533', 'request_id': 'req-930fc49c-71f9-414e-8ac5-737efa67f972'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:11.727389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b1448e98-a534-4cf9-843c-0764aaddda1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a3e33c5c069498ea74095d4fe1af5e9', 'request_id': 'req-b1448e98-a534-4cf9-843c-0764aaddda1f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:11.733349 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b1448e98-a534-4cf9-843c-0764aaddda1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a3e33c5c069498ea74095d4fe1af5e9', 'request_id': 'req-b1448e98-a534-4cf9-843c-0764aaddda1f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:11.744091 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-930fc49c-71f9-414e-8ac5-737efa67f972 admin admin] The token cache is being invalidate because project 90fe3efd0ca04f57b3e9bbde65e7e533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:11.744091 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-930fc49c-71f9-414e-8ac5-737efa67f972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:11.744342 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b1448e98-a534-4cf9-843c-0764aaddda1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a3e33c5c069498ea74095d4fe1af5e9', 'request_id': 'req-b1448e98-a534-4cf9-843c-0764aaddda1f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:11.744456 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-930fc49c-71f9-414e-8ac5-737efa67f972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:11.744456 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 990/1976] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:11 2022] DELETE /identity/v3/projects/90fe3efd0ca04f57b3e9bbde65e7e533 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:11.755080 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b1448e98-a534-4cf9-843c-0764aaddda1f admin admin] The token cache is being invalidate because project 4a3e33c5c069498ea74095d4fe1af5e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:11.755443 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b1448e98-a534-4cf9-843c-0764aaddda1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:11.756126 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b1448e98-a534-4cf9-843c-0764aaddda1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:11.758247 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 987/1977] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:11 2022] DELETE /identity/v3/projects/4a3e33c5c069498ea74095d4fe1af5e9 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:11.762727 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787ddf8-dd35-49a1-bb51-e26b9d0f87bf None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:11.763165 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787ddf8-dd35-49a1-bb51-e26b9d0f87bf None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:11.763402 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0d014-a540-4fb2-9d79-4cda167cd548 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:11.763787 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0d014-a540-4fb2-9d79-4cda167cd548 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:11.764016 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787ddf8-dd35-49a1-bb51-e26b9d0f87bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:11.764243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0d014-a540-4fb2-9d79-4cda167cd548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:11.790427 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-c9e0d014-a540-4fb2-9d79-4cda167cd548 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:11.794639 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-d787ddf8-dd35-49a1-bb51-e26b9d0f87bf None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:11.795764 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c9e0d014-a540-4fb2-9d79-4cda167cd548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:11.795887 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-d787ddf8-dd35-49a1-bb51-e26b9d0f87bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:11.863946 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 988/1978] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:11.870088 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 991/1979] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:11.876096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4630bb-d3aa-4a51-a799-8182cc2ba032 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:11.876532 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4630bb-d3aa-4a51-a799-8182cc2ba032 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:11.876790 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4630bb-d3aa-4a51-a799-8182cc2ba032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:11.878128 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2ee66-028c-435a-bb98-69d737d75a4d None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:11.878563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2ee66-028c-435a-bb98-69d737d75a4d None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:11.879125 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2ee66-028c-435a-bb98-69d737d75a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:11.895577 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-cd4630bb-d3aa-4a51-a799-8182cc2ba032 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:11.896760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-85e2ee66-028c-435a-bb98-69d737d75a4d None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:11.896874 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-cd4630bb-d3aa-4a51-a799-8182cc2ba032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:11.897935 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-85e2ee66-028c-435a-bb98-69d737d75a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:11.904621 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 989/1980] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:11.909383 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 992/1981] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:11.909530 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4630bb-d3aa-4a51-a799-8182cc2ba032 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:11.910340 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2ee66-028c-435a-bb98-69d737d75a4d None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:11.918706 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4630bb-d3aa-4a51-a799-8182cc2ba032 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:11.919979 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2ee66-028c-435a-bb98-69d737d75a4d None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:11.923329 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7990aa-e4a3-43ff-8883-a116134d2606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:11.923981 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7990aa-e4a3-43ff-8883-a116134d2606 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:11.924261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7990aa-e4a3-43ff-8883-a116134d2606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:11.924530 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7990aa-e4a3-43ff-8883-a116134d2606 admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:11.924691 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a80bec-8697-4c61-809a-6901e52b90a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:11.925251 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7990aa-e4a3-43ff-8883-a116134d2606 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:03:11.925352 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a80bec-8697-4c61-809a-6901e52b90a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:11.925554 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7990aa-e4a3-43ff-8883-a116134d2606 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:11.925651 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a80bec-8697-4c61-809a-6901e52b90a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:11.925858 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a80bec-8697-4c61-809a-6901e52b90a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:11.926608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a80bec-8697-4c61-809a-6901e52b90a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:03:11.926910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a80bec-8697-4c61-809a-6901e52b90a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:11.927188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7990aa-e4a3-43ff-8883-a116134d2606 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:11.928580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a80bec-8697-4c61-809a-6901e52b90a2 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:11.939268 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 990/1982] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:03:11.941235 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 993/1983] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:03:11.943423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7990aa-e4a3-43ff-8883-a116134d2606 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:11.945397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a80bec-8697-4c61-809a-6901e52b90a2 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:11.953427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7990aa-e4a3-43ff-8883-a116134d2606 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:11.956499 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a80bec-8697-4c61-809a-6901e52b90a2 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:11.958504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531c94a-441c-4157-aa6a-daca863fe624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:11.959157 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531c94a-441c-4157-aa6a-daca863fe624 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:11.959436 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531c94a-441c-4157-aa6a-daca863fe624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:11.959788 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531c94a-441c-4157-aa6a-daca863fe624 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:11.960792 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531c94a-441c-4157-aa6a-daca863fe624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:11.963103 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531c94a-441c-4157-aa6a-daca863fe624 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:11.968230 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683273c3-6d33-4b21-9013-72e86474f9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:11.969115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683273c3-6d33-4b21-9013-72e86474f9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:11.969398 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683273c3-6d33-4b21-9013-72e86474f9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:11.969799 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683273c3-6d33-4b21-9013-72e86474f9e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:11.970796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683273c3-6d33-4b21-9013-72e86474f9e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:11.974830 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683273c3-6d33-4b21-9013-72e86474f9e2 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:12.005641 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 991/1984] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:11 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:12.009783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531c94a-441c-4157-aa6a-daca863fe624 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:12.016441 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 994/1985] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:11 2022] POST /identity/v3/projects => generated 363 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:12.023526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683273c3-6d33-4b21-9013-72e86474f9e2 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:12.086807 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531c94a-441c-4157-aa6a-daca863fe624 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:12.092296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33ec9f-c9b4-4a1c-a294-1224a66e78da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:12.093015 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33ec9f-c9b4-4a1c-a294-1224a66e78da admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:12.093330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33ec9f-c9b4-4a1c-a294-1224a66e78da admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:12.093595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33ec9f-c9b4-4a1c-a294-1224a66e78da admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:12.096115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683273c3-6d33-4b21-9013-72e86474f9e2 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:12.096242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33ec9f-c9b4-4a1c-a294-1224a66e78da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:12.100380 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27162d1-d830-4846-8c2c-c34aba5a13bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:12.101083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27162d1-d830-4846-8c2c-c34aba5a13bf admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:12.101419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27162d1-d830-4846-8c2c-c34aba5a13bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:12.101861 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27162d1-d830-4846-8c2c-c34aba5a13bf admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:12.102625 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27162d1-d830-4846-8c2c-c34aba5a13bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:12.104499 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27162d1-d830-4846-8c2c-c34aba5a13bf admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:12.106367 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33ec9f-c9b4-4a1c-a294-1224a66e78da admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:12.128796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 995/1986] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:12 2022] POST /identity/v3/users => generated 282 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:12.135957 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27162d1-d830-4846-8c2c-c34aba5a13bf admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:12.136880 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 992/1987] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:12 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:12.142338 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33ec9f-c9b4-4a1c-a294-1224a66e78da admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:12.147591 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27162d1-d830-4846-8c2c-c34aba5a13bf admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:12.154019 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df9075-7968-47ee-916b-ba44fd5c261a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:12.154418 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33ec9f-c9b4-4a1c-a294-1224a66e78da admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:12.154735 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df9075-7968-47ee-916b-ba44fd5c261a admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:12.155020 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df9075-7968-47ee-916b-ba44fd5c261a admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:12.155293 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df9075-7968-47ee-916b-ba44fd5c261a admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:12.156062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df9075-7968-47ee-916b-ba44fd5c261a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:12.157580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df9075-7968-47ee-916b-ba44fd5c261a admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:12.159491 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606e332-f850-4b36-8e5b-30793b60b8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:12.160152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606e332-f850-4b36-8e5b-30793b60b8fc admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:12.160434 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606e332-f850-4b36-8e5b-30793b60b8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:12.160738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606e332-f850-4b36-8e5b-30793b60b8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:12.161473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606e332-f850-4b36-8e5b-30793b60b8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:12.163089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606e332-f850-4b36-8e5b-30793b60b8fc admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:12.168677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 996/1988] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:12.173321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df9075-7968-47ee-916b-ba44fd5c261a admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:12.180664 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 993/1989] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:03:12.184946 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606e332-f850-4b36-8e5b-30793b60b8fc admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:12.190255 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df9075-7968-47ee-916b-ba44fd5c261a admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:12.195615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606e332-f850-4b36-8e5b-30793b60b8fc admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:12.195788 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc1cac-7e11-43c9-ba22-72b0c31138b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:12.196454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc1cac-7e11-43c9-ba22-72b0c31138b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:12.196737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc1cac-7e11-43c9-ba22-72b0c31138b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:12.197011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc1cac-7e11-43c9-ba22-72b0c31138b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:12.197744 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc1cac-7e11-43c9-ba22-72b0c31138b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:12.199357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc1cac-7e11-43c9-ba22-72b0c31138b3 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:12.200320 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493ddfc-0572-4efc-8907-21b0b24c8177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:12.200976 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493ddfc-0572-4efc-8907-21b0b24c8177 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:12.201255 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493ddfc-0572-4efc-8907-21b0b24c8177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:12.201527 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493ddfc-0572-4efc-8907-21b0b24c8177 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:12.202279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493ddfc-0572-4efc-8907-21b0b24c8177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:12.203856 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493ddfc-0572-4efc-8907-21b0b24c8177 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:12.209927 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 997/1990] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:03:12.214144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc1cac-7e11-43c9-ba22-72b0c31138b3 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:12.214728 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 994/1991] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:03:12.218608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493ddfc-0572-4efc-8907-21b0b24c8177 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:12.228591 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc1cac-7e11-43c9-ba22-72b0c31138b3 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:12.228977 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493ddfc-0572-4efc-8907-21b0b24c8177 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:12.233318 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeeb4c3-572d-49e9-bd32-6d47a827c089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:12.233552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b157a1-e1b2-4e07-b76c-63df207fe63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:12.234223 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeeb4c3-572d-49e9-bd32-6d47a827c089 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:12.234463 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b157a1-e1b2-4e07-b76c-63df207fe63e admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:12.234553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeeb4c3-572d-49e9-bd32-6d47a827c089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:12.234753 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b157a1-e1b2-4e07-b76c-63df207fe63e admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:12.234893 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeeb4c3-572d-49e9-bd32-6d47a827c089 admin admin] PATH_INFO: `/v3/projects/f10765e6fb5143b9ab7650ceede266a0/users/fa068711ed344975b8780ce24fd8e6ed/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:12.235033 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b157a1-e1b2-4e07-b76c-63df207fe63e admin admin] PATH_INFO: `/v3/projects/7c584a4943054268b0276af9c9c0dc11/users/2dd40667b1f64be48cb1fbd9cfeeffca/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:12.249886 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeeb4c3-572d-49e9-bd32-6d47a827c089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f10765e6fb5143b9ab7650ceede266a0, user_id=fa068711ed344975b8780ce24fd8e6ed, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:12.250045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b157a1-e1b2-4e07-b76c-63df207fe63e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c584a4943054268b0276af9c9c0dc11, user_id=2dd40667b1f64be48cb1fbd9cfeeffca, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:12.252550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeeb4c3-572d-49e9-bd32-6d47a827c089 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:12.252691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b157a1-e1b2-4e07-b76c-63df207fe63e admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:12.266318 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 998/1992] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:12 2022] PUT /identity/v3/projects/f10765e6fb5143b9ab7650ceede266a0/users/fa068711ed344975b8780ce24fd8e6ed/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:12.276760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 995/1993] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:12 2022] PUT /identity/v3/projects/7c584a4943054268b0276af9c9c0dc11/users/2dd40667b1f64be48cb1fbd9cfeeffca/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:12.278398 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac32de8-dfb1-49ef-8384-866e3ac392a9 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:12.278716 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac32de8-dfb1-49ef-8384-866e3ac392a9 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:12.278997 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac32de8-dfb1-49ef-8384-866e3ac392a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:12.287101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a62ebf-2bb2-4e41-ba89-dcfdcccf7ff4 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:12.287375 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a62ebf-2bb2-4e41-ba89-dcfdcccf7ff4 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:12.287646 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a62ebf-2bb2-4e41-ba89-dcfdcccf7ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:12.306382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-aac32de8-dfb1-49ef-8384-866e3ac392a9 None None] MFA Rules not processed for user `fa068711ed344975b8780ce24fd8e6ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:12.307610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-aac32de8-dfb1-49ef-8384-866e3ac392a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:12.314467 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-91a62ebf-2bb2-4e41-ba89-dcfdcccf7ff4 None None] MFA Rules not processed for user `2dd40667b1f64be48cb1fbd9cfeeffca`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:12.315893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-91a62ebf-2bb2-4e41-ba89-dcfdcccf7ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:12.372147 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 999/1994] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:12 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:12.376818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac32de8-dfb1-49ef-8384-866e3ac392a9 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:12.381886 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 996/1995] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:12.393468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a62ebf-2bb2-4e41-ba89-dcfdcccf7ff4 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:12.394890 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-91a62ebf-2bb2-4e41-ba89-dcfdcccf7ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:12.444061 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac32de8-dfb1-49ef-8384-866e3ac392a9 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:12.449265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec2702-f7cd-4a54-a459-4e6a27cb082d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:12.449932 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec2702-f7cd-4a54-a459-4e6a27cb082d admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:12.450284 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec2702-f7cd-4a54-a459-4e6a27cb082d admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:12.450544 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec2702-f7cd-4a54-a459-4e6a27cb082d admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:12.451235 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec2702-f7cd-4a54-a459-4e6a27cb082d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:12.451615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a62ebf-2bb2-4e41-ba89-dcfdcccf7ff4 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:12.453126 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec2702-f7cd-4a54-a459-4e6a27cb082d admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:12.455301 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cc9c9-d6c3-4fcc-826e-b645065ab165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:12.455945 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cc9c9-d6c3-4fcc-826e-b645065ab165 service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:12.456234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cc9c9-d6c3-4fcc-826e-b645065ab165 service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:12.456501 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cc9c9-d6c3-4fcc-826e-b645065ab165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:12.465152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cc9c9-d6c3-4fcc-826e-b645065ab165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:12.466601 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cc9c9-d6c3-4fcc-826e-b645065ab165 service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:12.475458 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 997/1996] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:03:12.478446 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1000/1997] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:12 2022] POST /identity/v3/projects => generated 361 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:12.482566 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cc9c9-d6c3-4fcc-826e-b645065ab165 service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:12.495129 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cc9c9-d6c3-4fcc-826e-b645065ab165 service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:12.554282 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba6f5c-02ee-4e33-8825-82762c52b54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:12.555178 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba6f5c-02ee-4e33-8825-82762c52b54c admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:12.555461 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba6f5c-02ee-4e33-8825-82762c52b54c admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:12.555739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba6f5c-02ee-4e33-8825-82762c52b54c admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:12.556444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba6f5c-02ee-4e33-8825-82762c52b54c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:12.558599 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba6f5c-02ee-4e33-8825-82762c52b54c admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:12.579992 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 998/1998] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:12 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:12.584069 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec2702-f7cd-4a54-a459-4e6a27cb082d admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:12.596961 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec2702-f7cd-4a54-a459-4e6a27cb082d admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:12.601892 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346a9b9-2a93-450c-914b-72353b92f8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:12.602704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346a9b9-2a93-450c-914b-72353b92f8fa admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:12.603024 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346a9b9-2a93-450c-914b-72353b92f8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:12.603590 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346a9b9-2a93-450c-914b-72353b92f8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:12.604366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346a9b9-2a93-450c-914b-72353b92f8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:12.605939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346a9b9-2a93-450c-914b-72353b92f8fa admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:12.621228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1001/1999] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:12.622946 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba6f5c-02ee-4e33-8825-82762c52b54c admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:12.636741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba6f5c-02ee-4e33-8825-82762c52b54c admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:12.642344 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158693e-0e24-481c-aacb-3d7854f9aa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:12.643288 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158693e-0e24-481c-aacb-3d7854f9aa3e admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:12.643568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158693e-0e24-481c-aacb-3d7854f9aa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:12.643841 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158693e-0e24-481c-aacb-3d7854f9aa3e admin admin] PATH_INFO: `/v3/projects/15970a80e544449bb203ea84ea53c9d1/users/7978ca999d284773b50a6836ad4e5adc/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:12.660254 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158693e-0e24-481c-aacb-3d7854f9aa3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=15970a80e544449bb203ea84ea53c9d1, user_id=7978ca999d284773b50a6836ad4e5adc, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:12.663012 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158693e-0e24-481c-aacb-3d7854f9aa3e admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:12.676020 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 999/2000] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:12 2022] PUT /identity/v3/projects/15970a80e544449bb203ea84ea53c9d1/users/7978ca999d284773b50a6836ad4e5adc/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:12.680800 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346a9b9-2a93-450c-914b-72353b92f8fa admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:12.690809 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346a9b9-2a93-450c-914b-72353b92f8fa admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:12.768342 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56584c1-2626-405e-b33a-5003a91513a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:12.769579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56584c1-2626-405e-b33a-5003a91513a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:12.769872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56584c1-2626-405e-b33a-5003a91513a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:12.770382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56584c1-2626-405e-b33a-5003a91513a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:12.771117 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56584c1-2626-405e-b33a-5003a91513a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:12.773612 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56584c1-2626-405e-b33a-5003a91513a5 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:12.794261 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1002/2001] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:12.795782 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158693e-0e24-481c-aacb-3d7854f9aa3e admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:12.807061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158693e-0e24-481c-aacb-3d7854f9aa3e admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:12.811820 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720264c-2b9b-4397-bcbb-5818f2470966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:12.812784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720264c-2b9b-4397-bcbb-5818f2470966 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:12.813101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720264c-2b9b-4397-bcbb-5818f2470966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:12.813377 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720264c-2b9b-4397-bcbb-5818f2470966 admin admin] PATH_INFO: `/v3/projects/15970a80e544449bb203ea84ea53c9d1/users/7978ca999d284773b50a6836ad4e5adc/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:12.815477 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720264c-2b9b-4397-bcbb-5818f2470966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15970a80e544449bb203ea84ea53c9d1, user_id=7978ca999d284773b50a6836ad4e5adc, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:12.818014 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720264c-2b9b-4397-bcbb-5818f2470966 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:12.829025 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1000/2002] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:12 2022] PUT /identity/v3/projects/15970a80e544449bb203ea84ea53c9d1/users/7978ca999d284773b50a6836ad4e5adc/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:12.841440 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f1756-3523-4908-9762-56bc027cd808 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:12.841809 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f1756-3523-4908-9762-56bc027cd808 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:12.842819 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f1756-3523-4908-9762-56bc027cd808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:12.873253 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-0c5f1756-3523-4908-9762-56bc027cd808 None None] MFA Rules not processed for user `7978ca999d284773b50a6836ad4e5adc`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:12.874710 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-0c5f1756-3523-4908-9762-56bc027cd808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:12.946223 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1003/2003] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:12 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:12.957157 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720264c-2b9b-4397-bcbb-5818f2470966 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:12.959046 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b720264c-2b9b-4397-bcbb-5818f2470966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:13.015920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720264c-2b9b-4397-bcbb-5818f2470966 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:13.019575 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ad9ce-d34d-4b66-980c-a341263ba48e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:13.020213 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ad9ce-d34d-4b66-980c-a341263ba48e service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:13.020499 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ad9ce-d34d-4b66-980c-a341263ba48e service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:13.020773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ad9ce-d34d-4b66-980c-a341263ba48e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:13.030511 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ad9ce-d34d-4b66-980c-a341263ba48e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:13.031946 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ad9ce-d34d-4b66-980c-a341263ba48e service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:13.042090 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1001/2004] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:12 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:13.114191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f1756-3523-4908-9762-56bc027cd808 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:13.124608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f1756-3523-4908-9762-56bc027cd808 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:13.128470 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13940d1-ca88-4565-af4c-f2b80ede7005 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:13.129121 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13940d1-ca88-4565-af4c-f2b80ede7005 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:13.129457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13940d1-ca88-4565-af4c-f2b80ede7005 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:13.129731 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13940d1-ca88-4565-af4c-f2b80ede7005 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:13.190817 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13940d1-ca88-4565-af4c-f2b80ede7005 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:13.192363 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13940d1-ca88-4565-af4c-f2b80ede7005 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:13.206138 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1004/2005] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:13 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:15.920536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ad9ce-d34d-4b66-980c-a341263ba48e service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:15.980625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ad9ce-d34d-4b66-980c-a341263ba48e service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:15.985078 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e09fd-c797-48da-8705-fdd377c5afd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:15.985937 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e09fd-c797-48da-8705-fdd377c5afd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:15.986228 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e09fd-c797-48da-8705-fdd377c5afd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:15.986505 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e09fd-c797-48da-8705-fdd377c5afd4 admin admin] PATH_INFO: `/v3/users/fa068711ed344975b8780ce24fd8e6ed` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:15.987666 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e09fd-c797-48da-8705-fdd377c5afd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa068711ed344975b8780ce24fd8e6ed)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:15.989557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e09fd-c797-48da-8705-fdd377c5afd4 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:16.037122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-687e09fd-c797-48da-8705-fdd377c5afd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa068711ed344975b8780ce24fd8e6ed'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:16.043869 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-687e09fd-c797-48da-8705-fdd377c5afd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa068711ed344975b8780ce24fd8e6ed'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:16.055663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-687e09fd-c797-48da-8705-fdd377c5afd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa068711ed344975b8780ce24fd8e6ed'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:16.056548 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-687e09fd-c797-48da-8705-fdd377c5afd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa068711ed344975b8780ce24fd8e6ed'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:16.057166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-687e09fd-c797-48da-8705-fdd377c5afd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa068711ed344975b8780ce24fd8e6ed'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:16.068746 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1002/2006] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:15 2022] DELETE /identity/v3/users/fa068711ed344975b8780ce24fd8e6ed => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:16.073948 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f9cd4-4601-4768-b04b-7b65faf80b58 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:16.074488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f9cd4-4601-4768-b04b-7b65faf80b58 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:16.074585 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f9cd4-4601-4768-b04b-7b65faf80b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:16.091087 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-d10f9cd4-4601-4768-b04b-7b65faf80b58 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:16.092222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-d10f9cd4-4601-4768-b04b-7b65faf80b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:16.149449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1005/2007] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:16.159181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e09fd-c797-48da-8705-fdd377c5afd4 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:16.160598 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-687e09fd-c797-48da-8705-fdd377c5afd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:16.220937 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e09fd-c797-48da-8705-fdd377c5afd4 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:16.224783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4601a3a-8fa1-4778-9593-1682084f5bae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:16.225436 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4601a3a-8fa1-4778-9593-1682084f5bae service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:16.225713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4601a3a-8fa1-4778-9593-1682084f5bae service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:16.225981 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4601a3a-8fa1-4778-9593-1682084f5bae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:16.235400 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4601a3a-8fa1-4778-9593-1682084f5bae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:16.236784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4601a3a-8fa1-4778-9593-1682084f5bae service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:16.246767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1003/2008] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:16.501835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f9cd4-4601-4768-b04b-7b65faf80b58 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:16.503551 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-d10f9cd4-4601-4768-b04b-7b65faf80b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:16.516096 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f9cd4-4601-4768-b04b-7b65faf80b58 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:16.521139 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7417194-12ae-4226-ba06-6b4a3fa19bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:16.522280 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7417194-12ae-4226-ba06-6b4a3fa19bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:16.522758 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7417194-12ae-4226-ba06-6b4a3fa19bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:16.523034 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7417194-12ae-4226-ba06-6b4a3fa19bd2 admin admin] PATH_INFO: `/v3/projects/f10765e6fb5143b9ab7650ceede266a0` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:16.525145 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7417194-12ae-4226-ba06-6b4a3fa19bd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f10765e6fb5143b9ab7650ceede266a0)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:16.527104 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7417194-12ae-4226-ba06-6b4a3fa19bd2 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:16.574588 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f7417194-12ae-4226-ba06-6b4a3fa19bd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f10765e6fb5143b9ab7650ceede266a0', 'request_id': 'req-f7417194-12ae-4226-ba06-6b4a3fa19bd2'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:16.579928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f7417194-12ae-4226-ba06-6b4a3fa19bd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f10765e6fb5143b9ab7650ceede266a0', 'request_id': 'req-f7417194-12ae-4226-ba06-6b4a3fa19bd2'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:16.585929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f7417194-12ae-4226-ba06-6b4a3fa19bd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f10765e6fb5143b9ab7650ceede266a0', 'request_id': 'req-f7417194-12ae-4226-ba06-6b4a3fa19bd2'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:16.598081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f7417194-12ae-4226-ba06-6b4a3fa19bd2 admin admin] The token cache is being invalidate because project f10765e6fb5143b9ab7650ceede266a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:16.598342 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f7417194-12ae-4226-ba06-6b4a3fa19bd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:16.598965 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f7417194-12ae-4226-ba06-6b4a3fa19bd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:16.600518 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1006/2009] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:16 2022] DELETE /identity/v3/projects/f10765e6fb5143b9ab7650ceede266a0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:16.605082 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4601a3a-8fa1-4778-9593-1682084f5bae service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:16.614873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4601a3a-8fa1-4778-9593-1682084f5bae service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:16.672040 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f839a6d-15c8-4cef-a66d-4901f68149ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:16.672929 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f839a6d-15c8-4cef-a66d-4901f68149ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:16.673211 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f839a6d-15c8-4cef-a66d-4901f68149ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:16.673486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f839a6d-15c8-4cef-a66d-4901f68149ae admin admin] PATH_INFO: `/v3/users/7978ca999d284773b50a6836ad4e5adc` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:16.674789 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f839a6d-15c8-4cef-a66d-4901f68149ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=7978ca999d284773b50a6836ad4e5adc)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:16.676754 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f839a6d-15c8-4cef-a66d-4901f68149ae admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:16.730014 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-6f839a6d-15c8-4cef-a66d-4901f68149ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7978ca999d284773b50a6836ad4e5adc'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:16.738699 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-6f839a6d-15c8-4cef-a66d-4901f68149ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7978ca999d284773b50a6836ad4e5adc'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:16.752811 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-6f839a6d-15c8-4cef-a66d-4901f68149ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7978ca999d284773b50a6836ad4e5adc'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:16.753556 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-6f839a6d-15c8-4cef-a66d-4901f68149ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7978ca999d284773b50a6836ad4e5adc'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:16.754174 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-6f839a6d-15c8-4cef-a66d-4901f68149ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7978ca999d284773b50a6836ad4e5adc'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:16.767260 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1004/2010] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:16 2022] DELETE /identity/v3/users/7978ca999d284773b50a6836ad4e5adc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:17.123243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7417194-12ae-4226-ba06-6b4a3fa19bd2 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:17.124760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f7417194-12ae-4226-ba06-6b4a3fa19bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:17.138475 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7417194-12ae-4226-ba06-6b4a3fa19bd2 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:17.193418 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa21e5-5b6b-43d4-92eb-9322049db8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:17.194583 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa21e5-5b6b-43d4-92eb-9322049db8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:17.194866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa21e5-5b6b-43d4-92eb-9322049db8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:17.195141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa21e5-5b6b-43d4-92eb-9322049db8e8 admin admin] PATH_INFO: `/v3/projects/15970a80e544449bb203ea84ea53c9d1` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:17.196937 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa21e5-5b6b-43d4-92eb-9322049db8e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15970a80e544449bb203ea84ea53c9d1)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:17.198884 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa21e5-5b6b-43d4-92eb-9322049db8e8 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:17.246355 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-13aa21e5-5b6b-43d4-92eb-9322049db8e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15970a80e544449bb203ea84ea53c9d1', 'request_id': 'req-13aa21e5-5b6b-43d4-92eb-9322049db8e8'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:17.251637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-13aa21e5-5b6b-43d4-92eb-9322049db8e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15970a80e544449bb203ea84ea53c9d1', 'request_id': 'req-13aa21e5-5b6b-43d4-92eb-9322049db8e8'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:17.257738 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-13aa21e5-5b6b-43d4-92eb-9322049db8e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15970a80e544449bb203ea84ea53c9d1', 'request_id': 'req-13aa21e5-5b6b-43d4-92eb-9322049db8e8'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:17.273715 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-13aa21e5-5b6b-43d4-92eb-9322049db8e8 admin admin] The token cache is being invalidate because project 15970a80e544449bb203ea84ea53c9d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:17.273715 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-13aa21e5-5b6b-43d4-92eb-9322049db8e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:17.273715 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-13aa21e5-5b6b-43d4-92eb-9322049db8e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:17.273715 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1007/2011] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:17 2022] DELETE /identity/v3/projects/15970a80e544449bb203ea84ea53c9d1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:17.278182 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4ec35-9d67-447b-ba0f-832f1a14e7b9 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:17.278688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4ec35-9d67-447b-ba0f-832f1a14e7b9 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:17.278773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4ec35-9d67-447b-ba0f-832f1a14e7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:17.296463 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-f0f4ec35-9d67-447b-ba0f-832f1a14e7b9 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:17.297640 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-f0f4ec35-9d67-447b-ba0f-832f1a14e7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:17.353951 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1005/2012] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:17.361590 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f132b8-4413-4efd-b565-a87b9a9a0a3f None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:17.361884 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f132b8-4413-4efd-b565-a87b9a9a0a3f None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:17.362160 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f132b8-4413-4efd-b565-a87b9a9a0a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:17.381173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-b2f132b8-4413-4efd-b565-a87b9a9a0a3f None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:17.382415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-b2f132b8-4413-4efd-b565-a87b9a9a0a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:17.391591 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1008/2013] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:17.395926 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4ec35-9d67-447b-ba0f-832f1a14e7b9 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:17.408229 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4ec35-9d67-447b-ba0f-832f1a14e7b9 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:17.413309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a59e7-8775-43a7-8d45-44fcde5b2798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:17.413979 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a59e7-8775-43a7-8d45-44fcde5b2798 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:17.414310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a59e7-8775-43a7-8d45-44fcde5b2798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:17.415193 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a59e7-8775-43a7-8d45-44fcde5b2798 admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:17.415960 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a59e7-8775-43a7-8d45-44fcde5b2798 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:03:17.416267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a59e7-8775-43a7-8d45-44fcde5b2798 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:17.417875 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a59e7-8775-43a7-8d45-44fcde5b2798 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:17.429527 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1006/2014] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:03:17.434083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f132b8-4413-4efd-b565-a87b9a9a0a3f None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:17.443063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f132b8-4413-4efd-b565-a87b9a9a0a3f None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:17.448030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d97187-3205-4088-a4c5-ce1bb4dff8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:17.448680 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d97187-3205-4088-a4c5-ce1bb4dff8ba admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:17.448965 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d97187-3205-4088-a4c5-ce1bb4dff8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:17.449242 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d97187-3205-4088-a4c5-ce1bb4dff8ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:17.449924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d97187-3205-4088-a4c5-ce1bb4dff8ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:17.451850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d97187-3205-4088-a4c5-ce1bb4dff8ba admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:17.479020 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1009/2015] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:17 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:17.483122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a59e7-8775-43a7-8d45-44fcde5b2798 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:17.493684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a59e7-8775-43a7-8d45-44fcde5b2798 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:17.548726 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7981a3-a57b-4b8e-9a0a-7cd1d8d12b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:17.549396 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7981a3-a57b-4b8e-9a0a-7cd1d8d12b7a admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:17.549677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7981a3-a57b-4b8e-9a0a-7cd1d8d12b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:17.549947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7981a3-a57b-4b8e-9a0a-7cd1d8d12b7a admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:17.550669 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7981a3-a57b-4b8e-9a0a-7cd1d8d12b7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:17.552577 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7981a3-a57b-4b8e-9a0a-7cd1d8d12b7a admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:17.572580 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1007/2016] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:17 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:17.576822 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d97187-3205-4088-a4c5-ce1bb4dff8ba admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:17.588160 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d97187-3205-4088-a4c5-ce1bb4dff8ba admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:17.593385 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bbf11-c6e1-4bb4-adf1-8ae3f747174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:17.594161 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bbf11-c6e1-4bb4-adf1-8ae3f747174d admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:17.594488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bbf11-c6e1-4bb4-adf1-8ae3f747174d admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:17.594767 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bbf11-c6e1-4bb4-adf1-8ae3f747174d admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:17.595681 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820bbf11-c6e1-4bb4-adf1-8ae3f747174d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:17.597744 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820bbf11-c6e1-4bb4-adf1-8ae3f747174d admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:17.611085 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1010/2017] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:03:17.615666 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7981a3-a57b-4b8e-9a0a-7cd1d8d12b7a admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:17.626373 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7981a3-a57b-4b8e-9a0a-7cd1d8d12b7a admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:17.630831 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf90b3-89ec-4c66-9161-850a39a3a7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:17.631481 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf90b3-89ec-4c66-9161-850a39a3a7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:17.631763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf90b3-89ec-4c66-9161-850a39a3a7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:17.632039 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf90b3-89ec-4c66-9161-850a39a3a7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:17.632762 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf90b3-89ec-4c66-9161-850a39a3a7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:17.635072 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf90b3-89ec-4c66-9161-850a39a3a7b1 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:17.644658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1008/2018] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:17.648599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bbf11-c6e1-4bb4-adf1-8ae3f747174d admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:17.658384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bbf11-c6e1-4bb4-adf1-8ae3f747174d admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:17.663014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f317c-a3db-4b95-b344-5ca416c7ad08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:17.663901 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f317c-a3db-4b95-b344-5ca416c7ad08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:17.664186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f317c-a3db-4b95-b344-5ca416c7ad08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:17.664470 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f317c-a3db-4b95-b344-5ca416c7ad08 admin admin] PATH_INFO: `/v3/projects/1da613f71f644f558c0097585a48668d/users/3344da844a964c6eb3f1df25f1b0319e/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:17.678863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f317c-a3db-4b95-b344-5ca416c7ad08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da613f71f644f558c0097585a48668d, user_id=3344da844a964c6eb3f1df25f1b0319e, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:17.682569 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f317c-a3db-4b95-b344-5ca416c7ad08 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:17.696997 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1011/2019] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:17 2022] PUT /identity/v3/projects/1da613f71f644f558c0097585a48668d/users/3344da844a964c6eb3f1df25f1b0319e/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:17.708200 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09638689-f7d5-41c8-b625-b5cddde89090 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:17.708491 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09638689-f7d5-41c8-b625-b5cddde89090 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:17.708770 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09638689-f7d5-41c8-b625-b5cddde89090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:17.735019 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-09638689-f7d5-41c8-b625-b5cddde89090 None None] MFA Rules not processed for user `3344da844a964c6eb3f1df25f1b0319e`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:17.736214 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-09638689-f7d5-41c8-b625-b5cddde89090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:17.800034 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1009/2020] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:17.804671 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f317c-a3db-4b95-b344-5ca416c7ad08 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:17.866697 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f317c-a3db-4b95-b344-5ca416c7ad08 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:17.872397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b7ee9-2264-47cb-8fce-fe0d5ca3ddb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:17.873057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b7ee9-2264-47cb-8fce-fe0d5ca3ddb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:17.873337 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b7ee9-2264-47cb-8fce-fe0d5ca3ddb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:17.873609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b7ee9-2264-47cb-8fce-fe0d5ca3ddb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:17.874331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b7ee9-2264-47cb-8fce-fe0d5ca3ddb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:17.876216 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b7ee9-2264-47cb-8fce-fe0d5ca3ddb8 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:17.900801 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1012/2021] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:17 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:17.904914 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09638689-f7d5-41c8-b625-b5cddde89090 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:17.917431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09638689-f7d5-41c8-b625-b5cddde89090 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:17.972373 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d727505-4ca8-4a25-9e85-3a21f87ceac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:17.973051 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d727505-4ca8-4a25-9e85-3a21f87ceac4 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:17.973341 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d727505-4ca8-4a25-9e85-3a21f87ceac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:17.973616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d727505-4ca8-4a25-9e85-3a21f87ceac4 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:17.974334 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d727505-4ca8-4a25-9e85-3a21f87ceac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:17.976255 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d727505-4ca8-4a25-9e85-3a21f87ceac4 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:17.997407 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1010/2022] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:17 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:18.001254 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b7ee9-2264-47cb-8fce-fe0d5ca3ddb8 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:18.012397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b7ee9-2264-47cb-8fce-fe0d5ca3ddb8 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:18.017172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d0ca1-6923-431a-8cfd-4665fcd5c893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:18.017842 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d0ca1-6923-431a-8cfd-4665fcd5c893 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:18.018122 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d0ca1-6923-431a-8cfd-4665fcd5c893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:18.018426 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d0ca1-6923-431a-8cfd-4665fcd5c893 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:18.019154 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d0ca1-6923-431a-8cfd-4665fcd5c893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:18.021062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d0ca1-6923-431a-8cfd-4665fcd5c893 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:18.034231 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1013/2023] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:18.038124 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d727505-4ca8-4a25-9e85-3a21f87ceac4 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:18.049087 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d727505-4ca8-4a25-9e85-3a21f87ceac4 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:18.053828 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54829c00-feb4-494a-97a0-08067dd837dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:18.054747 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54829c00-feb4-494a-97a0-08067dd837dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:18.055033 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54829c00-feb4-494a-97a0-08067dd837dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:18.055397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54829c00-feb4-494a-97a0-08067dd837dd admin admin] PATH_INFO: `/v3/projects/961b4072a53e418f854bb08ff38fd57b/users/d35ecbb7cce64e6cba85798fe3be866e/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:18.071743 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54829c00-feb4-494a-97a0-08067dd837dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=961b4072a53e418f854bb08ff38fd57b, user_id=d35ecbb7cce64e6cba85798fe3be866e, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:18.074714 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54829c00-feb4-494a-97a0-08067dd837dd admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:18.090669 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1011/2024] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:18 2022] PUT /identity/v3/projects/961b4072a53e418f854bb08ff38fd57b/users/d35ecbb7cce64e6cba85798fe3be866e/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:18.094870 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d0ca1-6923-431a-8cfd-4665fcd5c893 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:18.104673 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d0ca1-6923-431a-8cfd-4665fcd5c893 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:18.164071 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e0613-b2cf-4658-9d6b-97b4ff540c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:18.164812 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e0613-b2cf-4658-9d6b-97b4ff540c3c admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:18.165132 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e0613-b2cf-4658-9d6b-97b4ff540c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:18.165387 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e0613-b2cf-4658-9d6b-97b4ff540c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:18.166120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e0613-b2cf-4658-9d6b-97b4ff540c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:18.167952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e0613-b2cf-4658-9d6b-97b4ff540c3c admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:18.183117 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1014/2025] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:03:18.187127 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54829c00-feb4-494a-97a0-08067dd837dd admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:18.197973 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54829c00-feb4-494a-97a0-08067dd837dd admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:18.202566 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8496b1-775a-4c77-b658-080172d3cd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:18.203437 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8496b1-775a-4c77-b658-080172d3cd00 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:18.203714 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8496b1-775a-4c77-b658-080172d3cd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:18.203982 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8496b1-775a-4c77-b658-080172d3cd00 admin admin] PATH_INFO: `/v3/projects/961b4072a53e418f854bb08ff38fd57b/users/d35ecbb7cce64e6cba85798fe3be866e/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:18.205949 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8496b1-775a-4c77-b658-080172d3cd00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=961b4072a53e418f854bb08ff38fd57b, user_id=d35ecbb7cce64e6cba85798fe3be866e, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:18.208610 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8496b1-775a-4c77-b658-080172d3cd00 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:18.218714 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1012/2026] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:18 2022] PUT /identity/v3/projects/961b4072a53e418f854bb08ff38fd57b/users/d35ecbb7cce64e6cba85798fe3be866e/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:18.229113 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb366b-4af8-4552-baa8-7fcc8510ef6a None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:18.229408 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb366b-4af8-4552-baa8-7fcc8510ef6a None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:18.229692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb366b-4af8-4552-baa8-7fcc8510ef6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:18.258164 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-a7eb366b-4af8-4552-baa8-7fcc8510ef6a None None] MFA Rules not processed for user `d35ecbb7cce64e6cba85798fe3be866e`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:18.260180 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-a7eb366b-4af8-4552-baa8-7fcc8510ef6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:18.327132 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1015/2027] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:18.337869 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8496b1-775a-4c77-b658-080172d3cd00 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:18.339577 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-de8496b1-775a-4c77-b658-080172d3cd00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:18.396394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8496b1-775a-4c77-b658-080172d3cd00 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:18.400600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8755d6-9b4c-42fa-8123-4bf289365155 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:18.401225 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8755d6-9b4c-42fa-8123-4bf289365155 service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:18.401510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8755d6-9b4c-42fa-8123-4bf289365155 service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:18.401787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8755d6-9b4c-42fa-8123-4bf289365155 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:18.411094 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8755d6-9b4c-42fa-8123-4bf289365155 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:18.412543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8755d6-9b4c-42fa-8123-4bf289365155 service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:18.422604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1013/2028] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:18.520884 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb366b-4af8-4552-baa8-7fcc8510ef6a None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:18.522298 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-a7eb366b-4af8-4552-baa8-7fcc8510ef6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:18.534548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb366b-4af8-4552-baa8-7fcc8510ef6a None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:18.542171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83746291-87b2-475d-852b-716c4ef7bcf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:18.542873 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83746291-87b2-475d-852b-716c4ef7bcf6 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:18.543162 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83746291-87b2-475d-852b-716c4ef7bcf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:18.543471 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83746291-87b2-475d-852b-716c4ef7bcf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:18.600829 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83746291-87b2-475d-852b-716c4ef7bcf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:18.603476 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83746291-87b2-475d-852b-716c4ef7bcf6 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:18.612531 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1016/2029] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:22.825409 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8755d6-9b4c-42fa-8123-4bf289365155 service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:22.828173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-7d8755d6-9b4c-42fa-8123-4bf289365155 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:22.907624 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8755d6-9b4c-42fa-8123-4bf289365155 service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:22.912497 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009a6dd-be88-4a39-bd4d-5cdf7461b5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:22.913485 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009a6dd-be88-4a39-bd4d-5cdf7461b5e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:22.914024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009a6dd-be88-4a39-bd4d-5cdf7461b5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:22.915094 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009a6dd-be88-4a39-bd4d-5cdf7461b5e1 admin admin] PATH_INFO: `/v3/users/2dd40667b1f64be48cb1fbd9cfeeffca` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:22.917060 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009a6dd-be88-4a39-bd4d-5cdf7461b5e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dd40667b1f64be48cb1fbd9cfeeffca)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:22.919622 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009a6dd-be88-4a39-bd4d-5cdf7461b5e1 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:22.974474 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-a009a6dd-be88-4a39-bd4d-5cdf7461b5e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dd40667b1f64be48cb1fbd9cfeeffca'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:22.981747 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-a009a6dd-be88-4a39-bd4d-5cdf7461b5e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dd40667b1f64be48cb1fbd9cfeeffca'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:22.994268 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-a009a6dd-be88-4a39-bd4d-5cdf7461b5e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dd40667b1f64be48cb1fbd9cfeeffca'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:22.994954 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-a009a6dd-be88-4a39-bd4d-5cdf7461b5e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dd40667b1f64be48cb1fbd9cfeeffca'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:22.995558 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-a009a6dd-be88-4a39-bd4d-5cdf7461b5e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dd40667b1f64be48cb1fbd9cfeeffca'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:23.009711 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1014/2030] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:22 2022] DELETE /identity/v3/users/2dd40667b1f64be48cb1fbd9cfeeffca => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:23.014157 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed9e84-0250-41e3-bed9-054461eaf3c3 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:23.014656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed9e84-0250-41e3-bed9-054461eaf3c3 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:23.014746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed9e84-0250-41e3-bed9-054461eaf3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:23.032143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-92ed9e84-0250-41e3-bed9-054461eaf3c3 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:23.033354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-92ed9e84-0250-41e3-bed9-054461eaf3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:23.095910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1017/2031] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:23.105568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009a6dd-be88-4a39-bd4d-5cdf7461b5e1 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:23.107099 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a009a6dd-be88-4a39-bd4d-5cdf7461b5e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:23.163837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009a6dd-be88-4a39-bd4d-5cdf7461b5e1 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:23.168423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29329b-cdd0-4ac7-b169-4a5e5e243ce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:23.169249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29329b-cdd0-4ac7-b169-4a5e5e243ce5 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:23.169546 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29329b-cdd0-4ac7-b169-4a5e5e243ce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:23.169822 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29329b-cdd0-4ac7-b169-4a5e5e243ce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:23.179117 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b29329b-cdd0-4ac7-b169-4a5e5e243ce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:23.180860 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b29329b-cdd0-4ac7-b169-4a5e5e243ce5 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:23.190189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1015/2032] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:23.308615 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed9e84-0250-41e3-bed9-054461eaf3c3 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:23.310962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-92ed9e84-0250-41e3-bed9-054461eaf3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:23.324067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed9e84-0250-41e3-bed9-054461eaf3c3 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:23.346267 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f712770-3e95-4628-9ab4-89e2710ebf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:23.347359 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f712770-3e95-4628-9ab4-89e2710ebf11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:23.347689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f712770-3e95-4628-9ab4-89e2710ebf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:23.348179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f712770-3e95-4628-9ab4-89e2710ebf11 admin admin] PATH_INFO: `/v3/users/3344da844a964c6eb3f1df25f1b0319e` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:23.349619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f712770-3e95-4628-9ab4-89e2710ebf11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3344da844a964c6eb3f1df25f1b0319e)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:23.352582 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f712770-3e95-4628-9ab4-89e2710ebf11 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:23.404755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-7f712770-3e95-4628-9ab4-89e2710ebf11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3344da844a964c6eb3f1df25f1b0319e'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:23.406182 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-7f712770-3e95-4628-9ab4-89e2710ebf11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3344da844a964c6eb3f1df25f1b0319e'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:23.419670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-7f712770-3e95-4628-9ab4-89e2710ebf11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3344da844a964c6eb3f1df25f1b0319e'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:23.427783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-7f712770-3e95-4628-9ab4-89e2710ebf11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3344da844a964c6eb3f1df25f1b0319e'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:23.435429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-7f712770-3e95-4628-9ab4-89e2710ebf11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3344da844a964c6eb3f1df25f1b0319e'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:23.441474 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1018/2033] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:23 2022] DELETE /identity/v3/users/3344da844a964c6eb3f1df25f1b0319e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:23.447669 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1ca59-eeba-4379-b163-9f29a406e932 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:23.448049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1ca59-eeba-4379-b163-9f29a406e932 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:23.448537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1ca59-eeba-4379-b163-9f29a406e932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:23.467552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-afc1ca59-eeba-4379-b163-9f29a406e932 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:23.468919 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-afc1ca59-eeba-4379-b163-9f29a406e932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:23.475449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f712770-3e95-4628-9ab4-89e2710ebf11 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:23.476844 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-7f712770-3e95-4628-9ab4-89e2710ebf11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:23.540374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1016/2034] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:23.551388 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1ca59-eeba-4379-b163-9f29a406e932 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:23.560279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-afc1ca59-eeba-4379-b163-9f29a406e932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:23.560858 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f712770-3e95-4628-9ab4-89e2710ebf11 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:23.565737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892def38-ccd6-4421-98d2-5ddb66be62ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:23.566650 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892def38-ccd6-4421-98d2-5ddb66be62ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:23.566935 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892def38-ccd6-4421-98d2-5ddb66be62ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:23.567374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892def38-ccd6-4421-98d2-5ddb66be62ef admin admin] PATH_INFO: `/v3/projects/7c584a4943054268b0276af9c9c0dc11` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:23.568594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892def38-ccd6-4421-98d2-5ddb66be62ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c584a4943054268b0276af9c9c0dc11)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:23.570525 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892def38-ccd6-4421-98d2-5ddb66be62ef admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:23.623430 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-892def38-ccd6-4421-98d2-5ddb66be62ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c584a4943054268b0276af9c9c0dc11', 'request_id': 'req-892def38-ccd6-4421-98d2-5ddb66be62ef'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:23.624901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1ca59-eeba-4379-b163-9f29a406e932 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:23.628919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-892def38-ccd6-4421-98d2-5ddb66be62ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c584a4943054268b0276af9c9c0dc11', 'request_id': 'req-892def38-ccd6-4421-98d2-5ddb66be62ef'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:23.635497 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-892def38-ccd6-4421-98d2-5ddb66be62ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c584a4943054268b0276af9c9c0dc11', 'request_id': 'req-892def38-ccd6-4421-98d2-5ddb66be62ef'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:23.652944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-892def38-ccd6-4421-98d2-5ddb66be62ef admin admin] The token cache is being invalidate because project 7c584a4943054268b0276af9c9c0dc11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:23.652944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-892def38-ccd6-4421-98d2-5ddb66be62ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:23.652944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-892def38-ccd6-4421-98d2-5ddb66be62ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:23.653556 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1019/2035] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:23 2022] DELETE /identity/v3/projects/7c584a4943054268b0276af9c9c0dc11 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:23.657824 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861749d-d8d2-44fa-991b-522d0ca02513 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:23.658108 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861749d-d8d2-44fa-991b-522d0ca02513 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:23.658412 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861749d-d8d2-44fa-991b-522d0ca02513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:23.687677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-a861749d-d8d2-44fa-991b-522d0ca02513 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:23.688980 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-a861749d-d8d2-44fa-991b-522d0ca02513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:23.694040 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9692e25-1e1e-4dca-9d6b-af97e3bd9a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:23.695318 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9692e25-1e1e-4dca-9d6b-af97e3bd9a33 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:23.696053 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9692e25-1e1e-4dca-9d6b-af97e3bd9a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:23.696765 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9692e25-1e1e-4dca-9d6b-af97e3bd9a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:23.699311 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-c9692e25-1e1e-4dca-9d6b-af97e3bd9a33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:23.761867 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1020/2036] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:23.767675 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9692e25-1e1e-4dca-9d6b-af97e3bd9a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:23.769209 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9692e25-1e1e-4dca-9d6b-af97e3bd9a33 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:23.770795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98e96d-f221-4889-8485-94e950419a2a None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:23.770943 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98e96d-f221-4889-8485-94e950419a2a None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:23.771195 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98e96d-f221-4889-8485-94e950419a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:23.780510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1017/2037] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:03:23.790947 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-5e98e96d-f221-4889-8485-94e950419a2a None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:23.792251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-5e98e96d-f221-4889-8485-94e950419a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:23.800839 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1021/2038] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:23.805230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9692e25-1e1e-4dca-9d6b-af97e3bd9a33 service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:23.815443 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9692e25-1e1e-4dca-9d6b-af97e3bd9a33 service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:23.821453 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a9809-ae3d-471e-aacb-45bf94c899aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:23.822432 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a9809-ae3d-471e-aacb-45bf94c899aa admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:23.822639 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a9809-ae3d-471e-aacb-45bf94c899aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:23.822796 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a9809-ae3d-471e-aacb-45bf94c899aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:23.823556 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a9809-ae3d-471e-aacb-45bf94c899aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:03:23.823861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a9809-ae3d-471e-aacb-45bf94c899aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:23.825447 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a9809-ae3d-471e-aacb-45bf94c899aa admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:23.849675 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1018/2039] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:03:23.849834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98e96d-f221-4889-8485-94e950419a2a None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:23.861675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98e96d-f221-4889-8485-94e950419a2a None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:23.867817 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c6ec7-08cf-4fbe-8a24-f627ffc73f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:23.868656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c6ec7-08cf-4fbe-8a24-f627ffc73f44 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:23.868947 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c6ec7-08cf-4fbe-8a24-f627ffc73f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:23.869825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c6ec7-08cf-4fbe-8a24-f627ffc73f44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:23.869954 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c6ec7-08cf-4fbe-8a24-f627ffc73f44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:23.872033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c6ec7-08cf-4fbe-8a24-f627ffc73f44 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:23.912220 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1022/2040] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:23 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:23.916729 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a9809-ae3d-471e-aacb-45bf94c899aa admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:23.930449 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a9809-ae3d-471e-aacb-45bf94c899aa admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:24.019347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d51853-8373-4568-a8ba-20d2b2a35dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:24.019885 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d51853-8373-4568-a8ba-20d2b2a35dda admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:24.020173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d51853-8373-4568-a8ba-20d2b2a35dda admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:24.020448 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d51853-8373-4568-a8ba-20d2b2a35dda admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:24.021148 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d51853-8373-4568-a8ba-20d2b2a35dda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:24.026386 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d51853-8373-4568-a8ba-20d2b2a35dda admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:24.065757 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1019/2041] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:23 2022] POST /identity/v3/users => generated 291 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:24.067718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c6ec7-08cf-4fbe-8a24-f627ffc73f44 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:24.080942 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c6ec7-08cf-4fbe-8a24-f627ffc73f44 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:24.088382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff996c2-e18b-4880-b71a-66b12f333226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:24.089445 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff996c2-e18b-4880-b71a-66b12f333226 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:24.091492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff996c2-e18b-4880-b71a-66b12f333226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:24.091492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff996c2-e18b-4880-b71a-66b12f333226 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:24.091492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff996c2-e18b-4880-b71a-66b12f333226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:24.093686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff996c2-e18b-4880-b71a-66b12f333226 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:24.120499 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1023/2042] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:24.122144 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d51853-8373-4568-a8ba-20d2b2a35dda admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:24.139002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d51853-8373-4568-a8ba-20d2b2a35dda admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:24.149470 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c709308-aa43-4fd3-a4d8-25736ef6902c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:24.151056 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c709308-aa43-4fd3-a4d8-25736ef6902c admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:24.151890 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c709308-aa43-4fd3-a4d8-25736ef6902c admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:24.156389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c709308-aa43-4fd3-a4d8-25736ef6902c admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:24.156389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c709308-aa43-4fd3-a4d8-25736ef6902c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:24.160563 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c709308-aa43-4fd3-a4d8-25736ef6902c admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:24.183778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1020/2043] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:24.187699 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff996c2-e18b-4880-b71a-66b12f333226 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:24.220696 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff996c2-e18b-4880-b71a-66b12f333226 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:24.229217 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d16f2-1007-46c3-b744-b15d2a41de27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:24.230361 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d16f2-1007-46c3-b744-b15d2a41de27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:24.230734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d16f2-1007-46c3-b744-b15d2a41de27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:24.231157 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d16f2-1007-46c3-b744-b15d2a41de27 admin admin] PATH_INFO: `/v3/projects/5744960322494493bcb5bfe0e85a4fd2/users/5c8cf1adb72a4fac840942aee7b5631d/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:24.268274 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c709308-aa43-4fd3-a4d8-25736ef6902c admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:24.270652 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-6c709308-aa43-4fd3-a4d8-25736ef6902c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:24.275489 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d16f2-1007-46c3-b744-b15d2a41de27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5744960322494493bcb5bfe0e85a4fd2, user_id=5c8cf1adb72a4fac840942aee7b5631d, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:24.278523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d16f2-1007-46c3-b744-b15d2a41de27 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:24.290721 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c709308-aa43-4fd3-a4d8-25736ef6902c admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:24.314647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1024/2044] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:24 2022] PUT /identity/v3/projects/5744960322494493bcb5bfe0e85a4fd2/users/5c8cf1adb72a4fac840942aee7b5631d/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:24.329302 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930baf63-7cff-44c4-afb8-2194d16bec46 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:24.329603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930baf63-7cff-44c4-afb8-2194d16bec46 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:24.329887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930baf63-7cff-44c4-afb8-2194d16bec46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:24.365990 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60034e4b-f466-4735-bea3-19962678d3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:24.366995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60034e4b-f466-4735-bea3-19962678d3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:24.367651 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60034e4b-f466-4735-bea3-19962678d3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:24.368022 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60034e4b-f466-4735-bea3-19962678d3f8 admin admin] PATH_INFO: `/v3/projects/1da613f71f644f558c0097585a48668d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:24.369551 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60034e4b-f466-4735-bea3-19962678d3f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da613f71f644f558c0097585a48668d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:24.371132 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-930baf63-7cff-44c4-afb8-2194d16bec46 None None] MFA Rules not processed for user `5c8cf1adb72a4fac840942aee7b5631d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:24.371662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60034e4b-f466-4735-bea3-19962678d3f8 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:24.372366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-930baf63-7cff-44c4-afb8-2194d16bec46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:24.432143 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-60034e4b-f466-4735-bea3-19962678d3f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da613f71f644f558c0097585a48668d', 'request_id': 'req-60034e4b-f466-4735-bea3-19962678d3f8'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:24.440215 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-60034e4b-f466-4735-bea3-19962678d3f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da613f71f644f558c0097585a48668d', 'request_id': 'req-60034e4b-f466-4735-bea3-19962678d3f8'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:24.447947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-60034e4b-f466-4735-bea3-19962678d3f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da613f71f644f558c0097585a48668d', 'request_id': 'req-60034e4b-f466-4735-bea3-19962678d3f8'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:24.466914 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-60034e4b-f466-4735-bea3-19962678d3f8 admin admin] The token cache is being invalidate because project 1da613f71f644f558c0097585a48668d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:24.467277 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-60034e4b-f466-4735-bea3-19962678d3f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:24.467882 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-60034e4b-f466-4735-bea3-19962678d3f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:24.469981 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1021/2045] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:24 2022] DELETE /identity/v3/projects/1da613f71f644f558c0097585a48668d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:24.479696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60034e4b-f466-4735-bea3-19962678d3f8 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:24.481525 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-60034e4b-f466-4735-bea3-19962678d3f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:24.481922 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1025/2046] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:24.486883 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930baf63-7cff-44c4-afb8-2194d16bec46 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:24.501446 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930baf63-7cff-44c4-afb8-2194d16bec46 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:24.561044 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60034e4b-f466-4735-bea3-19962678d3f8 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:24.566932 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82963e1e-79f7-4e60-b560-ade1adfcccf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:24.567822 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82963e1e-79f7-4e60-b560-ade1adfcccf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:24.568107 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82963e1e-79f7-4e60-b560-ade1adfcccf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:24.568389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82963e1e-79f7-4e60-b560-ade1adfcccf1 admin admin] PATH_INFO: `/v3/users/d35ecbb7cce64e6cba85798fe3be866e` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:24.569613 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82963e1e-79f7-4e60-b560-ade1adfcccf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d35ecbb7cce64e6cba85798fe3be866e)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:24.574083 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82963e1e-79f7-4e60-b560-ade1adfcccf1 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:24.592929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b784898-8986-4257-b140-944df8abf840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:24.593615 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b784898-8986-4257-b140-944df8abf840 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:24.593903 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b784898-8986-4257-b140-944df8abf840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:24.594258 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b784898-8986-4257-b140-944df8abf840 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:24.595692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b784898-8986-4257-b140-944df8abf840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:24.597770 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b784898-8986-4257-b140-944df8abf840 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:24.636424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1026/2047] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:24 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:24.643155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b784898-8986-4257-b140-944df8abf840 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:24.645279 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-6b784898-8986-4257-b140-944df8abf840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:24.664945 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-82963e1e-79f7-4e60-b560-ade1adfcccf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd35ecbb7cce64e6cba85798fe3be866e'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:24.677391 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-82963e1e-79f7-4e60-b560-ade1adfcccf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd35ecbb7cce64e6cba85798fe3be866e'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:24.690926 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-82963e1e-79f7-4e60-b560-ade1adfcccf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd35ecbb7cce64e6cba85798fe3be866e'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:24.692237 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-82963e1e-79f7-4e60-b560-ade1adfcccf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd35ecbb7cce64e6cba85798fe3be866e'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:24.693732 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-82963e1e-79f7-4e60-b560-ade1adfcccf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd35ecbb7cce64e6cba85798fe3be866e'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:24.708875 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1022/2048] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:24 2022] DELETE /identity/v3/users/d35ecbb7cce64e6cba85798fe3be866e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:24.709880 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82963e1e-79f7-4e60-b560-ade1adfcccf1 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:24.719215 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-82963e1e-79f7-4e60-b560-ade1adfcccf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:24.747724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b784898-8986-4257-b140-944df8abf840 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:24.803188 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82963e1e-79f7-4e60-b560-ade1adfcccf1 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:24.812256 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356dd3ed-c2ed-41ed-b935-9180ef6c8c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:24.814513 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dd3ed-c2ed-41ed-b935-9180ef6c8c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:24.814855 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b533f3-8aeb-4e99-852d-c2bccdef7db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:24.815495 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dd3ed-c2ed-41ed-b935-9180ef6c8c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:24.815759 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b533f3-8aeb-4e99-852d-c2bccdef7db1 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:24.816089 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b533f3-8aeb-4e99-852d-c2bccdef7db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:24.816372 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b533f3-8aeb-4e99-852d-c2bccdef7db1 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:24.816896 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dd3ed-c2ed-41ed-b935-9180ef6c8c44 admin admin] PATH_INFO: `/v3/users/a13735d5c3634f11801b63c3dd3d5981` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:24.817275 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b533f3-8aeb-4e99-852d-c2bccdef7db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:24.819075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356dd3ed-c2ed-41ed-b935-9180ef6c8c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a13735d5c3634f11801b63c3dd3d5981)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:24.819924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b533f3-8aeb-4e99-852d-c2bccdef7db1 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:24.822656 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356dd3ed-c2ed-41ed-b935-9180ef6c8c44 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:24.854713 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1027/2049] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:24 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:24.866843 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b533f3-8aeb-4e99-852d-c2bccdef7db1 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:24.869373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-d8b533f3-8aeb-4e99-852d-c2bccdef7db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:24.884339 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b533f3-8aeb-4e99-852d-c2bccdef7db1 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:24.890876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9551811-09bf-4bd3-9ff0-f52323753315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:24.891970 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9551811-09bf-4bd3-9ff0-f52323753315 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:24.893100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9551811-09bf-4bd3-9ff0-f52323753315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:24.893648 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9551811-09bf-4bd3-9ff0-f52323753315 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:24.894687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9551811-09bf-4bd3-9ff0-f52323753315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:24.897193 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9551811-09bf-4bd3-9ff0-f52323753315 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:24.921200 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1028/2050] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:24.924862 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9551811-09bf-4bd3-9ff0-f52323753315 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:24.936494 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9551811-09bf-4bd3-9ff0-f52323753315 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:24.942146 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53929ec6-dd53-4f36-a1e0-533f0febab67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:24.942855 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53929ec6-dd53-4f36-a1e0-533f0febab67 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:24.943137 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53929ec6-dd53-4f36-a1e0-533f0febab67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:24.943410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53929ec6-dd53-4f36-a1e0-533f0febab67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:24.944582 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53929ec6-dd53-4f36-a1e0-533f0febab67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:24.946827 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53929ec6-dd53-4f36-a1e0-533f0febab67 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:24.947468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-356dd3ed-c2ed-41ed-b935-9180ef6c8c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a13735d5c3634f11801b63c3dd3d5981'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:24.956509 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-356dd3ed-c2ed-41ed-b935-9180ef6c8c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a13735d5c3634f11801b63c3dd3d5981'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:24.959144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1029/2051] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:03:24.963581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53929ec6-dd53-4f36-a1e0-533f0febab67 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:24.971704 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-356dd3ed-c2ed-41ed-b935-9180ef6c8c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a13735d5c3634f11801b63c3dd3d5981'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:24.972670 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-356dd3ed-c2ed-41ed-b935-9180ef6c8c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a13735d5c3634f11801b63c3dd3d5981'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:24.973515 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-356dd3ed-c2ed-41ed-b935-9180ef6c8c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a13735d5c3634f11801b63c3dd3d5981'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:24.976227 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53929ec6-dd53-4f36-a1e0-533f0febab67 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:24.982453 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040170dd-da94-4365-b071-4d29b63d98f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:24.984295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040170dd-da94-4365-b071-4d29b63d98f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:24.984582 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040170dd-da94-4365-b071-4d29b63d98f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:24.984853 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040170dd-da94-4365-b071-4d29b63d98f4 admin admin] PATH_INFO: `/v3/projects/c8dab943288c4caaa379cde05226353e/users/ba6138c28b574764b6a35ef5d88ff35f/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:24.991046 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1023/2052] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:24 2022] DELETE /identity/v3/users/a13735d5c3634f11801b63c3dd3d5981 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:25.002756 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a33ad-8758-44d4-93e4-44dfce6371b0 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:25.003042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a33ad-8758-44d4-93e4-44dfce6371b0 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:25.003557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a33ad-8758-44d4-93e4-44dfce6371b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:25.008763 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040170dd-da94-4365-b071-4d29b63d98f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8dab943288c4caaa379cde05226353e, user_id=ba6138c28b574764b6a35ef5d88ff35f, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:25.011636 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040170dd-da94-4365-b071-4d29b63d98f4 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:25.026971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-895a33ad-8758-44d4-93e4-44dfce6371b0 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:25.028243 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-895a33ad-8758-44d4-93e4-44dfce6371b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:25.032372 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1030/2053] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:24 2022] PUT /identity/v3/projects/c8dab943288c4caaa379cde05226353e/users/ba6138c28b574764b6a35ef5d88ff35f/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:25.032999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040170dd-da94-4365-b071-4d29b63d98f4 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:25.034621 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-040170dd-da94-4365-b071-4d29b63d98f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:25.110542 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1024/2054] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:25.112110 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d67a7e-a404-4bc9-a8c6-4203b9715938 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:25.112734 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d67a7e-a404-4bc9-a8c6-4203b9715938 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:25.112906 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d67a7e-a404-4bc9-a8c6-4203b9715938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:25.121766 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040170dd-da94-4365-b071-4d29b63d98f4 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:25.126466 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80dd33-627c-4046-96ca-337f4af2e9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:25.127332 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80dd33-627c-4046-96ca-337f4af2e9cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:25.127615 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80dd33-627c-4046-96ca-337f4af2e9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:25.127889 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80dd33-627c-4046-96ca-337f4af2e9cb admin admin] PATH_INFO: `/v3/users/5b6252f06de8429e90449c473a38a979` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:25.129122 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80dd33-627c-4046-96ca-337f4af2e9cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6252f06de8429e90449c473a38a979)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:25.131067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80dd33-627c-4046-96ca-337f4af2e9cb admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:25.141573 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-a4d67a7e-a404-4bc9-a8c6-4203b9715938 None None] MFA Rules not processed for user `ba6138c28b574764b6a35ef5d88ff35f`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:25.142793 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a4d67a7e-a404-4bc9-a8c6-4203b9715938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:25.188800 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0a80dd33-627c-4046-96ca-337f4af2e9cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6252f06de8429e90449c473a38a979'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:25.189849 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0a80dd33-627c-4046-96ca-337f4af2e9cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6252f06de8429e90449c473a38a979'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:25.203452 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0a80dd33-627c-4046-96ca-337f4af2e9cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6252f06de8429e90449c473a38a979'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:25.210358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0a80dd33-627c-4046-96ca-337f4af2e9cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6252f06de8429e90449c473a38a979'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:25.217998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0a80dd33-627c-4046-96ca-337f4af2e9cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6252f06de8429e90449c473a38a979'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:25.220502 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1025/2055] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:25.221634 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d67a7e-a404-4bc9-a8c6-4203b9715938 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:25.224563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1031/2056] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:25 2022] DELETE /identity/v3/users/5b6252f06de8429e90449c473a38a979 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:25.225378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80dd33-627c-4046-96ca-337f4af2e9cb admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:25.227524 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-0a80dd33-627c-4046-96ca-337f4af2e9cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:25.228474 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a4d67a7e-a404-4bc9-a8c6-4203b9715938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:25.242006 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d67a7e-a404-4bc9-a8c6-4203b9715938 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:25.295506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80dd33-627c-4046-96ca-337f4af2e9cb admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:25.302501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298286b3-ab6c-4de2-84b0-f7e18edb6c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:25.303277 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298286b3-ab6c-4de2-84b0-f7e18edb6c56 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:25.303582 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298286b3-ab6c-4de2-84b0-f7e18edb6c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:25.303877 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298286b3-ab6c-4de2-84b0-f7e18edb6c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:25.306709 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-298286b3-ab6c-4de2-84b0-f7e18edb6c56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:25.330320 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dea8c3-4593-499a-8c49-04acb653f193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:25.331119 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dea8c3-4593-499a-8c49-04acb653f193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:25.331982 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dea8c3-4593-499a-8c49-04acb653f193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:25.332274 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dea8c3-4593-499a-8c49-04acb653f193 admin admin] PATH_INFO: `/v3/projects/961b4072a53e418f854bb08ff38fd57b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:25.334033 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dea8c3-4593-499a-8c49-04acb653f193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=961b4072a53e418f854bb08ff38fd57b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:25.337989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dea8c3-4593-499a-8c49-04acb653f193 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:25.399589 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-77dea8c3-4593-499a-8c49-04acb653f193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '961b4072a53e418f854bb08ff38fd57b', 'request_id': 'req-77dea8c3-4593-499a-8c49-04acb653f193'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:25.409634 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-77dea8c3-4593-499a-8c49-04acb653f193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '961b4072a53e418f854bb08ff38fd57b', 'request_id': 'req-77dea8c3-4593-499a-8c49-04acb653f193'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:25.417096 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298286b3-ab6c-4de2-84b0-f7e18edb6c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:25.418596 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298286b3-ab6c-4de2-84b0-f7e18edb6c56 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:25.420418 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-77dea8c3-4593-499a-8c49-04acb653f193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '961b4072a53e418f854bb08ff38fd57b', 'request_id': 'req-77dea8c3-4593-499a-8c49-04acb653f193'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:25.442956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-77dea8c3-4593-499a-8c49-04acb653f193 admin admin] The token cache is being invalidate because project 961b4072a53e418f854bb08ff38fd57b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:25.442956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-77dea8c3-4593-499a-8c49-04acb653f193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:25.442956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-77dea8c3-4593-499a-8c49-04acb653f193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:25.442956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1026/2057] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:25 2022] DELETE /identity/v3/projects/961b4072a53e418f854bb08ff38fd57b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:25.442956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dea8c3-4593-499a-8c49-04acb653f193 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:25.443498 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-77dea8c3-4593-499a-8c49-04acb653f193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:25.445291 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1032/2058] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:25.447993 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341bc1e-86b6-409e-bf9b-5bf7baafa8ed None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:25.448284 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341bc1e-86b6-409e-bf9b-5bf7baafa8ed None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:25.448712 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341bc1e-86b6-409e-bf9b-5bf7baafa8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:25.473806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-a341bc1e-86b6-409e-bf9b-5bf7baafa8ed None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:25.475403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-a341bc1e-86b6-409e-bf9b-5bf7baafa8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:25.534001 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dea8c3-4593-499a-8c49-04acb653f193 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:25.540437 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab043485-9459-49bb-bbca-09fe8f1fa759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:25.541302 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab043485-9459-49bb-bbca-09fe8f1fa759 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:25.541586 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab043485-9459-49bb-bbca-09fe8f1fa759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:25.541859 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab043485-9459-49bb-bbca-09fe8f1fa759 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:25.542594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab043485-9459-49bb-bbca-09fe8f1fa759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:25.544578 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab043485-9459-49bb-bbca-09fe8f1fa759 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:25.562358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1033/2059] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:25.564129 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37a9d0-45ec-4ea7-93aa-9ec5ae0fd8f7 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:25.564423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37a9d0-45ec-4ea7-93aa-9ec5ae0fd8f7 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:25.564701 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37a9d0-45ec-4ea7-93aa-9ec5ae0fd8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:25.587863 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1027/2060] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:25 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:25.588875 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab043485-9459-49bb-bbca-09fe8f1fa759 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:25.589420 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-ac37a9d0-45ec-4ea7-93aa-9ec5ae0fd8f7 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:25.590644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-ab043485-9459-49bb-bbca-09fe8f1fa759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:25.591092 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-ac37a9d0-45ec-4ea7-93aa-9ec5ae0fd8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:25.662370 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab043485-9459-49bb-bbca-09fe8f1fa759 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:25.668488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08238717-794f-44ce-a5d0-3619ff27149a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:25.669333 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08238717-794f-44ce-a5d0-3619ff27149a service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:25.669889 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08238717-794f-44ce-a5d0-3619ff27149a service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:25.670369 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08238717-794f-44ce-a5d0-3619ff27149a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:25.705534 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1034/2061] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:25.707554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37a9d0-45ec-4ea7-93aa-9ec5ae0fd8f7 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:25.731106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37a9d0-45ec-4ea7-93aa-9ec5ae0fd8f7 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:25.742606 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846a9fd-9a55-40b6-bb18-00c9a0a1b174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:25.744272 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846a9fd-9a55-40b6-bb18-00c9a0a1b174 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:25.744825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846a9fd-9a55-40b6-bb18-00c9a0a1b174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:25.745106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846a9fd-9a55-40b6-bb18-00c9a0a1b174 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:25.745808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846a9fd-9a55-40b6-bb18-00c9a0a1b174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:25.747756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846a9fd-9a55-40b6-bb18-00c9a0a1b174 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:25.752717 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08238717-794f-44ce-a5d0-3619ff27149a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:25.754178 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08238717-794f-44ce-a5d0-3619ff27149a service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:25.773500 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1028/2062] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:25.775796 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbff8e-03f8-42ee-8ea5-fcd6ecb9bad1 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:25.776092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbff8e-03f8-42ee-8ea5-fcd6ecb9bad1 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:25.776374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbff8e-03f8-42ee-8ea5-fcd6ecb9bad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:25.781164 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1035/2063] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:25 2022] POST /identity/v3/users => generated 298 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:25.782288 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846a9fd-9a55-40b6-bb18-00c9a0a1b174 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:25.794006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846a9fd-9a55-40b6-bb18-00c9a0a1b174 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:25.797111 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-01dbff8e-03f8-42ee-8ea5-fcd6ecb9bad1 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:25.798379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-01dbff8e-03f8-42ee-8ea5-fcd6ecb9bad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:25.799541 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590f057-ad17-441b-b591-a7a71791840b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:25.800385 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590f057-ad17-441b-b591-a7a71791840b admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:25.800815 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590f057-ad17-441b-b591-a7a71791840b admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:25.801777 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590f057-ad17-441b-b591-a7a71791840b admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:25.802861 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590f057-ad17-441b-b591-a7a71791840b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:25.805849 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590f057-ad17-441b-b591-a7a71791840b admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:25.815034 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1029/2064] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:25.820754 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbff8e-03f8-42ee-8ea5-fcd6ecb9bad1 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:25.830096 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1036/2065] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:25.843070 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590f057-ad17-441b-b591-a7a71791840b admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:25.846387 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbff8e-03f8-42ee-8ea5-fcd6ecb9bad1 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:25.859169 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc66762-0a98-421f-ad8d-a4b8b2dfa925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:25.859853 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc66762-0a98-421f-ad8d-a4b8b2dfa925 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:25.860133 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc66762-0a98-421f-ad8d-a4b8b2dfa925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:25.860405 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc66762-0a98-421f-ad8d-a4b8b2dfa925 admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:25.861144 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc66762-0a98-421f-ad8d-a4b8b2dfa925 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:03:25.861591 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc66762-0a98-421f-ad8d-a4b8b2dfa925 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:25.862872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590f057-ad17-441b-b591-a7a71791840b admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:25.863257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc66762-0a98-421f-ad8d-a4b8b2dfa925 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:25.874864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152f8ba-8ce4-418a-83df-4a30b1a208a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:25.879768 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152f8ba-8ce4-418a-83df-4a30b1a208a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:25.880055 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152f8ba-8ce4-418a-83df-4a30b1a208a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:25.880545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152f8ba-8ce4-418a-83df-4a30b1a208a4 admin admin] PATH_INFO: `/v3/projects/3edcd25c3c3a4c4ba71f37a243b05c9d/users/7af462e9ae324c9898da0955c08249bf/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:25.888938 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1030/2066] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:03:25.893088 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc66762-0a98-421f-ad8d-a4b8b2dfa925 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:25.905076 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152f8ba-8ce4-418a-83df-4a30b1a208a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3edcd25c3c3a4c4ba71f37a243b05c9d, user_id=7af462e9ae324c9898da0955c08249bf, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:25.905910 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc66762-0a98-421f-ad8d-a4b8b2dfa925 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:25.909072 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152f8ba-8ce4-418a-83df-4a30b1a208a4 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:25.915454 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5b852-00db-4fe9-8e2a-8552375485c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:25.916804 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5b852-00db-4fe9-8e2a-8552375485c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:25.916804 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5b852-00db-4fe9-8e2a-8552375485c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:25.917024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5b852-00db-4fe9-8e2a-8552375485c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:25.917924 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5b852-00db-4fe9-8e2a-8552375485c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:25.920670 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5b852-00db-4fe9-8e2a-8552375485c1 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:25.926646 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1037/2067] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:25 2022] PUT /identity/v3/projects/3edcd25c3c3a4c4ba71f37a243b05c9d/users/7af462e9ae324c9898da0955c08249bf/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:25.931271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152f8ba-8ce4-418a-83df-4a30b1a208a4 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:25.962374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1031/2068] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:25 2022] POST /identity/v3/projects => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:25.967124 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5b852-00db-4fe9-8e2a-8552375485c1 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:26.057964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152f8ba-8ce4-418a-83df-4a30b1a208a4 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:26.069856 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5b852-00db-4fe9-8e2a-8552375485c1 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:26.081734 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0257b-03b4-48cc-8031-94759c883db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:26.086417 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0257b-03b4-48cc-8031-94759c883db1 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:26.086738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0257b-03b4-48cc-8031-94759c883db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:26.087005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0257b-03b4-48cc-8031-94759c883db1 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:26.087745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0257b-03b4-48cc-8031-94759c883db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:26.089712 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0257b-03b4-48cc-8031-94759c883db1 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:26.113380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1032/2069] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:25 2022] POST /identity/v3/users => generated 284 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:26.114232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0257b-03b4-48cc-8031-94759c883db1 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:26.115914 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-11f0257b-03b4-48cc-8031-94759c883db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:26.126319 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c66453-56d5-4512-bd52-3fb1464aa286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:26.127818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c66453-56d5-4512-bd52-3fb1464aa286 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:26.128108 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c66453-56d5-4512-bd52-3fb1464aa286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:26.128389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c66453-56d5-4512-bd52-3fb1464aa286 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:26.129185 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c66453-56d5-4512-bd52-3fb1464aa286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:26.129572 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0257b-03b4-48cc-8031-94759c883db1 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:26.130857 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c66453-56d5-4512-bd52-3fb1464aa286 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:26.135644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2e179-b220-4f38-93e1-47b689cc7ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:26.136703 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2e179-b220-4f38-93e1-47b689cc7ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:26.137177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2e179-b220-4f38-93e1-47b689cc7ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:26.137459 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2e179-b220-4f38-93e1-47b689cc7ae7 admin admin] PATH_INFO: `/v3/projects/7dc41ba49b2f46c09611c3f7310de0ea` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:26.138918 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2e179-b220-4f38-93e1-47b689cc7ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc41ba49b2f46c09611c3f7310de0ea)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:26.140992 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2e179-b220-4f38-93e1-47b689cc7ae7 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:26.142800 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1038/2070] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:03:26.143587 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c66453-56d5-4512-bd52-3fb1464aa286 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:26.155349 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c66453-56d5-4512-bd52-3fb1464aa286 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:26.160756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52a778-e019-4767-9872-64e56c06fa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:26.161480 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52a778-e019-4767-9872-64e56c06fa30 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:26.161765 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52a778-e019-4767-9872-64e56c06fa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:26.162064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52a778-e019-4767-9872-64e56c06fa30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:26.163126 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52a778-e019-4767-9872-64e56c06fa30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:26.165254 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52a778-e019-4767-9872-64e56c06fa30 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:26.177596 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1039/2071] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:26.178686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52a778-e019-4767-9872-64e56c06fa30 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:26.193165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52a778-e019-4767-9872-64e56c06fa30 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:26.199025 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22394425-977b-4f2c-8640-8e8aaeea5f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:26.200105 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22394425-977b-4f2c-8640-8e8aaeea5f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:26.206913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22394425-977b-4f2c-8640-8e8aaeea5f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:26.207980 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22394425-977b-4f2c-8640-8e8aaeea5f14 admin admin] PATH_INFO: `/v3/projects/3edcd25c3c3a4c4ba71f37a243b05c9d/users/7af462e9ae324c9898da0955c08249bf/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:26.210226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22394425-977b-4f2c-8640-8e8aaeea5f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3edcd25c3c3a4c4ba71f37a243b05c9d, user_id=7af462e9ae324c9898da0955c08249bf, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:26.211018 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1bc2e179-b220-4f38-93e1-47b689cc7ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc41ba49b2f46c09611c3f7310de0ea', 'request_id': 'req-1bc2e179-b220-4f38-93e1-47b689cc7ae7'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:26.213673 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22394425-977b-4f2c-8640-8e8aaeea5f14 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:26.217875 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1bc2e179-b220-4f38-93e1-47b689cc7ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc41ba49b2f46c09611c3f7310de0ea', 'request_id': 'req-1bc2e179-b220-4f38-93e1-47b689cc7ae7'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:26.230264 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1bc2e179-b220-4f38-93e1-47b689cc7ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc41ba49b2f46c09611c3f7310de0ea', 'request_id': 'req-1bc2e179-b220-4f38-93e1-47b689cc7ae7'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:26.230422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1040/2072] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:26 2022] PUT /identity/v3/projects/3edcd25c3c3a4c4ba71f37a243b05c9d/users/7af462e9ae324c9898da0955c08249bf/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:26.230422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22394425-977b-4f2c-8640-8e8aaeea5f14 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:26.250352 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1bc2e179-b220-4f38-93e1-47b689cc7ae7 admin admin] The token cache is being invalidate because project 7dc41ba49b2f46c09611c3f7310de0ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:26.250638 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1bc2e179-b220-4f38-93e1-47b689cc7ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:26.251274 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1bc2e179-b220-4f38-93e1-47b689cc7ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:26.252834 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1033/2073] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:26 2022] DELETE /identity/v3/projects/7dc41ba49b2f46c09611c3f7310de0ea => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:26.253712 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2e179-b220-4f38-93e1-47b689cc7ae7 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:26.256883 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-1bc2e179-b220-4f38-93e1-47b689cc7ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:26.296428 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22394425-977b-4f2c-8640-8e8aaeea5f14 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:26.302727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d02cb6-716e-43e2-addc-77e95e13fa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:26.303402 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d02cb6-716e-43e2-addc-77e95e13fa23 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:26.303687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d02cb6-716e-43e2-addc-77e95e13fa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:26.303965 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d02cb6-716e-43e2-addc-77e95e13fa23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:26.304738 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d02cb6-716e-43e2-addc-77e95e13fa23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:26.306419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d02cb6-716e-43e2-addc-77e95e13fa23 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:26.317495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1041/2074] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:26.319231 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c090b15-c3bf-4387-b7dc-4f39c733617c None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:26.319521 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c090b15-c3bf-4387-b7dc-4f39c733617c None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:26.319835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c090b15-c3bf-4387-b7dc-4f39c733617c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:26.329116 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2e179-b220-4f38-93e1-47b689cc7ae7 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:26.334035 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610df114-bb08-4dd8-aa73-d3ffc8004725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:26.335137 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610df114-bb08-4dd8-aa73-d3ffc8004725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:26.335434 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610df114-bb08-4dd8-aa73-d3ffc8004725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:26.335715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610df114-bb08-4dd8-aa73-d3ffc8004725 admin admin] PATH_INFO: `/v3/projects/1b006b5d944f4ad491298cb78ff3ef7a` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:26.337597 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610df114-bb08-4dd8-aa73-d3ffc8004725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b006b5d944f4ad491298cb78ff3ef7a)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:26.340111 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610df114-bb08-4dd8-aa73-d3ffc8004725 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:26.350539 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-8c090b15-c3bf-4387-b7dc-4f39c733617c None None] MFA Rules not processed for user `7af462e9ae324c9898da0955c08249bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:26.351929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-8c090b15-c3bf-4387-b7dc-4f39c733617c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:26.389587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-610df114-bb08-4dd8-aa73-d3ffc8004725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b006b5d944f4ad491298cb78ff3ef7a', 'request_id': 'req-610df114-bb08-4dd8-aa73-d3ffc8004725'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:26.394906 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-610df114-bb08-4dd8-aa73-d3ffc8004725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b006b5d944f4ad491298cb78ff3ef7a', 'request_id': 'req-610df114-bb08-4dd8-aa73-d3ffc8004725'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:26.401537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-610df114-bb08-4dd8-aa73-d3ffc8004725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b006b5d944f4ad491298cb78ff3ef7a', 'request_id': 'req-610df114-bb08-4dd8-aa73-d3ffc8004725'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:26.417957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-610df114-bb08-4dd8-aa73-d3ffc8004725 admin admin] The token cache is being invalidate because project 1b006b5d944f4ad491298cb78ff3ef7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:26.418291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-610df114-bb08-4dd8-aa73-d3ffc8004725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:26.419147 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-610df114-bb08-4dd8-aa73-d3ffc8004725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:26.420727 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1034/2075] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:26 2022] DELETE /identity/v3/projects/1b006b5d944f4ad491298cb78ff3ef7a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:26.423025 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610df114-bb08-4dd8-aa73-d3ffc8004725 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:26.424530 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-610df114-bb08-4dd8-aa73-d3ffc8004725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:26.426863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1042/2076] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:26.427827 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c090b15-c3bf-4387-b7dc-4f39c733617c None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:26.429069 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-8c090b15-c3bf-4387-b7dc-4f39c733617c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:26.443374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c090b15-c3bf-4387-b7dc-4f39c733617c None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:26.496397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610df114-bb08-4dd8-aa73-d3ffc8004725 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:26.501147 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10c57b-3e11-4d01-a337-baf410f064a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:26.502127 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10c57b-3e11-4d01-a337-baf410f064a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:26.502441 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10c57b-3e11-4d01-a337-baf410f064a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:26.502749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10c57b-3e11-4d01-a337-baf410f064a4 admin admin] PATH_INFO: `/v3/users/cacd3500f640486496fbdb4eebe9dfa6` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:26.504087 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10c57b-3e11-4d01-a337-baf410f064a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cacd3500f640486496fbdb4eebe9dfa6)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:26.506022 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10c57b-3e11-4d01-a337-baf410f064a4 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:26.518160 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff9984-6948-4e55-9a9c-65b6f3a82930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:26.519147 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff9984-6948-4e55-9a9c-65b6f3a82930 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:26.519521 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff9984-6948-4e55-9a9c-65b6f3a82930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:26.519889 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff9984-6948-4e55-9a9c-65b6f3a82930 admin admin] PATH_INFO: `/v3/projects/ee56f2fd63494a71aedfda53dc9ddf33/users/af68eaf58603445799ade165dd782c3f/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:26.535522 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff9984-6948-4e55-9a9c-65b6f3a82930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee56f2fd63494a71aedfda53dc9ddf33, user_id=af68eaf58603445799ade165dd782c3f, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:26.538134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff9984-6948-4e55-9a9c-65b6f3a82930 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:26.560218 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1043/2077] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:26 2022] PUT /identity/v3/projects/ee56f2fd63494a71aedfda53dc9ddf33/users/af68eaf58603445799ade165dd782c3f/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:26.563906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a65db-7276-4008-830f-e892c4296378 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:26.564274 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a65db-7276-4008-830f-e892c4296378 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:26.564635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a65db-7276-4008-830f-e892c4296378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:26.565634 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-3a10c57b-3e11-4d01-a337-baf410f064a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cacd3500f640486496fbdb4eebe9dfa6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:26.574541 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-3a10c57b-3e11-4d01-a337-baf410f064a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cacd3500f640486496fbdb4eebe9dfa6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:26.584418 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-de9a65db-7276-4008-830f-e892c4296378 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:26.585635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-de9a65db-7276-4008-830f-e892c4296378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:26.589327 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-3a10c57b-3e11-4d01-a337-baf410f064a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cacd3500f640486496fbdb4eebe9dfa6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:26.590254 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-3a10c57b-3e11-4d01-a337-baf410f064a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cacd3500f640486496fbdb4eebe9dfa6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:26.590828 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-3a10c57b-3e11-4d01-a337-baf410f064a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cacd3500f640486496fbdb4eebe9dfa6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:26.609355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1035/2078] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:26 2022] DELETE /identity/v3/users/cacd3500f640486496fbdb4eebe9dfa6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:26.609355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10c57b-3e11-4d01-a337-baf410f064a4 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:26.609355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-3a10c57b-3e11-4d01-a337-baf410f064a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:26.683315 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1044/2079] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:26.685269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55b928-ee6b-4a88-803a-9781d8c161ed None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:26.685577 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55b928-ee6b-4a88-803a-9781d8c161ed None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:26.685915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55b928-ee6b-4a88-803a-9781d8c161ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:26.700336 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10c57b-3e11-4d01-a337-baf410f064a4 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:26.704604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b765c-698d-4d07-8d01-da66c9e45570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:26.710336 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b765c-698d-4d07-8d01-da66c9e45570 service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:26.710336 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b765c-698d-4d07-8d01-da66c9e45570 service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:26.710336 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b765c-698d-4d07-8d01-da66c9e45570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:26.716330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-1b2b765c-698d-4d07-8d01-da66c9e45570 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:26.740340 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-6e55b928-ee6b-4a88-803a-9781d8c161ed None None] MFA Rules not processed for user `af68eaf58603445799ade165dd782c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:26.743469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-6e55b928-ee6b-4a88-803a-9781d8c161ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:26.816859 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b765c-698d-4d07-8d01-da66c9e45570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:26.818414 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b765c-698d-4d07-8d01-da66c9e45570 service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:26.829576 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1036/2080] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:26.831035 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6480631-4755-40cf-a777-bdee5ccca20c None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:26.840307 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6480631-4755-40cf-a777-bdee5ccca20c None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:26.840727 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6480631-4755-40cf-a777-bdee5ccca20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:26.869044 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-d6480631-4755-40cf-a777-bdee5ccca20c None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:26.870858 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-d6480631-4755-40cf-a777-bdee5ccca20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:26.924224 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1045/2081] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:26.935349 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55b928-ee6b-4a88-803a-9781d8c161ed None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:26.936946 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-6e55b928-ee6b-4a88-803a-9781d8c161ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:26.946885 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1037/2082] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:26.951083 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6480631-4755-40cf-a777-bdee5ccca20c None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:26.960806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6480631-4755-40cf-a777-bdee5ccca20c None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:26.963771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55b928-ee6b-4a88-803a-9781d8c161ed None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:26.966554 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c844313-6570-443e-a4b1-2ee232dd9f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:26.967228 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c844313-6570-443e-a4b1-2ee232dd9f4e admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:26.967513 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c844313-6570-443e-a4b1-2ee232dd9f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:26.967788 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c844313-6570-443e-a4b1-2ee232dd9f4e admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:26.968523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c844313-6570-443e-a4b1-2ee232dd9f4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:03:26.968829 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c844313-6570-443e-a4b1-2ee232dd9f4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:26.970185 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282008fe-1fec-456f-b37e-8fdb97fc317b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:26.970680 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c844313-6570-443e-a4b1-2ee232dd9f4e admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:26.971013 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282008fe-1fec-456f-b37e-8fdb97fc317b admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:26.971706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282008fe-1fec-456f-b37e-8fdb97fc317b admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:26.972047 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282008fe-1fec-456f-b37e-8fdb97fc317b admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:26.973467 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282008fe-1fec-456f-b37e-8fdb97fc317b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:26.975578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282008fe-1fec-456f-b37e-8fdb97fc317b admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:26.985825 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1038/2083] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:03:26.990100 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c844313-6570-443e-a4b1-2ee232dd9f4e admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:27.002794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c844313-6570-443e-a4b1-2ee232dd9f4e admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:27.008885 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810d339-e8a5-498e-b9bf-58f0775936f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:27.009737 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810d339-e8a5-498e-b9bf-58f0775936f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:27.010030 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810d339-e8a5-498e-b9bf-58f0775936f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:27.010348 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810d339-e8a5-498e-b9bf-58f0775936f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:27.011279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810d339-e8a5-498e-b9bf-58f0775936f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:27.013354 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810d339-e8a5-498e-b9bf-58f0775936f8 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:27.019193 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1046/2084] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:26 2022] POST /identity/v3/projects => generated 365 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:27.020520 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282008fe-1fec-456f-b37e-8fdb97fc317b admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:27.061157 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1039/2085] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:26 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:27.062298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810d339-e8a5-498e-b9bf-58f0775936f8 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:27.118546 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282008fe-1fec-456f-b37e-8fdb97fc317b admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:27.154237 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810d339-e8a5-498e-b9bf-58f0775936f8 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:27.162422 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8c7f1-33a6-4b05-86e4-c1ed0dfcd968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:27.163451 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8c7f1-33a6-4b05-86e4-c1ed0dfcd968 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:27.163940 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8c7f1-33a6-4b05-86e4-c1ed0dfcd968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:27.165192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8c7f1-33a6-4b05-86e4-c1ed0dfcd968 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:27.166399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8c7f1-33a6-4b05-86e4-c1ed0dfcd968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:27.168805 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8c7f1-33a6-4b05-86e4-c1ed0dfcd968 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:27.198704 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1040/2086] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:27 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:27.203049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8c7f1-33a6-4b05-86e4-c1ed0dfcd968 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:27.204774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b25768-b5e6-43a8-a125-1feeb1c90c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:27.205488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b25768-b5e6-43a8-a125-1feeb1c90c3e admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:27.205618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b0f8c7f1-33a6-4b05-86e4-c1ed0dfcd968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:27.205762 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b25768-b5e6-43a8-a125-1feeb1c90c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:27.206036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b25768-b5e6-43a8-a125-1feeb1c90c3e admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:27.206811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b25768-b5e6-43a8-a125-1feeb1c90c3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:27.209213 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b25768-b5e6-43a8-a125-1feeb1c90c3e admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:27.222962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8c7f1-33a6-4b05-86e4-c1ed0dfcd968 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:27.229347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14721136-5e2e-478e-a4d8-56edf9437961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:27.230250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14721136-5e2e-478e-a4d8-56edf9437961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:27.230653 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14721136-5e2e-478e-a4d8-56edf9437961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:27.230794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14721136-5e2e-478e-a4d8-56edf9437961 admin admin] PATH_INFO: `/v3/projects/a4ff43c6854442d499a0c0e73d78ac60` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:27.232300 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14721136-5e2e-478e-a4d8-56edf9437961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4ff43c6854442d499a0c0e73d78ac60)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:27.234462 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14721136-5e2e-478e-a4d8-56edf9437961 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:27.238566 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1047/2087] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:27 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:27.239615 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b25768-b5e6-43a8-a125-1feeb1c90c3e admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:27.250043 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b25768-b5e6-43a8-a125-1feeb1c90c3e admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:27.255448 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4d52b-e9ef-4c83-a64c-5c00ff4f7665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:27.256108 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4d52b-e9ef-4c83-a64c-5c00ff4f7665 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:27.256393 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4d52b-e9ef-4c83-a64c-5c00ff4f7665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:27.256689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4d52b-e9ef-4c83-a64c-5c00ff4f7665 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:27.257396 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4d52b-e9ef-4c83-a64c-5c00ff4f7665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:27.265800 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4d52b-e9ef-4c83-a64c-5c00ff4f7665 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:27.278414 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1048/2088] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:27.279369 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4d52b-e9ef-4c83-a64c-5c00ff4f7665 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:27.290881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4d52b-e9ef-4c83-a64c-5c00ff4f7665 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:27.294910 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-14721136-5e2e-478e-a4d8-56edf9437961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4ff43c6854442d499a0c0e73d78ac60', 'request_id': 'req-14721136-5e2e-478e-a4d8-56edf9437961'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:27.301621 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-14721136-5e2e-478e-a4d8-56edf9437961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4ff43c6854442d499a0c0e73d78ac60', 'request_id': 'req-14721136-5e2e-478e-a4d8-56edf9437961'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:27.309626 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-14721136-5e2e-478e-a4d8-56edf9437961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4ff43c6854442d499a0c0e73d78ac60', 'request_id': 'req-14721136-5e2e-478e-a4d8-56edf9437961'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:27.329494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-14721136-5e2e-478e-a4d8-56edf9437961 admin admin] The token cache is being invalidate because project a4ff43c6854442d499a0c0e73d78ac60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:27.329782 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-14721136-5e2e-478e-a4d8-56edf9437961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:27.330607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-14721136-5e2e-478e-a4d8-56edf9437961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:27.332280 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1041/2089] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:27 2022] DELETE /identity/v3/projects/a4ff43c6854442d499a0c0e73d78ac60 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:27.332958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14721136-5e2e-478e-a4d8-56edf9437961 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:27.334315 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-14721136-5e2e-478e-a4d8-56edf9437961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:27.364828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e8989-4dfd-43c2-b513-55e5ce2eb744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:27.365628 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e8989-4dfd-43c2-b513-55e5ce2eb744 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:27.365963 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e8989-4dfd-43c2-b513-55e5ce2eb744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:27.366270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e8989-4dfd-43c2-b513-55e5ce2eb744 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:27.367003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e8989-4dfd-43c2-b513-55e5ce2eb744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:27.369513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e8989-4dfd-43c2-b513-55e5ce2eb744 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:27.379909 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1049/2090] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:27.381488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182d7de-7c08-42cd-a908-6ab56f2bb467 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:27.381774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182d7de-7c08-42cd-a908-6ab56f2bb467 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:27.382101 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182d7de-7c08-42cd-a908-6ab56f2bb467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:27.402312 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-7182d7de-7c08-42cd-a908-6ab56f2bb467 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:27.403527 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-7182d7de-7c08-42cd-a908-6ab56f2bb467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:27.410622 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14721136-5e2e-478e-a4d8-56edf9437961 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:27.412588 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1050/2091] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:27.413435 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182d7de-7c08-42cd-a908-6ab56f2bb467 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:27.414928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-7182d7de-7c08-42cd-a908-6ab56f2bb467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:27.416565 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821ac87-0c50-469b-94aa-990e3b47b093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:27.417232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821ac87-0c50-469b-94aa-990e3b47b093 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:27.417513 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821ac87-0c50-469b-94aa-990e3b47b093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:27.417809 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821ac87-0c50-469b-94aa-990e3b47b093 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:27.418563 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821ac87-0c50-469b-94aa-990e3b47b093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:27.420420 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821ac87-0c50-469b-94aa-990e3b47b093 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:27.426551 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182d7de-7c08-42cd-a908-6ab56f2bb467 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:27.431551 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1042/2092] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:27.432808 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7015a-c2a9-40d8-8c2a-afa28e5db68f None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:27.433095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7015a-c2a9-40d8-8c2a-afa28e5db68f None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:27.433369 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7015a-c2a9-40d8-8c2a-afa28e5db68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:27.435230 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946ee69-d3e6-481b-8911-4c92904202a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:27.436130 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946ee69-d3e6-481b-8911-4c92904202a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:27.436411 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946ee69-d3e6-481b-8911-4c92904202a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:27.436683 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946ee69-d3e6-481b-8911-4c92904202a0 admin admin] PATH_INFO: `/v3/projects/956a9a8e2de84eb78e309d2e1fb5b5c5/users/b41d72ba19ab458b805a4faba0576711/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:27.451804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946ee69-d3e6-481b-8911-4c92904202a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=956a9a8e2de84eb78e309d2e1fb5b5c5, user_id=b41d72ba19ab458b805a4faba0576711, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:27.452417 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-76d7015a-c2a9-40d8-8c2a-afa28e5db68f None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:27.453755 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-76d7015a-c2a9-40d8-8c2a-afa28e5db68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:27.454488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946ee69-d3e6-481b-8911-4c92904202a0 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:27.462064 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1043/2093] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:27.462967 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7015a-c2a9-40d8-8c2a-afa28e5db68f None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:27.467797 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1051/2094] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:27 2022] PUT /identity/v3/projects/956a9a8e2de84eb78e309d2e1fb5b5c5/users/b41d72ba19ab458b805a4faba0576711/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:27.469090 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946ee69-d3e6-481b-8911-4c92904202a0 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:27.472608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7015a-c2a9-40d8-8c2a-afa28e5db68f None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:27.528369 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976cf30-a920-4381-af22-2c901e3d092c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:27.529259 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976cf30-a920-4381-af22-2c901e3d092c admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:27.529537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976cf30-a920-4381-af22-2c901e3d092c admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:27.529804 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976cf30-a920-4381-af22-2c901e3d092c admin admin] PATH_INFO: `/v3/projects/8da3711ec3034c158c91bfac934b7c19/users/b37334ca923c4b1cac64ccd4e57215e8/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:27.534806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946ee69-d3e6-481b-8911-4c92904202a0 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:27.540232 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a599186-de79-495b-9851-51eb7379ec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:27.541046 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a599186-de79-495b-9851-51eb7379ec35 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:27.542009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a599186-de79-495b-9851-51eb7379ec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:27.542324 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a599186-de79-495b-9851-51eb7379ec35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:27.543076 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a599186-de79-495b-9851-51eb7379ec35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:03:27.543379 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a599186-de79-495b-9851-51eb7379ec35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:27.544983 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a599186-de79-495b-9851-51eb7379ec35 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:27.546432 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976cf30-a920-4381-af22-2c901e3d092c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8da3711ec3034c158c91bfac934b7c19, user_id=b37334ca923c4b1cac64ccd4e57215e8, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:27.549182 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976cf30-a920-4381-af22-2c901e3d092c admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:27.562552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1052/2095] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:03:27.562552 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a599186-de79-495b-9851-51eb7379ec35 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:27.563182 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1044/2096] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:27 2022] PUT /identity/v3/projects/8da3711ec3034c158c91bfac934b7c19/users/b37334ca923c4b1cac64ccd4e57215e8/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:27.563980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976cf30-a920-4381-af22-2c901e3d092c admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:27.576009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a599186-de79-495b-9851-51eb7379ec35 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:27.625546 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976cf30-a920-4381-af22-2c901e3d092c admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:27.630379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d642a-c250-48df-8d88-6b60100f1e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:27.631030 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d642a-c250-48df-8d88-6b60100f1e0d admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:27.631313 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d642a-c250-48df-8d88-6b60100f1e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:27.631583 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d642a-c250-48df-8d88-6b60100f1e0d admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:27.632267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d642a-c250-48df-8d88-6b60100f1e0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:27.634186 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d642a-c250-48df-8d88-6b60100f1e0d admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:27.635686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae993e-3b70-4baf-9840-e7d075abf6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:27.636364 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae993e-3b70-4baf-9840-e7d075abf6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:27.636647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae993e-3b70-4baf-9840-e7d075abf6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:27.636920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae993e-3b70-4baf-9840-e7d075abf6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:27.637650 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae993e-3b70-4baf-9840-e7d075abf6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:27.639260 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae993e-3b70-4baf-9840-e7d075abf6e2 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:27.650148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1053/2097] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:27.651413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b376707-eb2e-4024-b3d6-0730528a4f44 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:27.651709 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b376707-eb2e-4024-b3d6-0730528a4f44 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:27.651981 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b376707-eb2e-4024-b3d6-0730528a4f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:27.665370 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1045/2098] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:27 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:27.669358 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d642a-c250-48df-8d88-6b60100f1e0d admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:27.682838 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-3b376707-eb2e-4024-b3d6-0730528a4f44 None None] MFA Rules not processed for user `b37334ca923c4b1cac64ccd4e57215e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:27.684068 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-3b376707-eb2e-4024-b3d6-0730528a4f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:27.732456 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d642a-c250-48df-8d88-6b60100f1e0d admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:27.737631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b911845-3b92-4de9-a919-822883222db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:27.738561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b911845-3b92-4de9-a919-822883222db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:27.738847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b911845-3b92-4de9-a919-822883222db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:27.739122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b911845-3b92-4de9-a919-822883222db1 admin admin] PATH_INFO: `/v3/projects/956a9a8e2de84eb78e309d2e1fb5b5c5/users/b41d72ba19ab458b805a4faba0576711/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:27.741232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b911845-3b92-4de9-a919-822883222db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=956a9a8e2de84eb78e309d2e1fb5b5c5, user_id=b41d72ba19ab458b805a4faba0576711, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:27.746265 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b911845-3b92-4de9-a919-822883222db1 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:27.755161 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1054/2099] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:27.755878 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b376707-eb2e-4024-b3d6-0730528a4f44 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:27.762346 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1046/2100] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:27 2022] PUT /identity/v3/projects/956a9a8e2de84eb78e309d2e1fb5b5c5/users/b41d72ba19ab458b805a4faba0576711/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:27.767466 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b911845-3b92-4de9-a919-822883222db1 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:27.769173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-1b911845-3b92-4de9-a919-822883222db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:27.775734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b376707-eb2e-4024-b3d6-0730528a4f44 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:27.830448 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b911845-3b92-4de9-a919-822883222db1 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:27.837227 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977271e1-6929-4ecd-9d7f-0b1221918bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:27.837920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977271e1-6929-4ecd-9d7f-0b1221918bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:27.838244 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977271e1-6929-4ecd-9d7f-0b1221918bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:27.838520 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977271e1-6929-4ecd-9d7f-0b1221918bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:27.839046 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78852a8-dde7-4abf-af92-3615bebd567e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:27.839247 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977271e1-6929-4ecd-9d7f-0b1221918bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:27.839697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78852a8-dde7-4abf-af92-3615bebd567e service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:27.839976 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78852a8-dde7-4abf-af92-3615bebd567e service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:27.840246 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78852a8-dde7-4abf-af92-3615bebd567e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:27.841170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977271e1-6929-4ecd-9d7f-0b1221918bc1 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:27.870702 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1055/2101] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:27 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:27.870702 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fea2f-4cb3-4f97-9a0f-59c97d51543e None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:27.870702 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fea2f-4cb3-4f97-9a0f-59c97d51543e None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:27.870702 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fea2f-4cb3-4f97-9a0f-59c97d51543e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:27.902780 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-b29fea2f-4cb3-4f97-9a0f-59c97d51543e None None] MFA Rules not processed for user `b41d72ba19ab458b805a4faba0576711`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:27.903287 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78852a8-dde7-4abf-af92-3615bebd567e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:27.904134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-b29fea2f-4cb3-4f97-9a0f-59c97d51543e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:27.905002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78852a8-dde7-4abf-af92-3615bebd567e service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:27.918255 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1047/2102] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:03:27.919405 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78852a8-dde7-4abf-af92-3615bebd567e service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:27.938250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78852a8-dde7-4abf-af92-3615bebd567e service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:27.938626 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308f7e7-435b-47cc-b06b-2e047ec6b644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:27.939327 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308f7e7-435b-47cc-b06b-2e047ec6b644 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:27.939607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308f7e7-435b-47cc-b06b-2e047ec6b644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:27.939878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308f7e7-435b-47cc-b06b-2e047ec6b644 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:27.940612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308f7e7-435b-47cc-b06b-2e047ec6b644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:27.942234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308f7e7-435b-47cc-b06b-2e047ec6b644 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:27.953971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1048/2103] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:27.957832 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308f7e7-435b-47cc-b06b-2e047ec6b644 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:27.975460 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308f7e7-435b-47cc-b06b-2e047ec6b644 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:27.982665 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb75f30-ca91-4ad2-985d-7cc5e3e2ed9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:27.984410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb75f30-ca91-4ad2-985d-7cc5e3e2ed9c admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:27.984990 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb75f30-ca91-4ad2-985d-7cc5e3e2ed9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:27.985529 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb75f30-ca91-4ad2-985d-7cc5e3e2ed9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:27.986854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb75f30-ca91-4ad2-985d-7cc5e3e2ed9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:27.988699 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb75f30-ca91-4ad2-985d-7cc5e3e2ed9c admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:28.004275 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1049/2104] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:28.008211 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb75f30-ca91-4ad2-985d-7cc5e3e2ed9c admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:28.020976 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb75f30-ca91-4ad2-985d-7cc5e3e2ed9c admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:28.027753 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852efc0f-f1c8-4c87-beea-a27d6c442ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:28.029035 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852efc0f-f1c8-4c87-beea-a27d6c442ff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:28.029035 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852efc0f-f1c8-4c87-beea-a27d6c442ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:28.029322 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852efc0f-f1c8-4c87-beea-a27d6c442ff4 admin admin] PATH_INFO: `/v3/projects/97d2e3d2d959400b9b559eddff4eafc4/users/7a5dcbc619e14c09bf65fe1555a76ed5/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:28.034547 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1056/2105] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:28.050618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852efc0f-f1c8-4c87-beea-a27d6c442ff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97d2e3d2d959400b9b559eddff4eafc4, user_id=7a5dcbc619e14c09bf65fe1555a76ed5, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:28.051103 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fea2f-4cb3-4f97-9a0f-59c97d51543e None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:28.052627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-b29fea2f-4cb3-4f97-9a0f-59c97d51543e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:28.053727 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852efc0f-f1c8-4c87-beea-a27d6c442ff4 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:28.070767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1050/2106] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:28 2022] PUT /identity/v3/projects/97d2e3d2d959400b9b559eddff4eafc4/users/7a5dcbc619e14c09bf65fe1555a76ed5/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:28.086522 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d1c2b-0ea6-4682-8ddd-62d58ca843ec None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:28.086522 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d1c2b-0ea6-4682-8ddd-62d58ca843ec None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:28.086522 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d1c2b-0ea6-4682-8ddd-62d58ca843ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:28.088265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fea2f-4cb3-4f97-9a0f-59c97d51543e None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:28.147289 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-6c7d1c2b-0ea6-4682-8ddd-62d58ca843ec None None] MFA Rules not processed for user `7a5dcbc619e14c09bf65fe1555a76ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:28.149798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-6c7d1c2b-0ea6-4682-8ddd-62d58ca843ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:28.159281 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29559179-e751-452a-b9b1-38a93f364c42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:28.160101 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29559179-e751-452a-b9b1-38a93f364c42 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:28.160419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29559179-e751-452a-b9b1-38a93f364c42 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:28.160720 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29559179-e751-452a-b9b1-38a93f364c42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:28.255631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1051/2107] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:28.261270 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d1c2b-0ea6-4682-8ddd-62d58ca843ec None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:28.278298 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29559179-e751-452a-b9b1-38a93f364c42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:28.279924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29559179-e751-452a-b9b1-38a93f364c42 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:28.318967 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1057/2108] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:28 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:03:28.357140 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d1c2b-0ea6-4682-8ddd-62d58ca843ec None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:28.362421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ae3b8-b5fd-42ef-802a-b1e6f4d7da7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:28.363422 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ae3b8-b5fd-42ef-802a-b1e6f4d7da7f admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:28.363639 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ae3b8-b5fd-42ef-802a-b1e6f4d7da7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:28.364302 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ae3b8-b5fd-42ef-802a-b1e6f4d7da7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:28.365064 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ae3b8-b5fd-42ef-802a-b1e6f4d7da7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:28.369490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ae3b8-b5fd-42ef-802a-b1e6f4d7da7f admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:28.436671 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1052/2109] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:28 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:28.438190 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29559179-e751-452a-b9b1-38a93f364c42 service cinder] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:28.454810 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29559179-e751-452a-b9b1-38a93f364c42 service cinder] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:28.466957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ae3b8-b5fd-42ef-802a-b1e6f4d7da7f admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:28.557913 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ae3b8-b5fd-42ef-802a-b1e6f4d7da7f admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:28.561748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a53a66-1778-4cbe-ab76-80ec6230fc73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:28.562974 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a53a66-1778-4cbe-ab76-80ec6230fc73 service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:28.563335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a53a66-1778-4cbe-ab76-80ec6230fc73 service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:28.563662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a53a66-1778-4cbe-ab76-80ec6230fc73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:28.566124 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-08a53a66-1778-4cbe-ab76-80ec6230fc73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:28.586146 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87d79d-8834-4ef5-b92e-a4ecf331e786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:28.586146 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87d79d-8834-4ef5-b92e-a4ecf331e786 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:28.586146 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87d79d-8834-4ef5-b92e-a4ecf331e786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:28.586146 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87d79d-8834-4ef5-b92e-a4ecf331e786 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:28.587091 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87d79d-8834-4ef5-b92e-a4ecf331e786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:28.587091 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87d79d-8834-4ef5-b92e-a4ecf331e786 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:28.615415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1058/2110] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:28 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:28.623203 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87d79d-8834-4ef5-b92e-a4ecf331e786 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:28.634316 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a53a66-1778-4cbe-ab76-80ec6230fc73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:28.635869 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a53a66-1778-4cbe-ab76-80ec6230fc73 service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:28.636172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87d79d-8834-4ef5-b92e-a4ecf331e786 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:28.641353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d191c-2e06-408c-9347-16f53de54231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:28.642030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d191c-2e06-408c-9347-16f53de54231 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:28.642356 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d191c-2e06-408c-9347-16f53de54231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:28.642653 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d191c-2e06-408c-9347-16f53de54231 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:28.643405 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d191c-2e06-408c-9347-16f53de54231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:28.644934 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d191c-2e06-408c-9347-16f53de54231 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:28.650866 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1053/2111] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:03:28.659719 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1059/2112] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:28.661335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d191c-2e06-408c-9347-16f53de54231 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:28.661452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a53a66-1778-4cbe-ab76-80ec6230fc73 service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:28.671529 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a53a66-1778-4cbe-ab76-80ec6230fc73 service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:28.671937 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d191c-2e06-408c-9347-16f53de54231 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:28.676045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935bc77-345a-4346-9835-478d2c7cb933 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:28.676863 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935bc77-345a-4346-9835-478d2c7cb933 service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:28.677232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935bc77-345a-4346-9835-478d2c7cb933 service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:28.677623 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935bc77-345a-4346-9835-478d2c7cb933 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:28.678563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62909f28-a90f-49b8-ab19-ad6b10dd54ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:28.679709 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62909f28-a90f-49b8-ab19-ad6b10dd54ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:28.679823 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-0935bc77-345a-4346-9835-478d2c7cb933 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:28.680773 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62909f28-a90f-49b8-ab19-ad6b10dd54ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:28.680969 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62909f28-a90f-49b8-ab19-ad6b10dd54ee admin admin] PATH_INFO: `/v3/projects/d09a6be94afb457286ec776cd7a50e35/users/4ea07b80d6d14b7498cfddb36487fdb1/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:28.703003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62909f28-a90f-49b8-ab19-ad6b10dd54ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09a6be94afb457286ec776cd7a50e35, user_id=4ea07b80d6d14b7498cfddb36487fdb1, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:28.706290 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62909f28-a90f-49b8-ab19-ad6b10dd54ee admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:28.725195 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1060/2113] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:28 2022] PUT /identity/v3/projects/d09a6be94afb457286ec776cd7a50e35/users/4ea07b80d6d14b7498cfddb36487fdb1/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:28.729126 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62909f28-a90f-49b8-ab19-ad6b10dd54ee admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:28.770937 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935bc77-345a-4346-9835-478d2c7cb933 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:28.776448 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935bc77-345a-4346-9835-478d2c7cb933 service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:28.790345 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1054/2114] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:28.830366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62909f28-a90f-49b8-ab19-ad6b10dd54ee admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:28.843903 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b64c41-b683-4d97-8e45-ece1d1dd3ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:28.844932 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b64c41-b683-4d97-8e45-ece1d1dd3ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:28.845369 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b64c41-b683-4d97-8e45-ece1d1dd3ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:28.845798 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b64c41-b683-4d97-8e45-ece1d1dd3ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:28.846739 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b64c41-b683-4d97-8e45-ece1d1dd3ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:28.849206 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b64c41-b683-4d97-8e45-ece1d1dd3ee5 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:28.869964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1061/2115] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:03:28.873760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935bc77-345a-4346-9835-478d2c7cb933 service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:28.904995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b64c41-b683-4d97-8e45-ece1d1dd3ee5 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:28.907366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f1b64c41-b683-4d97-8e45-ece1d1dd3ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:28.911139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935bc77-345a-4346-9835-478d2c7cb933 service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:28.920880 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd038e8-a26d-41ac-954d-b4876e4a48c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:28.922349 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd038e8-a26d-41ac-954d-b4876e4a48c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:28.923005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd038e8-a26d-41ac-954d-b4876e4a48c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:28.924220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd038e8-a26d-41ac-954d-b4876e4a48c8 admin admin] PATH_INFO: `/v3/projects/d09a6be94afb457286ec776cd7a50e35/users/4ea07b80d6d14b7498cfddb36487fdb1/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:28.927483 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd038e8-a26d-41ac-954d-b4876e4a48c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09a6be94afb457286ec776cd7a50e35, user_id=4ea07b80d6d14b7498cfddb36487fdb1, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:28.932612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd038e8-a26d-41ac-954d-b4876e4a48c8 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:28.933436 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b64c41-b683-4d97-8e45-ece1d1dd3ee5 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:28.942860 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14fcd8-fde1-476f-97ef-fe341644908b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:28.944100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14fcd8-fde1-476f-97ef-fe341644908b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:28.944367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14fcd8-fde1-476f-97ef-fe341644908b admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:28.944703 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14fcd8-fde1-476f-97ef-fe341644908b admin admin] PATH_INFO: `/v3/users/f57a715b890443d78579a056f0a9ff51` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:28.946844 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14fcd8-fde1-476f-97ef-fe341644908b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f57a715b890443d78579a056f0a9ff51)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:28.949021 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14fcd8-fde1-476f-97ef-fe341644908b admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:28.957711 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1055/2116] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:28 2022] PUT /identity/v3/projects/d09a6be94afb457286ec776cd7a50e35/users/4ea07b80d6d14b7498cfddb36487fdb1/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:28.959989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e3f5c-94e4-4b2c-b5ef-3352fbc861a2 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:28.960654 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e3f5c-94e4-4b2c-b5ef-3352fbc861a2 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:28.961038 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e3f5c-94e4-4b2c-b5ef-3352fbc861a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:29.006557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-533e3f5c-94e4-4b2c-b5ef-3352fbc861a2 None None] MFA Rules not processed for user `4ea07b80d6d14b7498cfddb36487fdb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:29.007880 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-533e3f5c-94e4-4b2c-b5ef-3352fbc861a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:29.036286 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6b14fcd8-fde1-476f-97ef-fe341644908b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f57a715b890443d78579a056f0a9ff51'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:29.038163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6b14fcd8-fde1-476f-97ef-fe341644908b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f57a715b890443d78579a056f0a9ff51'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:29.056047 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6b14fcd8-fde1-476f-97ef-fe341644908b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f57a715b890443d78579a056f0a9ff51'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:29.073398 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6b14fcd8-fde1-476f-97ef-fe341644908b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f57a715b890443d78579a056f0a9ff51'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:29.087520 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6b14fcd8-fde1-476f-97ef-fe341644908b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f57a715b890443d78579a056f0a9ff51'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:29.096600 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1062/2117] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:28 2022] DELETE /identity/v3/users/f57a715b890443d78579a056f0a9ff51 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:29.117005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1056/2118] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:29.127092 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14fcd8-fde1-476f-97ef-fe341644908b admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:29.128670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-6b14fcd8-fde1-476f-97ef-fe341644908b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:29.203698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14fcd8-fde1-476f-97ef-fe341644908b admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:29.208110 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a7fa8-e408-4043-a98f-704d78ed1b91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:29.208439 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a7fa8-e408-4043-a98f-704d78ed1b91 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:29.208719 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a7fa8-e408-4043-a98f-704d78ed1b91 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:29.208989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a7fa8-e408-4043-a98f-704d78ed1b91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:29.277705 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a7fa8-e408-4043-a98f-704d78ed1b91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:29.279771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a7fa8-e408-4043-a98f-704d78ed1b91 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:29.292714 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e3f5c-94e4-4b2c-b5ef-3352fbc861a2 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:29.294116 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-533e3f5c-94e4-4b2c-b5ef-3352fbc861a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:29.297594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1063/2119] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:29.332706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a7fa8-e408-4043-a98f-704d78ed1b91 service cinder] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:29.334541 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f85a7fa8-e408-4043-a98f-704d78ed1b91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:29.385247 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e3f5c-94e4-4b2c-b5ef-3352fbc861a2 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:29.418998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a7fa8-e408-4043-a98f-704d78ed1b91 service cinder] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:29.425679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c578ce6-e38b-4ded-8396-9d064d2e8820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:29.427004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c578ce6-e38b-4ded-8396-9d064d2e8820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:29.427292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c578ce6-e38b-4ded-8396-9d064d2e8820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:29.427684 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c578ce6-e38b-4ded-8396-9d064d2e8820 admin admin] PATH_INFO: `/v3/users/7a5dcbc619e14c09bf65fe1555a76ed5` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:29.430555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c578ce6-e38b-4ded-8396-9d064d2e8820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a5dcbc619e14c09bf65fe1555a76ed5)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:29.432519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c578ce6-e38b-4ded-8396-9d064d2e8820 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:29.502326 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7850c-967f-4935-8ef1-2b1fd37652d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:29.503511 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7850c-967f-4935-8ef1-2b1fd37652d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:29.503848 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7850c-967f-4935-8ef1-2b1fd37652d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:29.504277 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7850c-967f-4935-8ef1-2b1fd37652d1 admin admin] PATH_INFO: `/v3/projects/db378765a65d4ed59cf60275bc325525` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:29.505926 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7850c-967f-4935-8ef1-2b1fd37652d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db378765a65d4ed59cf60275bc325525)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:29.508799 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7850c-967f-4935-8ef1-2b1fd37652d1 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:29.522639 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6c578ce6-e38b-4ded-8396-9d064d2e8820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a5dcbc619e14c09bf65fe1555a76ed5'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:29.523630 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6c578ce6-e38b-4ded-8396-9d064d2e8820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a5dcbc619e14c09bf65fe1555a76ed5'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:29.555303 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6c578ce6-e38b-4ded-8396-9d064d2e8820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a5dcbc619e14c09bf65fe1555a76ed5'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:29.567721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6c578ce6-e38b-4ded-8396-9d064d2e8820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a5dcbc619e14c09bf65fe1555a76ed5'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:29.581733 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6c578ce6-e38b-4ded-8396-9d064d2e8820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a5dcbc619e14c09bf65fe1555a76ed5'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:29.589462 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-baf7850c-967f-4935-8ef1-2b1fd37652d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db378765a65d4ed59cf60275bc325525', 'request_id': 'req-baf7850c-967f-4935-8ef1-2b1fd37652d1'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:29.594115 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1064/2120] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:29 2022] DELETE /identity/v3/users/7a5dcbc619e14c09bf65fe1555a76ed5 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:29.596814 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c578ce6-e38b-4ded-8396-9d064d2e8820 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:29.598015 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-6c578ce6-e38b-4ded-8396-9d064d2e8820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:29.601281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-baf7850c-967f-4935-8ef1-2b1fd37652d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db378765a65d4ed59cf60275bc325525', 'request_id': 'req-baf7850c-967f-4935-8ef1-2b1fd37652d1'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:29.609054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-baf7850c-967f-4935-8ef1-2b1fd37652d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db378765a65d4ed59cf60275bc325525', 'request_id': 'req-baf7850c-967f-4935-8ef1-2b1fd37652d1'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:29.624356 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-baf7850c-967f-4935-8ef1-2b1fd37652d1 admin admin] The token cache is being invalidate because project db378765a65d4ed59cf60275bc325525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:29.625001 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-baf7850c-967f-4935-8ef1-2b1fd37652d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:29.625289 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-baf7850c-967f-4935-8ef1-2b1fd37652d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:29.627230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1057/2121] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:29 2022] DELETE /identity/v3/projects/db378765a65d4ed59cf60275bc325525 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:29.628239 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a5ed9-025c-498e-b8b7-e05dd594c316 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:29.628517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a5ed9-025c-498e-b8b7-e05dd594c316 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:29.628790 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a5ed9-025c-498e-b8b7-e05dd594c316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:29.648049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-aa6a5ed9-025c-498e-b8b7-e05dd594c316 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:29.649820 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-aa6a5ed9-025c-498e-b8b7-e05dd594c316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:29.686042 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c578ce6-e38b-4ded-8396-9d064d2e8820 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:29.691123 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6465ad8-f87b-4aec-a396-5b675a6692b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:29.691877 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6465ad8-f87b-4aec-a396-5b675a6692b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:29.692166 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6465ad8-f87b-4aec-a396-5b675a6692b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:29.692441 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6465ad8-f87b-4aec-a396-5b675a6692b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:29.695004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-e6465ad8-f87b-4aec-a396-5b675a6692b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:29.716414 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1058/2122] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:29.717890 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f37cb-496f-4052-bfc7-77a397735d78 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:29.718177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f37cb-496f-4052-bfc7-77a397735d78 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:29.718548 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f37cb-496f-4052-bfc7-77a397735d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:29.739757 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-b65f37cb-496f-4052-bfc7-77a397735d78 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:29.740968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b65f37cb-496f-4052-bfc7-77a397735d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:29.751068 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1059/2123] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:29.759065 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f37cb-496f-4052-bfc7-77a397735d78 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:29.760519 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b65f37cb-496f-4052-bfc7-77a397735d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:29.786347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6465ad8-f87b-4aec-a396-5b675a6692b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:29.787784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6465ad8-f87b-4aec-a396-5b675a6692b2 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:29.798512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1065/2124] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:03:29.799844 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34deb91f-4040-4292-87e3-75f72eba4567 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:29.800135 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34deb91f-4040-4292-87e3-75f72eba4567 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:29.800412 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34deb91f-4040-4292-87e3-75f72eba4567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:29.819983 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-34deb91f-4040-4292-87e3-75f72eba4567 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:29.821320 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-34deb91f-4040-4292-87e3-75f72eba4567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:29.828239 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f37cb-496f-4052-bfc7-77a397735d78 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:29.833783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1066/2125] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:29.835296 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34deb91f-4040-4292-87e3-75f72eba4567 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:29.835627 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d911a-7749-4c4c-bc77-c25f225005fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:29.836437 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d911a-7749-4c4c-bc77-c25f225005fd service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:29.836781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d911a-7749-4c4c-bc77-c25f225005fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:29.837257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d911a-7749-4c4c-bc77-c25f225005fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:29.845738 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34deb91f-4040-4292-87e3-75f72eba4567 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:29.848898 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d911a-7749-4c4c-bc77-c25f225005fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:29.850404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d911a-7749-4c4c-bc77-c25f225005fd service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:29.850662 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed4ea1-29db-4d13-929d-d9da431d3058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:29.851542 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed4ea1-29db-4d13-929d-d9da431d3058 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:29.852416 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed4ea1-29db-4d13-929d-d9da431d3058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:29.852815 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed4ea1-29db-4d13-929d-d9da431d3058 admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:29.853867 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed4ea1-29db-4d13-929d-d9da431d3058 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:03:29.854176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed4ea1-29db-4d13-929d-d9da431d3058 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:29.855849 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed4ea1-29db-4d13-929d-d9da431d3058 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:29.865489 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1060/2126] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:29.873243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1067/2127] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:03:29.877872 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d911a-7749-4c4c-bc77-c25f225005fd service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:29.888685 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d911a-7749-4c4c-bc77-c25f225005fd service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:29.895389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7204b0-2249-4b9c-abab-e0e24307485c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:29.896083 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7204b0-2249-4b9c-abab-e0e24307485c admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:29.896362 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7204b0-2249-4b9c-abab-e0e24307485c admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:29.898420 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7204b0-2249-4b9c-abab-e0e24307485c admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:29.899305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7204b0-2249-4b9c-abab-e0e24307485c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:29.901451 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7204b0-2249-4b9c-abab-e0e24307485c admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:29.931209 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1061/2128] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:29 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:29.935388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed4ea1-29db-4d13-929d-d9da431d3058 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:29.948461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed4ea1-29db-4d13-929d-d9da431d3058 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:30.009235 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349ab05-f4a5-4c14-aafa-e89d99578ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:30.009918 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349ab05-f4a5-4c14-aafa-e89d99578ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:30.010221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349ab05-f4a5-4c14-aafa-e89d99578ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:30.010500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349ab05-f4a5-4c14-aafa-e89d99578ba1 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:30.011191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349ab05-f4a5-4c14-aafa-e89d99578ba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:30.013119 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349ab05-f4a5-4c14-aafa-e89d99578ba1 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:30.037408 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1068/2129] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:29 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:30.042111 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7204b0-2249-4b9c-abab-e0e24307485c admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:30.053095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7204b0-2249-4b9c-abab-e0e24307485c admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:30.058763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf58a4-11a2-400e-9728-9e75d637e826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:30.059427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf58a4-11a2-400e-9728-9e75d637e826 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:30.059713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf58a4-11a2-400e-9728-9e75d637e826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:30.059992 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf58a4-11a2-400e-9728-9e75d637e826 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:30.060719 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf58a4-11a2-400e-9728-9e75d637e826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:30.062349 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf58a4-11a2-400e-9728-9e75d637e826 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:30.073196 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1062/2130] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:30.077346 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349ab05-f4a5-4c14-aafa-e89d99578ba1 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:30.090223 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349ab05-f4a5-4c14-aafa-e89d99578ba1 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:30.094099 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ec90b-6883-49f9-9953-aee62729db52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:30.094957 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ec90b-6883-49f9-9953-aee62729db52 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:30.095254 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ec90b-6883-49f9-9953-aee62729db52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:30.095526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ec90b-6883-49f9-9953-aee62729db52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:30.096258 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ec90b-6883-49f9-9953-aee62729db52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:30.099008 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ec90b-6883-49f9-9953-aee62729db52 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:30.114375 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1069/2131] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:30.116572 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf58a4-11a2-400e-9728-9e75d637e826 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:30.145747 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf58a4-11a2-400e-9728-9e75d637e826 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:30.156560 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13a5d3-bf4f-4c0c-a923-10e621745a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:30.157560 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13a5d3-bf4f-4c0c-a923-10e621745a62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:30.157846 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13a5d3-bf4f-4c0c-a923-10e621745a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:30.158312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13a5d3-bf4f-4c0c-a923-10e621745a62 admin admin] PATH_INFO: `/v3/projects/3327601a4d59466dbe9fb4ad689616f2/users/fb76fce14cf84b2bb4094fa2691777fe/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:30.183101 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ec90b-6883-49f9-9953-aee62729db52 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:30.184255 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13a5d3-bf4f-4c0c-a923-10e621745a62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3327601a4d59466dbe9fb4ad689616f2, user_id=fb76fce14cf84b2bb4094fa2691777fe, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:30.185226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-ee6ec90b-6883-49f9-9953-aee62729db52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:30.187119 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13a5d3-bf4f-4c0c-a923-10e621745a62 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:30.202058 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1063/2132] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:30 2022] PUT /identity/v3/projects/3327601a4d59466dbe9fb4ad689616f2/users/fb76fce14cf84b2bb4094fa2691777fe/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:30.210190 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ec90b-6883-49f9-9953-aee62729db52 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:30.216835 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e436b03-c54d-4f42-a9f0-72a75726c848 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:30.217150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e436b03-c54d-4f42-a9f0-72a75726c848 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:30.217424 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e436b03-c54d-4f42-a9f0-72a75726c848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:30.236046 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-6e436b03-c54d-4f42-a9f0-72a75726c848 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:30.237400 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-6e436b03-c54d-4f42-a9f0-72a75726c848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:30.279233 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cf73c-c5e9-4dc0-bbe0-d590526e8459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:30.280214 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cf73c-c5e9-4dc0-bbe0-d590526e8459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:30.280755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cf73c-c5e9-4dc0-bbe0-d590526e8459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:30.280755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cf73c-c5e9-4dc0-bbe0-d590526e8459 admin admin] PATH_INFO: `/v3/projects/97d2e3d2d959400b9b559eddff4eafc4` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:30.282122 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cf73c-c5e9-4dc0-bbe0-d590526e8459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97d2e3d2d959400b9b559eddff4eafc4)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:30.284158 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cf73c-c5e9-4dc0-bbe0-d590526e8459 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:30.306568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1064/2133] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:30.313607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e436b03-c54d-4f42-a9f0-72a75726c848 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:30.315416 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-6e436b03-c54d-4f42-a9f0-72a75726c848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:30.369527 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-071cf73c-c5e9-4dc0-bbe0-d590526e8459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97d2e3d2d959400b9b559eddff4eafc4', 'request_id': 'req-071cf73c-c5e9-4dc0-bbe0-d590526e8459'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:30.376135 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-071cf73c-c5e9-4dc0-bbe0-d590526e8459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97d2e3d2d959400b9b559eddff4eafc4', 'request_id': 'req-071cf73c-c5e9-4dc0-bbe0-d590526e8459'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:30.380504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e436b03-c54d-4f42-a9f0-72a75726c848 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:30.384381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-071cf73c-c5e9-4dc0-bbe0-d590526e8459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97d2e3d2d959400b9b559eddff4eafc4', 'request_id': 'req-071cf73c-c5e9-4dc0-bbe0-d590526e8459'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:30.399155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-071cf73c-c5e9-4dc0-bbe0-d590526e8459 admin admin] The token cache is being invalidate because project 97d2e3d2d959400b9b559eddff4eafc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:30.399697 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-071cf73c-c5e9-4dc0-bbe0-d590526e8459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:30.400374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-071cf73c-c5e9-4dc0-bbe0-d590526e8459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:30.402190 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1070/2134] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:30 2022] DELETE /identity/v3/projects/97d2e3d2d959400b9b559eddff4eafc4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:30.406718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cf73c-c5e9-4dc0-bbe0-d590526e8459 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:30.409961 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-071cf73c-c5e9-4dc0-bbe0-d590526e8459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:30.438597 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85db26-3445-436b-82a1-9bf4d200f0fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:30.439207 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85db26-3445-436b-82a1-9bf4d200f0fb service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:30.439470 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85db26-3445-436b-82a1-9bf4d200f0fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:30.439739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85db26-3445-436b-82a1-9bf4d200f0fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:30.441661 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-3e85db26-3445-436b-82a1-9bf4d200f0fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:30.481175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cf73c-c5e9-4dc0-bbe0-d590526e8459 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:30.485850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8218a-bbb2-447d-9774-4b979fbe9ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:30.486747 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8218a-bbb2-447d-9774-4b979fbe9ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:30.487032 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8218a-bbb2-447d-9774-4b979fbe9ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:30.487308 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8218a-bbb2-447d-9774-4b979fbe9ac6 admin admin] PATH_INFO: `/v3/users/4ea07b80d6d14b7498cfddb36487fdb1` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:30.488530 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8218a-bbb2-447d-9774-4b979fbe9ac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ea07b80d6d14b7498cfddb36487fdb1)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:30.490476 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8218a-bbb2-447d-9774-4b979fbe9ac6 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:30.504877 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85db26-3445-436b-82a1-9bf4d200f0fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:30.506360 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85db26-3445-436b-82a1-9bf4d200f0fb service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:30.516684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1065/2135] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:03:30.538345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-4bf8218a-bbb2-447d-9774-4b979fbe9ac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea07b80d6d14b7498cfddb36487fdb1'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:30.539223 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-4bf8218a-bbb2-447d-9774-4b979fbe9ac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea07b80d6d14b7498cfddb36487fdb1'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:30.551883 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-4bf8218a-bbb2-447d-9774-4b979fbe9ac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea07b80d6d14b7498cfddb36487fdb1'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:30.559893 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-4bf8218a-bbb2-447d-9774-4b979fbe9ac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea07b80d6d14b7498cfddb36487fdb1'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:30.566762 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-4bf8218a-bbb2-447d-9774-4b979fbe9ac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea07b80d6d14b7498cfddb36487fdb1'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:30.573569 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1071/2136] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:30 2022] DELETE /identity/v3/users/4ea07b80d6d14b7498cfddb36487fdb1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:30.866822 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85db26-3445-436b-82a1-9bf4d200f0fb service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:30.878522 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85db26-3445-436b-82a1-9bf4d200f0fb service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:30.943102 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51071cb7-f384-4e8e-ac9c-f7ef02000d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:30.943891 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51071cb7-f384-4e8e-ac9c-f7ef02000d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:30.944175 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51071cb7-f384-4e8e-ac9c-f7ef02000d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:30.944449 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51071cb7-f384-4e8e-ac9c-f7ef02000d10 admin admin] PATH_INFO: `/v3/projects/d09a6be94afb457286ec776cd7a50e35` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:30.945834 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51071cb7-f384-4e8e-ac9c-f7ef02000d10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09a6be94afb457286ec776cd7a50e35)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:30.947848 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51071cb7-f384-4e8e-ac9c-f7ef02000d10 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:30.999269 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-51071cb7-f384-4e8e-ac9c-f7ef02000d10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09a6be94afb457286ec776cd7a50e35', 'request_id': 'req-51071cb7-f384-4e8e-ac9c-f7ef02000d10'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:31.005536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-51071cb7-f384-4e8e-ac9c-f7ef02000d10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09a6be94afb457286ec776cd7a50e35', 'request_id': 'req-51071cb7-f384-4e8e-ac9c-f7ef02000d10'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:31.011955 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-51071cb7-f384-4e8e-ac9c-f7ef02000d10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09a6be94afb457286ec776cd7a50e35', 'request_id': 'req-51071cb7-f384-4e8e-ac9c-f7ef02000d10'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:31.038694 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-51071cb7-f384-4e8e-ac9c-f7ef02000d10 admin admin] The token cache is being invalidate because project d09a6be94afb457286ec776cd7a50e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:31.039017 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-51071cb7-f384-4e8e-ac9c-f7ef02000d10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:31.040218 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-51071cb7-f384-4e8e-ac9c-f7ef02000d10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:31.041987 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1066/2137] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:30 2022] DELETE /identity/v3/projects/d09a6be94afb457286ec776cd7a50e35 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:31.047969 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cdb0b-e37e-408b-96cf-77fae68fffa9 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:31.048310 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cdb0b-e37e-408b-96cf-77fae68fffa9 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:31.048595 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cdb0b-e37e-408b-96cf-77fae68fffa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:31.105768 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-db3cdb0b-e37e-408b-96cf-77fae68fffa9 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:31.107018 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-db3cdb0b-e37e-408b-96cf-77fae68fffa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:31.220910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1072/2138] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:31.222802 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bded9-8139-43ee-b4f7-4a77d60fd223 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:31.223269 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bded9-8139-43ee-b4f7-4a77d60fd223 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:31.223447 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bded9-8139-43ee-b4f7-4a77d60fd223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:31.249403 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-678bded9-8139-43ee-b4f7-4a77d60fd223 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:31.250732 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-678bded9-8139-43ee-b4f7-4a77d60fd223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:31.262590 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1067/2139] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:31.267317 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cdb0b-e37e-408b-96cf-77fae68fffa9 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:31.278161 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cdb0b-e37e-408b-96cf-77fae68fffa9 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:31.285196 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2df5c-254b-4eba-a9f0-5a004d8497a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:31.286118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2df5c-254b-4eba-a9f0-5a004d8497a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:31.286534 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2df5c-254b-4eba-a9f0-5a004d8497a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:31.286882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2df5c-254b-4eba-a9f0-5a004d8497a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:31.287695 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2df5c-254b-4eba-a9f0-5a004d8497a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:03:31.288071 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2df5c-254b-4eba-a9f0-5a004d8497a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:31.290724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2df5c-254b-4eba-a9f0-5a004d8497a6 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:31.308594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1073/2140] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:03:31.312989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bded9-8139-43ee-b4f7-4a77d60fd223 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:31.322831 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bded9-8139-43ee-b4f7-4a77d60fd223 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:31.327690 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beda14c-27df-4d1f-ba90-65b65ade02ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:31.328356 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beda14c-27df-4d1f-ba90-65b65ade02ff admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:31.328639 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beda14c-27df-4d1f-ba90-65b65ade02ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:31.328914 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beda14c-27df-4d1f-ba90-65b65ade02ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:31.329603 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beda14c-27df-4d1f-ba90-65b65ade02ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:31.331598 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beda14c-27df-4d1f-ba90-65b65ade02ff admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:31.365750 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1068/2141] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:31 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:31.366922 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2df5c-254b-4eba-a9f0-5a004d8497a6 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:31.378215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2df5c-254b-4eba-a9f0-5a004d8497a6 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:31.456844 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d1a52-dcc3-4875-ab9b-359d3696a46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:31.457538 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d1a52-dcc3-4875-ab9b-359d3696a46c admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:31.457817 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d1a52-dcc3-4875-ab9b-359d3696a46c admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:31.458140 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d1a52-dcc3-4875-ab9b-359d3696a46c admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:31.459201 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d1a52-dcc3-4875-ab9b-359d3696a46c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:31.461297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d1a52-dcc3-4875-ab9b-359d3696a46c admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:31.490793 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1074/2142] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:31 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:31.491844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beda14c-27df-4d1f-ba90-65b65ade02ff admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:31.508134 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beda14c-27df-4d1f-ba90-65b65ade02ff admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:31.516691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1751e8-3297-4808-a183-6f92560aaf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:31.517901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1751e8-3297-4808-a183-6f92560aaf10 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:31.518867 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1751e8-3297-4808-a183-6f92560aaf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:31.518867 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1751e8-3297-4808-a183-6f92560aaf10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:31.519540 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1751e8-3297-4808-a183-6f92560aaf10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:31.521533 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1751e8-3297-4808-a183-6f92560aaf10 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:31.544048 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1069/2143] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:03:31.547868 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d1a52-dcc3-4875-ab9b-359d3696a46c admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:31.559326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d1a52-dcc3-4875-ab9b-359d3696a46c admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:31.565319 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc45e2c-b5ac-4f46-9c2f-abc5dd5babf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:31.566247 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc45e2c-b5ac-4f46-9c2f-abc5dd5babf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:31.567207 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc45e2c-b5ac-4f46-9c2f-abc5dd5babf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:31.567631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc45e2c-b5ac-4f46-9c2f-abc5dd5babf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:31.568795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc45e2c-b5ac-4f46-9c2f-abc5dd5babf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:31.570642 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc45e2c-b5ac-4f46-9c2f-abc5dd5babf0 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:31.583438 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1075/2144] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:31.587193 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1751e8-3297-4808-a183-6f92560aaf10 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:31.598459 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1751e8-3297-4808-a183-6f92560aaf10 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:31.605523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74acced-61c3-4e16-89e5-9bae0d33e526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:31.606747 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74acced-61c3-4e16-89e5-9bae0d33e526 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:31.607098 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74acced-61c3-4e16-89e5-9bae0d33e526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:31.607441 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74acced-61c3-4e16-89e5-9bae0d33e526 admin admin] PATH_INFO: `/v3/projects/3497be685fda463ba3f715be538b5720/users/dc0267f0937c43939a9ee1034f79f5ce/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:31.638429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74acced-61c3-4e16-89e5-9bae0d33e526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3497be685fda463ba3f715be538b5720, user_id=dc0267f0937c43939a9ee1034f79f5ce, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:31.641603 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74acced-61c3-4e16-89e5-9bae0d33e526 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:31.661400 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1070/2145] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:31 2022] PUT /identity/v3/projects/3497be685fda463ba3f715be538b5720/users/dc0267f0937c43939a9ee1034f79f5ce/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:31.671984 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8b18e-c2a7-4b99-a8d0-d40d98003a2f None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:31.672270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8b18e-c2a7-4b99-a8d0-d40d98003a2f None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:31.672544 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8b18e-c2a7-4b99-a8d0-d40d98003a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:31.705866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-2dc8b18e-c2a7-4b99-a8d0-d40d98003a2f None None] MFA Rules not processed for user `dc0267f0937c43939a9ee1034f79f5ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:31.707632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-2dc8b18e-c2a7-4b99-a8d0-d40d98003a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:31.798555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1076/2146] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:31.802785 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74acced-61c3-4e16-89e5-9bae0d33e526 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:31.903311 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74acced-61c3-4e16-89e5-9bae0d33e526 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:31.908422 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53b29a-7c72-41e7-a150-c4e0a85cead6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:31.909106 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53b29a-7c72-41e7-a150-c4e0a85cead6 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:31.909384 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53b29a-7c72-41e7-a150-c4e0a85cead6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:31.910131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53b29a-7c72-41e7-a150-c4e0a85cead6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:31.911162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53b29a-7c72-41e7-a150-c4e0a85cead6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:31.913230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53b29a-7c72-41e7-a150-c4e0a85cead6 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:31.956632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1071/2147] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:31 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:31.957492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8b18e-c2a7-4b99-a8d0-d40d98003a2f None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:31.989064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8b18e-c2a7-4b99-a8d0-d40d98003a2f None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:32.129635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28ba3a-1b56-483d-8327-ca3f6fc67673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:32.130443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28ba3a-1b56-483d-8327-ca3f6fc67673 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:32.130875 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28ba3a-1b56-483d-8327-ca3f6fc67673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:32.131652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28ba3a-1b56-483d-8327-ca3f6fc67673 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:32.131846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28ba3a-1b56-483d-8327-ca3f6fc67673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:32.134421 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28ba3a-1b56-483d-8327-ca3f6fc67673 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:32.160368 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1077/2148] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:31 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:32.172280 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53b29a-7c72-41e7-a150-c4e0a85cead6 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:32.176574 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53b29a-7c72-41e7-a150-c4e0a85cead6 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:32.182261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfef41c-9c76-4d5d-9b52-010385e9ab7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:32.183029 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfef41c-9c76-4d5d-9b52-010385e9ab7b admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:32.183309 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfef41c-9c76-4d5d-9b52-010385e9ab7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:32.183590 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfef41c-9c76-4d5d-9b52-010385e9ab7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:32.184324 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfef41c-9c76-4d5d-9b52-010385e9ab7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:32.186125 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfef41c-9c76-4d5d-9b52-010385e9ab7b admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:32.201293 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28ba3a-1b56-483d-8327-ca3f6fc67673 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:32.202951 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1072/2149] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:32.212982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28ba3a-1b56-483d-8327-ca3f6fc67673 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:32.220612 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb9922-ea3d-4b8a-b358-62f561b1f0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:32.222224 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb9922-ea3d-4b8a-b358-62f561b1f0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:32.222985 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb9922-ea3d-4b8a-b358-62f561b1f0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:32.223102 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb9922-ea3d-4b8a-b358-62f561b1f0f0 admin admin] PATH_INFO: `/v3/projects/cbdb4d3825284f5ab7dc352ad942b3f3/users/ce63d80e586f40479b0be4d442b5e359/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:32.244519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb9922-ea3d-4b8a-b358-62f561b1f0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbdb4d3825284f5ab7dc352ad942b3f3, user_id=ce63d80e586f40479b0be4d442b5e359, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:32.247346 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb9922-ea3d-4b8a-b358-62f561b1f0f0 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:32.273453 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1078/2150] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:32 2022] PUT /identity/v3/projects/cbdb4d3825284f5ab7dc352ad942b3f3/users/ce63d80e586f40479b0be4d442b5e359/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:32.275488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfef41c-9c76-4d5d-9b52-010385e9ab7b admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:32.292316 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfef41c-9c76-4d5d-9b52-010385e9ab7b admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:32.415355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d9fe2-9eca-41ab-a4cd-5680fd1ab456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:32.416012 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d9fe2-9eca-41ab-a4cd-5680fd1ab456 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:32.416389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d9fe2-9eca-41ab-a4cd-5680fd1ab456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:32.416851 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d9fe2-9eca-41ab-a4cd-5680fd1ab456 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:32.417302 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d9fe2-9eca-41ab-a4cd-5680fd1ab456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:32.419145 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d9fe2-9eca-41ab-a4cd-5680fd1ab456 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:32.439147 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1073/2151] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:32.443271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb9922-ea3d-4b8a-b358-62f561b1f0f0 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:32.458833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb9922-ea3d-4b8a-b358-62f561b1f0f0 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:32.474436 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6decf4c-20de-4c67-829c-40845a7d2adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:32.475465 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6decf4c-20de-4c67-829c-40845a7d2adb admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:32.475824 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6decf4c-20de-4c67-829c-40845a7d2adb admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:32.476206 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6decf4c-20de-4c67-829c-40845a7d2adb admin admin] PATH_INFO: `/v3/projects/cbdb4d3825284f5ab7dc352ad942b3f3/users/ce63d80e586f40479b0be4d442b5e359/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:32.491855 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6decf4c-20de-4c67-829c-40845a7d2adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbdb4d3825284f5ab7dc352ad942b3f3, user_id=ce63d80e586f40479b0be4d442b5e359, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:32.496500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6decf4c-20de-4c67-829c-40845a7d2adb admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:32.510179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1079/2152] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:32 2022] PUT /identity/v3/projects/cbdb4d3825284f5ab7dc352ad942b3f3/users/ce63d80e586f40479b0be4d442b5e359/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:32.519915 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c46301-9b9b-4d62-897d-733afb320439 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:32.520202 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c46301-9b9b-4d62-897d-733afb320439 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:32.520859 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c46301-9b9b-4d62-897d-733afb320439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:32.557205 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-a4c46301-9b9b-4d62-897d-733afb320439 None None] MFA Rules not processed for user `ce63d80e586f40479b0be4d442b5e359`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:32.558510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a4c46301-9b9b-4d62-897d-733afb320439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:32.645597 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1074/2153] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:32.657757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6decf4c-20de-4c67-829c-40845a7d2adb admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:32.659765 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f6decf4c-20de-4c67-829c-40845a7d2adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:32.746789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6decf4c-20de-4c67-829c-40845a7d2adb admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:32.750382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5b1b0-b75e-477c-80c9-075bf2c536b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:32.751035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5b1b0-b75e-477c-80c9-075bf2c536b6 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:32.751320 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5b1b0-b75e-477c-80c9-075bf2c536b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:32.751602 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5b1b0-b75e-477c-80c9-075bf2c536b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:32.761511 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5b1b0-b75e-477c-80c9-075bf2c536b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:32.762987 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5b1b0-b75e-477c-80c9-075bf2c536b6 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:32.772542 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1080/2154] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:33.186032 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c46301-9b9b-4d62-897d-733afb320439 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:33.266272 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c46301-9b9b-4d62-897d-733afb320439 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:33.272983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c7a6d-7da3-4737-be96-21ff697cf443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:33.274920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c7a6d-7da3-4737-be96-21ff697cf443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:33.275452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c7a6d-7da3-4737-be96-21ff697cf443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:33.275799 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c7a6d-7da3-4737-be96-21ff697cf443 admin admin] PATH_INFO: `/v3/users/dc0267f0937c43939a9ee1034f79f5ce` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:33.277591 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c7a6d-7da3-4737-be96-21ff697cf443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc0267f0937c43939a9ee1034f79f5ce)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:33.279671 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c7a6d-7da3-4737-be96-21ff697cf443 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:33.365104 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e91c7a6d-7da3-4737-be96-21ff697cf443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc0267f0937c43939a9ee1034f79f5ce'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:33.375653 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e91c7a6d-7da3-4737-be96-21ff697cf443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc0267f0937c43939a9ee1034f79f5ce'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:33.392045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e91c7a6d-7da3-4737-be96-21ff697cf443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc0267f0937c43939a9ee1034f79f5ce'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:33.393007 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e91c7a6d-7da3-4737-be96-21ff697cf443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc0267f0937c43939a9ee1034f79f5ce'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:33.393869 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e91c7a6d-7da3-4737-be96-21ff697cf443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc0267f0937c43939a9ee1034f79f5ce'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:33.422180 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1075/2155] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:33 2022] DELETE /identity/v3/users/dc0267f0937c43939a9ee1034f79f5ce => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:33.423375 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01966f-c00d-40a8-b361-8477e90c7bfe None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:33.423677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01966f-c00d-40a8-b361-8477e90c7bfe None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:33.423999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01966f-c00d-40a8-b361-8477e90c7bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:33.457806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-ec01966f-c00d-40a8-b361-8477e90c7bfe None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:33.459003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-ec01966f-c00d-40a8-b361-8477e90c7bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:33.556385 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1081/2156] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:33.566305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c7a6d-7da3-4737-be96-21ff697cf443 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:33.567773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-e91c7a6d-7da3-4737-be96-21ff697cf443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:33.705531 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c7a6d-7da3-4737-be96-21ff697cf443 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:33.709380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b34992-cb57-4270-a6c6-70bce6c866b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:33.710039 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b34992-cb57-4270-a6c6-70bce6c866b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:33.710355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b34992-cb57-4270-a6c6-70bce6c866b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:33.711872 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b34992-cb57-4270-a6c6-70bce6c866b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:33.723523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b34992-cb57-4270-a6c6-70bce6c866b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:33.724987 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b34992-cb57-4270-a6c6-70bce6c866b6 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:33.759090 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1076/2157] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:34.173001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01966f-c00d-40a8-b361-8477e90c7bfe None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:34.175043 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-ec01966f-c00d-40a8-b361-8477e90c7bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:34.202898 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01966f-c00d-40a8-b361-8477e90c7bfe None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:34.208015 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18181d2d-c59e-40d1-a588-50f0fa391c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:34.208957 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18181d2d-c59e-40d1-a588-50f0fa391c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:34.208957 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18181d2d-c59e-40d1-a588-50f0fa391c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:34.209236 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18181d2d-c59e-40d1-a588-50f0fa391c3a admin admin] PATH_INFO: `/v3/projects/3497be685fda463ba3f715be538b5720` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:34.210782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18181d2d-c59e-40d1-a588-50f0fa391c3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3497be685fda463ba3f715be538b5720)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:34.213805 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18181d2d-c59e-40d1-a588-50f0fa391c3a admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:34.272590 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-18181d2d-c59e-40d1-a588-50f0fa391c3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3497be685fda463ba3f715be538b5720', 'request_id': 'req-18181d2d-c59e-40d1-a588-50f0fa391c3a'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:34.283165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-18181d2d-c59e-40d1-a588-50f0fa391c3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3497be685fda463ba3f715be538b5720', 'request_id': 'req-18181d2d-c59e-40d1-a588-50f0fa391c3a'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:34.291568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-18181d2d-c59e-40d1-a588-50f0fa391c3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3497be685fda463ba3f715be538b5720', 'request_id': 'req-18181d2d-c59e-40d1-a588-50f0fa391c3a'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:34.309827 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-18181d2d-c59e-40d1-a588-50f0fa391c3a admin admin] The token cache is being invalidate because project 3497be685fda463ba3f715be538b5720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:34.310508 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-18181d2d-c59e-40d1-a588-50f0fa391c3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:34.311461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-18181d2d-c59e-40d1-a588-50f0fa391c3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:34.317074 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1082/2158] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:34 2022] DELETE /identity/v3/projects/3497be685fda463ba3f715be538b5720 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:34.317944 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b34992-cb57-4270-a6c6-70bce6c866b6 service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:34.328658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b34992-cb57-4270-a6c6-70bce6c866b6 service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:34.402826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e4537-8718-4a0f-998b-63c230dea1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:34.403979 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e4537-8718-4a0f-998b-63c230dea1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:34.404406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e4537-8718-4a0f-998b-63c230dea1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:34.405416 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e4537-8718-4a0f-998b-63c230dea1e6 admin admin] PATH_INFO: `/v3/users/ce63d80e586f40479b0be4d442b5e359` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:34.407064 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e4537-8718-4a0f-998b-63c230dea1e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce63d80e586f40479b0be4d442b5e359)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:34.409370 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e4537-8718-4a0f-998b-63c230dea1e6 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:34.474352 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9a9e4537-8718-4a0f-998b-63c230dea1e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce63d80e586f40479b0be4d442b5e359'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:34.488483 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9a9e4537-8718-4a0f-998b-63c230dea1e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce63d80e586f40479b0be4d442b5e359'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:34.505311 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9a9e4537-8718-4a0f-998b-63c230dea1e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce63d80e586f40479b0be4d442b5e359'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:34.506053 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9a9e4537-8718-4a0f-998b-63c230dea1e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce63d80e586f40479b0be4d442b5e359'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:34.506778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9a9e4537-8718-4a0f-998b-63c230dea1e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce63d80e586f40479b0be4d442b5e359'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:34.528312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1077/2159] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:34 2022] DELETE /identity/v3/users/ce63d80e586f40479b0be4d442b5e359 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:35.030152 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18181d2d-c59e-40d1-a588-50f0fa391c3a admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:35.032389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-18181d2d-c59e-40d1-a588-50f0fa391c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:35.054662 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18181d2d-c59e-40d1-a588-50f0fa391c3a admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:35.144137 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70239a88-d9c6-4527-9e43-61af12325279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:35.145013 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70239a88-d9c6-4527-9e43-61af12325279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:35.145312 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70239a88-d9c6-4527-9e43-61af12325279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:35.145584 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70239a88-d9c6-4527-9e43-61af12325279 admin admin] PATH_INFO: `/v3/projects/cbdb4d3825284f5ab7dc352ad942b3f3` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:35.146871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70239a88-d9c6-4527-9e43-61af12325279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbdb4d3825284f5ab7dc352ad942b3f3)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:35.150434 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70239a88-d9c6-4527-9e43-61af12325279 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:35.200205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-70239a88-d9c6-4527-9e43-61af12325279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbdb4d3825284f5ab7dc352ad942b3f3', 'request_id': 'req-70239a88-d9c6-4527-9e43-61af12325279'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:35.206302 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-70239a88-d9c6-4527-9e43-61af12325279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbdb4d3825284f5ab7dc352ad942b3f3', 'request_id': 'req-70239a88-d9c6-4527-9e43-61af12325279'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:35.215888 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-70239a88-d9c6-4527-9e43-61af12325279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbdb4d3825284f5ab7dc352ad942b3f3', 'request_id': 'req-70239a88-d9c6-4527-9e43-61af12325279'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:35.235080 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-70239a88-d9c6-4527-9e43-61af12325279 admin admin] The token cache is being invalidate because project cbdb4d3825284f5ab7dc352ad942b3f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:35.236680 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-70239a88-d9c6-4527-9e43-61af12325279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:35.237484 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-70239a88-d9c6-4527-9e43-61af12325279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:35.246342 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1083/2160] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:35 2022] DELETE /identity/v3/projects/cbdb4d3825284f5ab7dc352ad942b3f3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:35.247136 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0abea6-e5bd-401b-b9ae-192330347fcf None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:35.247423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0abea6-e5bd-401b-b9ae-192330347fcf None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:35.247736 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0abea6-e5bd-401b-b9ae-192330347fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:35.271065 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-bb0abea6-e5bd-401b-b9ae-192330347fcf None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:35.272289 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-bb0abea6-e5bd-401b-b9ae-192330347fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:35.366869 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1078/2161] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:35.380676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc71f2-eecb-4cce-8b11-ab7be2d5ac1a None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:35.380984 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc71f2-eecb-4cce-8b11-ab7be2d5ac1a None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:35.381250 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc71f2-eecb-4cce-8b11-ab7be2d5ac1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:35.408743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-72cc71f2-eecb-4cce-8b11-ab7be2d5ac1a None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:35.410722 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-72cc71f2-eecb-4cce-8b11-ab7be2d5ac1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:35.419514 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1084/2162] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:35.424737 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0abea6-e5bd-401b-b9ae-192330347fcf None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:35.443603 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0abea6-e5bd-401b-b9ae-192330347fcf None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:35.450600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da999a0d-c98a-4a15-a3ea-35979b7827a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:35.451542 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da999a0d-c98a-4a15-a3ea-35979b7827a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:35.451974 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da999a0d-c98a-4a15-a3ea-35979b7827a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:35.452415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da999a0d-c98a-4a15-a3ea-35979b7827a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:35.453467 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da999a0d-c98a-4a15-a3ea-35979b7827a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:03:35.453947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da999a0d-c98a-4a15-a3ea-35979b7827a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:35.455815 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da999a0d-c98a-4a15-a3ea-35979b7827a4 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:35.475964 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1079/2163] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:03:35.478078 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc71f2-eecb-4cce-8b11-ab7be2d5ac1a None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:35.488393 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc71f2-eecb-4cce-8b11-ab7be2d5ac1a None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:35.495137 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76838b-7f17-483b-879c-e7d22f54387c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:35.496078 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76838b-7f17-483b-879c-e7d22f54387c admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:35.496528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76838b-7f17-483b-879c-e7d22f54387c admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:35.496955 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76838b-7f17-483b-879c-e7d22f54387c admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:35.497817 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76838b-7f17-483b-879c-e7d22f54387c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:35.500234 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76838b-7f17-483b-879c-e7d22f54387c admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:35.546133 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1085/2164] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:35 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:35.548380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da999a0d-c98a-4a15-a3ea-35979b7827a4 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:35.562621 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da999a0d-c98a-4a15-a3ea-35979b7827a4 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:35.580698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a3b33-c3fb-4086-a802-0741a4e5260e None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:35.580929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a3b33-c3fb-4086-a802-0741a4e5260e None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:35.581216 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a3b33-c3fb-4086-a802-0741a4e5260e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:35.610521 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-596a3b33-c3fb-4086-a802-0741a4e5260e None None] MFA Rules not processed for user `fb76fce14cf84b2bb4094fa2691777fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:35.611902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-596a3b33-c3fb-4086-a802-0741a4e5260e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:35.637269 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0b6ce-52e3-42d5-9070-aa40b8153895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:35.638039 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0b6ce-52e3-42d5-9070-aa40b8153895 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:35.638419 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0b6ce-52e3-42d5-9070-aa40b8153895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:35.638763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0b6ce-52e3-42d5-9070-aa40b8153895 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:35.639581 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0b6ce-52e3-42d5-9070-aa40b8153895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:35.641580 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0b6ce-52e3-42d5-9070-aa40b8153895 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:35.671589 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1080/2165] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:35 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:35.672836 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0b6ce-52e3-42d5-9070-aa40b8153895 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:35.684227 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0b6ce-52e3-42d5-9070-aa40b8153895 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:35.690660 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1f336-ba9c-4286-a3cd-e9e2e4e4f4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:35.691915 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1f336-ba9c-4286-a3cd-e9e2e4e4f4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:35.692397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1f336-ba9c-4286-a3cd-e9e2e4e4f4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:35.692742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1f336-ba9c-4286-a3cd-e9e2e4e4f4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:35.694017 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1f336-ba9c-4286-a3cd-e9e2e4e4f4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:35.702916 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1f336-ba9c-4286-a3cd-e9e2e4e4f4d3 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:35.703868 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1086/2166] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:35.711903 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1081/2167] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:35.712844 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a3b33-c3fb-4086-a802-0741a4e5260e None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:35.713404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1f336-ba9c-4286-a3cd-e9e2e4e4f4d3 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:35.715054 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-596a3b33-c3fb-4086-a802-0741a4e5260e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:35.725226 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1f336-ba9c-4286-a3cd-e9e2e4e4f4d3 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:35.734931 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66c24f-8570-4932-802b-21d0dde65c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:35.735620 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66c24f-8570-4932-802b-21d0dde65c14 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:35.735901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66c24f-8570-4932-802b-21d0dde65c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:35.736175 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66c24f-8570-4932-802b-21d0dde65c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:35.736913 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66c24f-8570-4932-802b-21d0dde65c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:35.738579 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66c24f-8570-4932-802b-21d0dde65c14 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:35.755025 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1082/2168] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:35.761967 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66c24f-8570-4932-802b-21d0dde65c14 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:35.785772 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66c24f-8570-4932-802b-21d0dde65c14 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:35.807880 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa27a53-8bf8-426e-bebe-d999d58c95db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:35.809085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa27a53-8bf8-426e-bebe-d999d58c95db admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:35.809440 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa27a53-8bf8-426e-bebe-d999d58c95db admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:35.809787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa27a53-8bf8-426e-bebe-d999d58c95db admin admin] PATH_INFO: `/v3/projects/99a2df78f43c4dd4a9df29a301180ef8/users/cc963bc87b34479a8bd76f3e6a9ba208/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:35.855009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a3b33-c3fb-4086-a802-0741a4e5260e None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:35.861469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104ecce-cc23-4d08-aa36-918558d5bb47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:35.862134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104ecce-cc23-4d08-aa36-918558d5bb47 service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:35.862468 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104ecce-cc23-4d08-aa36-918558d5bb47 service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:35.862743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104ecce-cc23-4d08-aa36-918558d5bb47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:35.863389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa27a53-8bf8-426e-bebe-d999d58c95db admin admin] RBAC: Authorizing `identity:create_grant(project_id=99a2df78f43c4dd4a9df29a301180ef8, user_id=cc963bc87b34479a8bd76f3e6a9ba208, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:35.874239 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa27a53-8bf8-426e-bebe-d999d58c95db admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:35.875408 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104ecce-cc23-4d08-aa36-918558d5bb47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:35.880181 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104ecce-cc23-4d08-aa36-918558d5bb47 service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:35.891108 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1083/2169] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:35 2022] PUT /identity/v3/projects/99a2df78f43c4dd4a9df29a301180ef8/users/cc963bc87b34479a8bd76f3e6a9ba208/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:35.904364 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c880047-4f30-4b9e-8d6c-074623b93012 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:35.904834 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c880047-4f30-4b9e-8d6c-074623b93012 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:35.905108 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c880047-4f30-4b9e-8d6c-074623b93012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:35.906979 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1087/2170] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:03:35.951272 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-5c880047-4f30-4b9e-8d6c-074623b93012 None None] MFA Rules not processed for user `cc963bc87b34479a8bd76f3e6a9ba208`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:35.952843 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-5c880047-4f30-4b9e-8d6c-074623b93012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:36.063982 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1084/2171] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:36.070411 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104ecce-cc23-4d08-aa36-918558d5bb47 service nova] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:36.083969 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104ecce-cc23-4d08-aa36-918558d5bb47 service nova] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:36.170641 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b7c62-f752-4977-b2f4-bd4e15ecf5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:36.171475 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b7c62-f752-4977-b2f4-bd4e15ecf5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:36.171768 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b7c62-f752-4977-b2f4-bd4e15ecf5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:36.172335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b7c62-f752-4977-b2f4-bd4e15ecf5d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:36.173214 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b7c62-f752-4977-b2f4-bd4e15ecf5d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:36.175358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b7c62-f752-4977-b2f4-bd4e15ecf5d5 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:36.216383 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c880047-4f30-4b9e-8d6c-074623b93012 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:36.216606 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1088/2172] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:36 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:36.233506 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c880047-4f30-4b9e-8d6c-074623b93012 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:36.364898 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca2739-6085-442b-bd43-4abb8804d871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:36.366356 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca2739-6085-442b-bd43-4abb8804d871 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:36.366954 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca2739-6085-442b-bd43-4abb8804d871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:36.369364 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca2739-6085-442b-bd43-4abb8804d871 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:36.370348 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca2739-6085-442b-bd43-4abb8804d871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:36.375987 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca2739-6085-442b-bd43-4abb8804d871 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:36.412935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1085/2173] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:36 2022] POST /identity/v3/users => generated 299 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:36.417894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b7c62-f752-4977-b2f4-bd4e15ecf5d5 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:36.429076 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b7c62-f752-4977-b2f4-bd4e15ecf5d5 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:36.447608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1cfa1-7ec3-4142-8348-08e8b8bce6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:36.448317 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1cfa1-7ec3-4142-8348-08e8b8bce6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:36.448601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1cfa1-7ec3-4142-8348-08e8b8bce6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:36.448879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1cfa1-7ec3-4142-8348-08e8b8bce6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:36.449637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1cfa1-7ec3-4142-8348-08e8b8bce6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:36.455727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1cfa1-7ec3-4142-8348-08e8b8bce6b5 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:36.475689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1089/2174] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:36.480418 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca2739-6085-442b-bd43-4abb8804d871 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:36.494954 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca2739-6085-442b-bd43-4abb8804d871 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:36.501496 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3d916-6ca2-4454-a36a-9fb34ef48537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:36.503074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3d916-6ca2-4454-a36a-9fb34ef48537 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:36.503367 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3d916-6ca2-4454-a36a-9fb34ef48537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:36.503646 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3d916-6ca2-4454-a36a-9fb34ef48537 admin admin] PATH_INFO: `/v3/projects/e68feaf42f9a49c2bb86369fbca44217/users/895ba26f628846979b51ec5157adc3bf/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:36.527522 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3d916-6ca2-4454-a36a-9fb34ef48537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68feaf42f9a49c2bb86369fbca44217, user_id=895ba26f628846979b51ec5157adc3bf, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:36.530322 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3d916-6ca2-4454-a36a-9fb34ef48537 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:36.554239 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1086/2175] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:36 2022] PUT /identity/v3/projects/e68feaf42f9a49c2bb86369fbca44217/users/895ba26f628846979b51ec5157adc3bf/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:36.556966 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1cfa1-7ec3-4142-8348-08e8b8bce6b5 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:36.566971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1cfa1-7ec3-4142-8348-08e8b8bce6b5 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:36.639480 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11871798-d183-424b-b084-6d337977a638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:36.640403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11871798-d183-424b-b084-6d337977a638 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:36.640610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11871798-d183-424b-b084-6d337977a638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:36.640902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11871798-d183-424b-b084-6d337977a638 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:36.641900 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11871798-d183-424b-b084-6d337977a638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:36.643605 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11871798-d183-424b-b084-6d337977a638 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:36.655699 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1090/2176] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:36.660265 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3d916-6ca2-4454-a36a-9fb34ef48537 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:36.676933 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3d916-6ca2-4454-a36a-9fb34ef48537 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:36.684076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bab457-7b87-48a3-9694-eb38aaaf7b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:36.685557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bab457-7b87-48a3-9694-eb38aaaf7b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:36.685828 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bab457-7b87-48a3-9694-eb38aaaf7b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:36.686340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bab457-7b87-48a3-9694-eb38aaaf7b26 admin admin] PATH_INFO: `/v3/projects/e68feaf42f9a49c2bb86369fbca44217/users/895ba26f628846979b51ec5157adc3bf/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:36.688506 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bab457-7b87-48a3-9694-eb38aaaf7b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68feaf42f9a49c2bb86369fbca44217, user_id=895ba26f628846979b51ec5157adc3bf, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:36.692217 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bab457-7b87-48a3-9694-eb38aaaf7b26 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:36.708722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1087/2177] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:36 2022] PUT /identity/v3/projects/e68feaf42f9a49c2bb86369fbca44217/users/895ba26f628846979b51ec5157adc3bf/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:36.721127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297da5f-15cc-4923-b63c-a16bae239ae1 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:36.721525 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297da5f-15cc-4923-b63c-a16bae239ae1 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:36.721810 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297da5f-15cc-4923-b63c-a16bae239ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:36.751239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-0297da5f-15cc-4923-b63c-a16bae239ae1 None None] MFA Rules not processed for user `895ba26f628846979b51ec5157adc3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:36.752457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-0297da5f-15cc-4923-b63c-a16bae239ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:36.855818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1091/2178] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:36.871390 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bab457-7b87-48a3-9694-eb38aaaf7b26 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:36.874914 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a4bab457-7b87-48a3-9694-eb38aaaf7b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:36.958857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bab457-7b87-48a3-9694-eb38aaaf7b26 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:36.963640 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2b25b-1fc0-4702-8695-e8491df79497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:36.964304 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2b25b-1fc0-4702-8695-e8491df79497 service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:36.964587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2b25b-1fc0-4702-8695-e8491df79497 service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:36.964861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2b25b-1fc0-4702-8695-e8491df79497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:37.034810 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2b25b-1fc0-4702-8695-e8491df79497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:37.036525 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2b25b-1fc0-4702-8695-e8491df79497 service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:37.054219 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1088/2179] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:37.717018 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297da5f-15cc-4923-b63c-a16bae239ae1 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:37.718877 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-0297da5f-15cc-4923-b63c-a16bae239ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:37.803482 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1be41-ecc6-4e46-bd1c-90e5bffd3863 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:37.804425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1be41-ecc6-4e46-bd1c-90e5bffd3863 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:37.804708 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1be41-ecc6-4e46-bd1c-90e5bffd3863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:37.831176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-91a1be41-ecc6-4e46-bd1c-90e5bffd3863 None None] MFA Rules not processed for user `fb76fce14cf84b2bb4094fa2691777fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:37.832902 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-91a1be41-ecc6-4e46-bd1c-90e5bffd3863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:37.906086 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297da5f-15cc-4923-b63c-a16bae239ae1 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:37.913511 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316dbc9-3cc5-4f7f-adf5-8f34cfeb3f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:37.914813 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316dbc9-3cc5-4f7f-adf5-8f34cfeb3f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:37.915274 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316dbc9-3cc5-4f7f-adf5-8f34cfeb3f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:37.915697 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316dbc9-3cc5-4f7f-adf5-8f34cfeb3f6d admin admin] PATH_INFO: `/v3/users/af68eaf58603445799ade165dd782c3f` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:37.917547 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316dbc9-3cc5-4f7f-adf5-8f34cfeb3f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=af68eaf58603445799ade165dd782c3f)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:37.920930 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316dbc9-3cc5-4f7f-adf5-8f34cfeb3f6d admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:37.964459 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1089/2180] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:38.037859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a316dbc9-3cc5-4f7f-adf5-8f34cfeb3f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af68eaf58603445799ade165dd782c3f'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:38.039700 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a316dbc9-3cc5-4f7f-adf5-8f34cfeb3f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af68eaf58603445799ade165dd782c3f'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:38.062953 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a316dbc9-3cc5-4f7f-adf5-8f34cfeb3f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af68eaf58603445799ade165dd782c3f'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:38.073298 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a316dbc9-3cc5-4f7f-adf5-8f34cfeb3f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af68eaf58603445799ade165dd782c3f'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:38.093664 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a316dbc9-3cc5-4f7f-adf5-8f34cfeb3f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af68eaf58603445799ade165dd782c3f'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:38.112696 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1092/2181] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:37 2022] DELETE /identity/v3/users/af68eaf58603445799ade165dd782c3f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:38.114559 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447909e-6b0d-41f1-832b-c50e5446d935 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:38.115108 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447909e-6b0d-41f1-832b-c50e5446d935 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:38.115540 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447909e-6b0d-41f1-832b-c50e5446d935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:38.159952 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-d447909e-6b0d-41f1-832b-c50e5446d935 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:38.163679 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-d447909e-6b0d-41f1-832b-c50e5446d935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:38.262229 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1090/2182] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:38.272990 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316dbc9-3cc5-4f7f-adf5-8f34cfeb3f6d admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:38.275008 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-a316dbc9-3cc5-4f7f-adf5-8f34cfeb3f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:38.381544 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316dbc9-3cc5-4f7f-adf5-8f34cfeb3f6d admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:38.394647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247ece1-1aba-44b7-a5a8-a64537694a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:38.395612 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247ece1-1aba-44b7-a5a8-a64537694a05 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:38.395894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247ece1-1aba-44b7-a5a8-a64537694a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:38.396175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247ece1-1aba-44b7-a5a8-a64537694a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:38.415142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247ece1-1aba-44b7-a5a8-a64537694a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:38.418547 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247ece1-1aba-44b7-a5a8-a64537694a05 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:38.443190 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1093/2183] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:39.156251 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447909e-6b0d-41f1-832b-c50e5446d935 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:39.159202 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-d447909e-6b0d-41f1-832b-c50e5446d935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:39.203195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447909e-6b0d-41f1-832b-c50e5446d935 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:39.217710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf628a8b-22e0-42b5-9b62-22f13486a017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:39.219198 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf628a8b-22e0-42b5-9b62-22f13486a017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:39.220306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf628a8b-22e0-42b5-9b62-22f13486a017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:39.221283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf628a8b-22e0-42b5-9b62-22f13486a017 admin admin] PATH_INFO: `/v3/projects/ee56f2fd63494a71aedfda53dc9ddf33` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:39.222755 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf628a8b-22e0-42b5-9b62-22f13486a017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee56f2fd63494a71aedfda53dc9ddf33)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:39.225231 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf628a8b-22e0-42b5-9b62-22f13486a017 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:39.339759 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-cf628a8b-22e0-42b5-9b62-22f13486a017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee56f2fd63494a71aedfda53dc9ddf33', 'request_id': 'req-cf628a8b-22e0-42b5-9b62-22f13486a017'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:39.362330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-cf628a8b-22e0-42b5-9b62-22f13486a017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee56f2fd63494a71aedfda53dc9ddf33', 'request_id': 'req-cf628a8b-22e0-42b5-9b62-22f13486a017'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:39.371659 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-cf628a8b-22e0-42b5-9b62-22f13486a017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee56f2fd63494a71aedfda53dc9ddf33', 'request_id': 'req-cf628a8b-22e0-42b5-9b62-22f13486a017'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:39.400900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-cf628a8b-22e0-42b5-9b62-22f13486a017 admin admin] The token cache is being invalidate because project ee56f2fd63494a71aedfda53dc9ddf33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:39.401411 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-cf628a8b-22e0-42b5-9b62-22f13486a017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:39.402285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-cf628a8b-22e0-42b5-9b62-22f13486a017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:39.404781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1091/2184] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:39 2022] DELETE /identity/v3/projects/ee56f2fd63494a71aedfda53dc9ddf33 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:39.409429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247ece1-1aba-44b7-a5a8-a64537694a05 service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:39.438550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247ece1-1aba-44b7-a5a8-a64537694a05 service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:39.555932 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3555a-fa5b-4993-a2d3-164dd4d66097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:39.557491 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3555a-fa5b-4993-a2d3-164dd4d66097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:39.557977 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3555a-fa5b-4993-a2d3-164dd4d66097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:39.558476 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3555a-fa5b-4993-a2d3-164dd4d66097 admin admin] PATH_INFO: `/v3/users/b41d72ba19ab458b805a4faba0576711` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:39.560176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3555a-fa5b-4993-a2d3-164dd4d66097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b41d72ba19ab458b805a4faba0576711)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:39.562601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3555a-fa5b-4993-a2d3-164dd4d66097 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:39.670873 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-23e3555a-fa5b-4993-a2d3-164dd4d66097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b41d72ba19ab458b805a4faba0576711'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:39.675050 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-23e3555a-fa5b-4993-a2d3-164dd4d66097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b41d72ba19ab458b805a4faba0576711'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:39.705392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-23e3555a-fa5b-4993-a2d3-164dd4d66097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b41d72ba19ab458b805a4faba0576711'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:39.742864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-23e3555a-fa5b-4993-a2d3-164dd4d66097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b41d72ba19ab458b805a4faba0576711'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:39.763063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-23e3555a-fa5b-4993-a2d3-164dd4d66097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b41d72ba19ab458b805a4faba0576711'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:39.782032 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1094/2185] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:39 2022] DELETE /identity/v3/users/b41d72ba19ab458b805a4faba0576711 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:40.280717 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf628a8b-22e0-42b5-9b62-22f13486a017 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:40.282250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-cf628a8b-22e0-42b5-9b62-22f13486a017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:40.295225 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf628a8b-22e0-42b5-9b62-22f13486a017 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:40.358453 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788db06-1c1e-4a62-bacb-c9c94dd18e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:40.359674 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788db06-1c1e-4a62-bacb-c9c94dd18e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:40.360217 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788db06-1c1e-4a62-bacb-c9c94dd18e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:40.360678 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788db06-1c1e-4a62-bacb-c9c94dd18e2b admin admin] PATH_INFO: `/v3/projects/956a9a8e2de84eb78e309d2e1fb5b5c5` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:40.362234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788db06-1c1e-4a62-bacb-c9c94dd18e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=956a9a8e2de84eb78e309d2e1fb5b5c5)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:40.364203 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788db06-1c1e-4a62-bacb-c9c94dd18e2b admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:40.419540 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-c788db06-1c1e-4a62-bacb-c9c94dd18e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '956a9a8e2de84eb78e309d2e1fb5b5c5', 'request_id': 'req-c788db06-1c1e-4a62-bacb-c9c94dd18e2b'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:40.425598 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-c788db06-1c1e-4a62-bacb-c9c94dd18e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '956a9a8e2de84eb78e309d2e1fb5b5c5', 'request_id': 'req-c788db06-1c1e-4a62-bacb-c9c94dd18e2b'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:40.432066 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-c788db06-1c1e-4a62-bacb-c9c94dd18e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '956a9a8e2de84eb78e309d2e1fb5b5c5', 'request_id': 'req-c788db06-1c1e-4a62-bacb-c9c94dd18e2b'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:40.449339 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-c788db06-1c1e-4a62-bacb-c9c94dd18e2b admin admin] The token cache is being invalidate because project 956a9a8e2de84eb78e309d2e1fb5b5c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:40.449707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-c788db06-1c1e-4a62-bacb-c9c94dd18e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:40.450502 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-c788db06-1c1e-4a62-bacb-c9c94dd18e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:40.452302 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1092/2186] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:40 2022] DELETE /identity/v3/projects/956a9a8e2de84eb78e309d2e1fb5b5c5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:40.457807 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feaceaa-7186-42cc-897a-92ed8a21774f None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:40.458364 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feaceaa-7186-42cc-897a-92ed8a21774f None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:40.458446 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feaceaa-7186-42cc-897a-92ed8a21774f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:40.477340 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-2feaceaa-7186-42cc-897a-92ed8a21774f None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:40.482812 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-2feaceaa-7186-42cc-897a-92ed8a21774f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:40.554557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1095/2187] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:40.563562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ad839-eb10-4c3c-8a51-6f4df1c2141c None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:40.563859 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ad839-eb10-4c3c-8a51-6f4df1c2141c None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:40.564173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ad839-eb10-4c3c-8a51-6f4df1c2141c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:40.584822 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-3c7ad839-eb10-4c3c-8a51-6f4df1c2141c None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:40.587265 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-3c7ad839-eb10-4c3c-8a51-6f4df1c2141c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:40.597452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1093/2188] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:40.601405 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feaceaa-7186-42cc-897a-92ed8a21774f None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:40.611982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feaceaa-7186-42cc-897a-92ed8a21774f None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:40.617818 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caab5ca-d436-4648-9ecb-145b90d1de3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:40.618285 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caab5ca-d436-4648-9ecb-145b90d1de3d admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:40.618702 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caab5ca-d436-4648-9ecb-145b90d1de3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:40.618987 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caab5ca-d436-4648-9ecb-145b90d1de3d admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:40.620199 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caab5ca-d436-4648-9ecb-145b90d1de3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:03:40.620518 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caab5ca-d436-4648-9ecb-145b90d1de3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:40.622310 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caab5ca-d436-4648-9ecb-145b90d1de3d admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:40.639342 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1096/2189] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:03:40.643957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ad839-eb10-4c3c-8a51-6f4df1c2141c None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:40.654896 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ad839-eb10-4c3c-8a51-6f4df1c2141c None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:40.661452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7208c0-effe-439a-afdc-aed0520af816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:40.662457 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7208c0-effe-439a-afdc-aed0520af816 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:40.663133 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7208c0-effe-439a-afdc-aed0520af816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:40.663583 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7208c0-effe-439a-afdc-aed0520af816 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:40.664479 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7208c0-effe-439a-afdc-aed0520af816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:40.667156 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7208c0-effe-439a-afdc-aed0520af816 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:40.704044 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1094/2190] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:40 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:40.709223 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caab5ca-d436-4648-9ecb-145b90d1de3d admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:40.724240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caab5ca-d436-4648-9ecb-145b90d1de3d admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:40.825740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e41225-9b6c-471b-b086-798fd06e6f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:40.826504 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e41225-9b6c-471b-b086-798fd06e6f64 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:40.826786 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e41225-9b6c-471b-b086-798fd06e6f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:40.827059 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e41225-9b6c-471b-b086-798fd06e6f64 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:40.827807 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e41225-9b6c-471b-b086-798fd06e6f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:40.845112 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e41225-9b6c-471b-b086-798fd06e6f64 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:40.884240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1097/2191] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:40 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:40.888214 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7208c0-effe-439a-afdc-aed0520af816 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:40.899548 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7208c0-effe-439a-afdc-aed0520af816 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:40.904244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bc268-eee7-473d-8236-a3dfaabe985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:40.904897 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bc268-eee7-473d-8236-a3dfaabe985b admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:40.905170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bc268-eee7-473d-8236-a3dfaabe985b admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:40.905616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bc268-eee7-473d-8236-a3dfaabe985b admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:40.906383 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bc268-eee7-473d-8236-a3dfaabe985b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:40.908114 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bc268-eee7-473d-8236-a3dfaabe985b admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:40.920014 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1095/2192] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:40.923682 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e41225-9b6c-471b-b086-798fd06e6f64 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:40.936009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e41225-9b6c-471b-b086-798fd06e6f64 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:40.941359 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b2720-b72c-4764-9dd7-42205a44b6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:40.942046 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b2720-b72c-4764-9dd7-42205a44b6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:40.942368 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b2720-b72c-4764-9dd7-42205a44b6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:40.942652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b2720-b72c-4764-9dd7-42205a44b6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:40.943388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b2720-b72c-4764-9dd7-42205a44b6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:40.944999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b2720-b72c-4764-9dd7-42205a44b6d0 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:40.965994 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1098/2193] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:03:40.970508 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bc268-eee7-473d-8236-a3dfaabe985b admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:40.985756 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bc268-eee7-473d-8236-a3dfaabe985b admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:40.992127 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126b85d-6255-4503-888b-8bb750c51cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:40.993466 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126b85d-6255-4503-888b-8bb750c51cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:40.993778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126b85d-6255-4503-888b-8bb750c51cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:40.994130 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126b85d-6255-4503-888b-8bb750c51cf6 admin admin] PATH_INFO: `/v3/projects/a68724f8dee24cd4bcf86653168a16fc/users/5bac7a7f945341aeabe47c54960ae203/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:41.005389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b2720-b72c-4764-9dd7-42205a44b6d0 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:41.008348 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c95b2720-b72c-4764-9dd7-42205a44b6d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:41.018175 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126b85d-6255-4503-888b-8bb750c51cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a68724f8dee24cd4bcf86653168a16fc, user_id=5bac7a7f945341aeabe47c54960ae203, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:41.020922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126b85d-6255-4503-888b-8bb750c51cf6 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:41.025561 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b2720-b72c-4764-9dd7-42205a44b6d0 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:41.031857 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a0159-f19a-4b0b-875b-0f3787d12197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:41.032757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a0159-f19a-4b0b-875b-0f3787d12197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:41.033039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a0159-f19a-4b0b-875b-0f3787d12197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:41.033316 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a0159-f19a-4b0b-875b-0f3787d12197 admin admin] PATH_INFO: `/v3/users/5c8cf1adb72a4fac840942aee7b5631d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:41.035132 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a0159-f19a-4b0b-875b-0f3787d12197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c8cf1adb72a4fac840942aee7b5631d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:41.037097 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a0159-f19a-4b0b-875b-0f3787d12197 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:41.049187 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1096/2194] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:40 2022] PUT /identity/v3/projects/a68724f8dee24cd4bcf86653168a16fc/users/5bac7a7f945341aeabe47c54960ae203/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:41.054086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942bddb-c6a1-46a7-968f-2d07be2b72d2 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:41.054462 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942bddb-c6a1-46a7-968f-2d07be2b72d2 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:41.054783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942bddb-c6a1-46a7-968f-2d07be2b72d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:41.079594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-6942bddb-c6a1-46a7-968f-2d07be2b72d2 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:41.080900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-6942bddb-c6a1-46a7-968f-2d07be2b72d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:41.104267 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-560a0159-f19a-4b0b-875b-0f3787d12197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c8cf1adb72a4fac840942aee7b5631d'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:41.105005 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-560a0159-f19a-4b0b-875b-0f3787d12197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c8cf1adb72a4fac840942aee7b5631d'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:41.119048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-560a0159-f19a-4b0b-875b-0f3787d12197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c8cf1adb72a4fac840942aee7b5631d'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:41.128817 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-560a0159-f19a-4b0b-875b-0f3787d12197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c8cf1adb72a4fac840942aee7b5631d'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:41.141412 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-560a0159-f19a-4b0b-875b-0f3787d12197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c8cf1adb72a4fac840942aee7b5631d'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:41.148582 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1099/2195] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:41 2022] DELETE /identity/v3/users/5c8cf1adb72a4fac840942aee7b5631d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:41.154698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbde7a-8543-4fa2-bc44-457f3a431607 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:41.154932 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbde7a-8543-4fa2-bc44-457f3a431607 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:41.155435 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbde7a-8543-4fa2-bc44-457f3a431607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:41.183277 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-42bbde7a-8543-4fa2-bc44-457f3a431607 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:41.184526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-42bbde7a-8543-4fa2-bc44-457f3a431607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:41.199330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1097/2196] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:41.210628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942bddb-c6a1-46a7-968f-2d07be2b72d2 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:41.212935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-6942bddb-c6a1-46a7-968f-2d07be2b72d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:41.277257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1100/2197] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:41.329548 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942bddb-c6a1-46a7-968f-2d07be2b72d2 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:41.332461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbde7a-8543-4fa2-bc44-457f3a431607 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:41.333905 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-42bbde7a-8543-4fa2-bc44-457f3a431607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:41.394917 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38852ddb-5540-4594-b707-5e5e30ba2f9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:41.395724 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38852ddb-5540-4594-b707-5e5e30ba2f9a service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:41.396081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38852ddb-5540-4594-b707-5e5e30ba2f9a service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:41.396432 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38852ddb-5540-4594-b707-5e5e30ba2f9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:41.409331 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38852ddb-5540-4594-b707-5e5e30ba2f9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:41.411573 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38852ddb-5540-4594-b707-5e5e30ba2f9a service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:41.427672 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1098/2198] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:03:41.434831 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbde7a-8543-4fa2-bc44-457f3a431607 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:41.438678 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155c9f8-da6e-46e3-a86d-808f3b3a4a3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:41.439334 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155c9f8-da6e-46e3-a86d-808f3b3a4a3a service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:41.439645 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155c9f8-da6e-46e3-a86d-808f3b3a4a3a service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:41.439894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155c9f8-da6e-46e3-a86d-808f3b3a4a3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:41.450008 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155c9f8-da6e-46e3-a86d-808f3b3a4a3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:41.451641 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155c9f8-da6e-46e3-a86d-808f3b3a4a3a service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:41.461810 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1101/2199] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:41.809420 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38852ddb-5540-4594-b707-5e5e30ba2f9a service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:41.811117 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-38852ddb-5540-4594-b707-5e5e30ba2f9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:41.826988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38852ddb-5540-4594-b707-5e5e30ba2f9a service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:41.834063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155c9f8-da6e-46e3-a86d-808f3b3a4a3a service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:41.834352 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6aa86-1477-4fe2-b015-632b414b5300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:41.835326 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6aa86-1477-4fe2-b015-632b414b5300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:41.835609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6aa86-1477-4fe2-b015-632b414b5300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:41.835715 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-8155c9f8-da6e-46e3-a86d-808f3b3a4a3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:41.835880 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6aa86-1477-4fe2-b015-632b414b5300 admin admin] PATH_INFO: `/v3/projects/5744960322494493bcb5bfe0e85a4fd2` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:41.837738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6aa86-1477-4fe2-b015-632b414b5300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5744960322494493bcb5bfe0e85a4fd2)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:41.840157 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6aa86-1477-4fe2-b015-632b414b5300 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:41.859533 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155c9f8-da6e-46e3-a86d-808f3b3a4a3a service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:41.879155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad4150-0d69-452d-be7d-a0b25468c747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:41.880065 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad4150-0d69-452d-be7d-a0b25468c747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:41.882855 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad4150-0d69-452d-be7d-a0b25468c747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:41.883298 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad4150-0d69-452d-be7d-a0b25468c747 admin admin] PATH_INFO: `/v3/users/b37334ca923c4b1cac64ccd4e57215e8` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:41.884934 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad4150-0d69-452d-be7d-a0b25468c747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b37334ca923c4b1cac64ccd4e57215e8)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:41.887893 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad4150-0d69-452d-be7d-a0b25468c747 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:41.956587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-44b6aa86-1477-4fe2-b015-632b414b5300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5744960322494493bcb5bfe0e85a4fd2', 'request_id': 'req-44b6aa86-1477-4fe2-b015-632b414b5300'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:41.966642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-44b6aa86-1477-4fe2-b015-632b414b5300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5744960322494493bcb5bfe0e85a4fd2', 'request_id': 'req-44b6aa86-1477-4fe2-b015-632b414b5300'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:41.972980 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-8bad4150-0d69-452d-be7d-a0b25468c747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b37334ca923c4b1cac64ccd4e57215e8'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:41.974813 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-8bad4150-0d69-452d-be7d-a0b25468c747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b37334ca923c4b1cac64ccd4e57215e8'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:41.979086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-44b6aa86-1477-4fe2-b015-632b414b5300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5744960322494493bcb5bfe0e85a4fd2', 'request_id': 'req-44b6aa86-1477-4fe2-b015-632b414b5300'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:41.996994 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-44b6aa86-1477-4fe2-b015-632b414b5300 admin admin] The token cache is being invalidate because project 5744960322494493bcb5bfe0e85a4fd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:41.997584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-44b6aa86-1477-4fe2-b015-632b414b5300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:41.998726 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-44b6aa86-1477-4fe2-b015-632b414b5300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:42.001644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1099/2200] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:41 2022] DELETE /identity/v3/projects/5744960322494493bcb5bfe0e85a4fd2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:42.006231 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6aa86-1477-4fe2-b015-632b414b5300 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:42.008597 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-44b6aa86-1477-4fe2-b015-632b414b5300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:42.022046 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-8bad4150-0d69-452d-be7d-a0b25468c747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b37334ca923c4b1cac64ccd4e57215e8'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:42.036196 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-8bad4150-0d69-452d-be7d-a0b25468c747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b37334ca923c4b1cac64ccd4e57215e8'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:42.049842 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-8bad4150-0d69-452d-be7d-a0b25468c747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b37334ca923c4b1cac64ccd4e57215e8'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:42.061805 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1102/2201] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:41 2022] DELETE /identity/v3/users/b37334ca923c4b1cac64ccd4e57215e8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:42.065852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90747a-a2e9-4b41-afcd-40c72245dc0e None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:42.067009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90747a-a2e9-4b41-afcd-40c72245dc0e None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:42.068440 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90747a-a2e9-4b41-afcd-40c72245dc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:42.093340 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-ca90747a-a2e9-4b41-afcd-40c72245dc0e None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:42.096364 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-ca90747a-a2e9-4b41-afcd-40c72245dc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:42.096891 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6aa86-1477-4fe2-b015-632b414b5300 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:42.204534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a5cc5-3457-4219-8cd2-30445d1a3908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:42.205484 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1103/2202] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:42.206236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a5cc5-3457-4219-8cd2-30445d1a3908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:42.206521 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a5cc5-3457-4219-8cd2-30445d1a3908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:42.206862 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a5cc5-3457-4219-8cd2-30445d1a3908 admin admin] PATH_INFO: `/v3/users/ba6138c28b574764b6a35ef5d88ff35f` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:42.208138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a5cc5-3457-4219-8cd2-30445d1a3908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba6138c28b574764b6a35ef5d88ff35f)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:42.210080 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a5cc5-3457-4219-8cd2-30445d1a3908 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:42.214966 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90747a-a2e9-4b41-afcd-40c72245dc0e None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:42.216327 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-ca90747a-a2e9-4b41-afcd-40c72245dc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:42.269623 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b55a5cc5-3457-4219-8cd2-30445d1a3908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba6138c28b574764b6a35ef5d88ff35f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:42.282084 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b55a5cc5-3457-4219-8cd2-30445d1a3908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba6138c28b574764b6a35ef5d88ff35f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:42.282341 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90747a-a2e9-4b41-afcd-40c72245dc0e None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:42.286891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f185d49-7753-460a-8223-3259f5e70f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:42.287617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f185d49-7753-460a-8223-3259f5e70f57 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:42.287929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f185d49-7753-460a-8223-3259f5e70f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:42.288206 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f185d49-7753-460a-8223-3259f5e70f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:42.299121 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f185d49-7753-460a-8223-3259f5e70f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:42.300631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f185d49-7753-460a-8223-3259f5e70f57 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:42.301027 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b55a5cc5-3457-4219-8cd2-30445d1a3908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba6138c28b574764b6a35ef5d88ff35f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:42.302568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b55a5cc5-3457-4219-8cd2-30445d1a3908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba6138c28b574764b6a35ef5d88ff35f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:42.303421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b55a5cc5-3457-4219-8cd2-30445d1a3908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba6138c28b574764b6a35ef5d88ff35f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:42.314364 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1104/2203] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:42.322032 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1100/2204] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:42 2022] DELETE /identity/v3/users/ba6138c28b574764b6a35ef5d88ff35f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:42.340519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713eaa7-5c68-4cfa-bca5-93c680c436e7 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:42.340759 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713eaa7-5c68-4cfa-bca5-93c680c436e7 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:42.341036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713eaa7-5c68-4cfa-bca5-93c680c436e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:42.372994 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-1713eaa7-5c68-4cfa-bca5-93c680c436e7 None None] MFA Rules not processed for user `5bac7a7f945341aeabe47c54960ae203`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:42.374335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-1713eaa7-5c68-4cfa-bca5-93c680c436e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:42.520721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1105/2205] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:42.525522 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a5cc5-3457-4219-8cd2-30445d1a3908 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:42.527338 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b55a5cc5-3457-4219-8cd2-30445d1a3908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:42.622381 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a5cc5-3457-4219-8cd2-30445d1a3908 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:42.626901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db08625-0b89-4384-bb52-1b5a08c23598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:42.627557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db08625-0b89-4384-bb52-1b5a08c23598 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:42.627834 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db08625-0b89-4384-bb52-1b5a08c23598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:42.628108 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db08625-0b89-4384-bb52-1b5a08c23598 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:42.628836 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db08625-0b89-4384-bb52-1b5a08c23598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:42.631515 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db08625-0b89-4384-bb52-1b5a08c23598 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:42.667075 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713eaa7-5c68-4cfa-bca5-93c680c436e7 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:42.667972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1101/2206] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:42 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:42.680480 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713eaa7-5c68-4cfa-bca5-93c680c436e7 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:42.741345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fafee2-9aa4-4495-bbd7-a274694fb14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:42.742022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fafee2-9aa4-4495-bbd7-a274694fb14b admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:42.742554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fafee2-9aa4-4495-bbd7-a274694fb14b admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:42.743089 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fafee2-9aa4-4495-bbd7-a274694fb14b admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:42.743791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fafee2-9aa4-4495-bbd7-a274694fb14b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:42.745885 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fafee2-9aa4-4495-bbd7-a274694fb14b admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:42.765998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1106/2207] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:42 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:42.769960 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db08625-0b89-4384-bb52-1b5a08c23598 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:42.780813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db08625-0b89-4384-bb52-1b5a08c23598 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:42.785449 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef7061-7c0b-4dcf-9248-0e4984a12770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:42.786102 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef7061-7c0b-4dcf-9248-0e4984a12770 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:42.786411 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef7061-7c0b-4dcf-9248-0e4984a12770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:42.786684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef7061-7c0b-4dcf-9248-0e4984a12770 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:42.787406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef7061-7c0b-4dcf-9248-0e4984a12770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:42.789000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef7061-7c0b-4dcf-9248-0e4984a12770 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:42.800641 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1102/2208] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:42.804488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fafee2-9aa4-4495-bbd7-a274694fb14b admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:42.815099 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fafee2-9aa4-4495-bbd7-a274694fb14b admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:42.820085 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a23027-37d6-42e5-a5df-1bf8d3b01635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:42.821245 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a23027-37d6-42e5-a5df-1bf8d3b01635 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:42.821532 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a23027-37d6-42e5-a5df-1bf8d3b01635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:42.821827 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a23027-37d6-42e5-a5df-1bf8d3b01635 admin admin] PATH_INFO: `/v3/projects/28d99142a4fc4b1bba4238e62b5c48dd/users/f98ac190ae8e4821b6946df324585941/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:42.838985 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a23027-37d6-42e5-a5df-1bf8d3b01635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d99142a4fc4b1bba4238e62b5c48dd, user_id=f98ac190ae8e4821b6946df324585941, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:42.841659 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a23027-37d6-42e5-a5df-1bf8d3b01635 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:42.863287 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1107/2209] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:42 2022] PUT /identity/v3/projects/28d99142a4fc4b1bba4238e62b5c48dd/users/f98ac190ae8e4821b6946df324585941/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:42.867918 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef7061-7c0b-4dcf-9248-0e4984a12770 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:42.879196 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef7061-7c0b-4dcf-9248-0e4984a12770 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:42.894229 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a23027-37d6-42e5-a5df-1bf8d3b01635 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:42.901459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c5a23027-37d6-42e5-a5df-1bf8d3b01635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:42.962520 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bfbf7-6236-4560-8492-275201e9b7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:42.963510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bfbf7-6236-4560-8492-275201e9b7aa admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:42.963798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bfbf7-6236-4560-8492-275201e9b7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:42.964078 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bfbf7-6236-4560-8492-275201e9b7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:42.964818 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bfbf7-6236-4560-8492-275201e9b7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:42.966508 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bfbf7-6236-4560-8492-275201e9b7aa admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:42.978548 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1103/2210] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:03:42.979417 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bfbf7-6236-4560-8492-275201e9b7aa admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:42.981504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-df3bfbf7-6236-4560-8492-275201e9b7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:42.995635 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bfbf7-6236-4560-8492-275201e9b7aa admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:43.001523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d23334-a288-4518-9ce5-894b0f8c6fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:43.002438 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d23334-a288-4518-9ce5-894b0f8c6fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:43.002734 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d23334-a288-4518-9ce5-894b0f8c6fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:43.002986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d23334-a288-4518-9ce5-894b0f8c6fa3 admin admin] PATH_INFO: `/v3/projects/8da3711ec3034c158c91bfac934b7c19` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:43.004272 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d23334-a288-4518-9ce5-894b0f8c6fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8da3711ec3034c158c91bfac934b7c19)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:43.005253 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a23027-37d6-42e5-a5df-1bf8d3b01635 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:43.006222 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d23334-a288-4518-9ce5-894b0f8c6fa3 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:43.011509 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33cadd-aaf8-48ce-bf43-b7cd88f8a30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:43.012483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33cadd-aaf8-48ce-bf43-b7cd88f8a30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:43.012836 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33cadd-aaf8-48ce-bf43-b7cd88f8a30e admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:43.013178 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33cadd-aaf8-48ce-bf43-b7cd88f8a30e admin admin] PATH_INFO: `/v3/projects/c8dab943288c4caaa379cde05226353e` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:43.014511 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33cadd-aaf8-48ce-bf43-b7cd88f8a30e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8dab943288c4caaa379cde05226353e)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:43.016537 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33cadd-aaf8-48ce-bf43-b7cd88f8a30e admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:43.056634 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-93d23334-a288-4518-9ce5-894b0f8c6fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8da3711ec3034c158c91bfac934b7c19', 'request_id': 'req-93d23334-a288-4518-9ce5-894b0f8c6fa3'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:43.062361 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-93d23334-a288-4518-9ce5-894b0f8c6fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8da3711ec3034c158c91bfac934b7c19', 'request_id': 'req-93d23334-a288-4518-9ce5-894b0f8c6fa3'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:43.070121 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-93d23334-a288-4518-9ce5-894b0f8c6fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8da3711ec3034c158c91bfac934b7c19', 'request_id': 'req-93d23334-a288-4518-9ce5-894b0f8c6fa3'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:43.071040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-af33cadd-aaf8-48ce-bf43-b7cd88f8a30e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8dab943288c4caaa379cde05226353e', 'request_id': 'req-af33cadd-aaf8-48ce-bf43-b7cd88f8a30e'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:43.076942 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-af33cadd-aaf8-48ce-bf43-b7cd88f8a30e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8dab943288c4caaa379cde05226353e', 'request_id': 'req-af33cadd-aaf8-48ce-bf43-b7cd88f8a30e'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:43.083374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-93d23334-a288-4518-9ce5-894b0f8c6fa3 admin admin] The token cache is being invalidate because project 8da3711ec3034c158c91bfac934b7c19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:43.083649 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-af33cadd-aaf8-48ce-bf43-b7cd88f8a30e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8dab943288c4caaa379cde05226353e', 'request_id': 'req-af33cadd-aaf8-48ce-bf43-b7cd88f8a30e'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:43.083758 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-93d23334-a288-4518-9ce5-894b0f8c6fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:43.084330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-93d23334-a288-4518-9ce5-894b0f8c6fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:43.086325 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1104/2211] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:42 2022] DELETE /identity/v3/projects/8da3711ec3034c158c91bfac934b7c19 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:43.086959 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d23334-a288-4518-9ce5-894b0f8c6fa3 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:43.088292 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-93d23334-a288-4518-9ce5-894b0f8c6fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:43.100813 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-af33cadd-aaf8-48ce-bf43-b7cd88f8a30e admin admin] The token cache is being invalidate because project c8dab943288c4caaa379cde05226353e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:43.101211 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-af33cadd-aaf8-48ce-bf43-b7cd88f8a30e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:43.101880 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-af33cadd-aaf8-48ce-bf43-b7cd88f8a30e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:43.103641 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1108/2212] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:42 2022] DELETE /identity/v3/projects/c8dab943288c4caaa379cde05226353e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:43.104855 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e968e9-4b0c-4823-a3a9-838162cb57ba None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:43.105140 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e968e9-4b0c-4823-a3a9-838162cb57ba None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:43.105416 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e968e9-4b0c-4823-a3a9-838162cb57ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:43.124940 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-f4e968e9-4b0c-4823-a3a9-838162cb57ba None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:43.126137 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f4e968e9-4b0c-4823-a3a9-838162cb57ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:43.161208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d23334-a288-4518-9ce5-894b0f8c6fa3 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:43.186313 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1109/2213] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:43.187199 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e968e9-4b0c-4823-a3a9-838162cb57ba None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:43.188539 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f4e968e9-4b0c-4823-a3a9-838162cb57ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:43.200718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e968e9-4b0c-4823-a3a9-838162cb57ba None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:43.206074 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a57627-8943-42dd-9d62-398833234196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:43.206973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a57627-8943-42dd-9d62-398833234196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:43.207250 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a57627-8943-42dd-9d62-398833234196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:43.207547 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a57627-8943-42dd-9d62-398833234196 admin admin] PATH_INFO: `/v3/users/7af462e9ae324c9898da0955c08249bf` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:43.208732 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a57627-8943-42dd-9d62-398833234196 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7af462e9ae324c9898da0955c08249bf)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:43.210668 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a57627-8943-42dd-9d62-398833234196 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:43.227663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642e184-c617-41b1-9581-8366f465b7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:43.228576 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642e184-c617-41b1-9581-8366f465b7ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:43.228847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642e184-c617-41b1-9581-8366f465b7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:43.229158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642e184-c617-41b1-9581-8366f465b7ce admin admin] PATH_INFO: `/v3/projects/28d99142a4fc4b1bba4238e62b5c48dd/users/f98ac190ae8e4821b6946df324585941/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:43.231162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642e184-c617-41b1-9581-8366f465b7ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d99142a4fc4b1bba4238e62b5c48dd, user_id=f98ac190ae8e4821b6946df324585941, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:43.233788 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642e184-c617-41b1-9581-8366f465b7ce admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:43.246007 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1105/2214] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:43 2022] PUT /identity/v3/projects/28d99142a4fc4b1bba4238e62b5c48dd/users/f98ac190ae8e4821b6946df324585941/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:43.247901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eecac1-d1a0-4ed5-b611-79bd4a0ea00b None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:43.248316 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eecac1-d1a0-4ed5-b611-79bd4a0ea00b None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:43.248719 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eecac1-d1a0-4ed5-b611-79bd4a0ea00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:43.262978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a3a57627-8943-42dd-9d62-398833234196 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7af462e9ae324c9898da0955c08249bf'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:43.263656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a3a57627-8943-42dd-9d62-398833234196 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7af462e9ae324c9898da0955c08249bf'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:43.270367 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-34eecac1-d1a0-4ed5-b611-79bd4a0ea00b None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:43.271818 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-34eecac1-d1a0-4ed5-b611-79bd4a0ea00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:43.279533 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a3a57627-8943-42dd-9d62-398833234196 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7af462e9ae324c9898da0955c08249bf'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:43.288466 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a3a57627-8943-42dd-9d62-398833234196 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7af462e9ae324c9898da0955c08249bf'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:43.296428 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a3a57627-8943-42dd-9d62-398833234196 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7af462e9ae324c9898da0955c08249bf'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:43.302565 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1110/2215] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:43 2022] DELETE /identity/v3/users/7af462e9ae324c9898da0955c08249bf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:43.338758 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1106/2216] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:43.343250 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a57627-8943-42dd-9d62-398833234196 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:43.430431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a57627-8943-42dd-9d62-398833234196 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:43.434872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ef5b8-b501-4c22-87dc-dc83ccb893e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:43.435719 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ef5b8-b501-4c22-87dc-dc83ccb893e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:43.436006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ef5b8-b501-4c22-87dc-dc83ccb893e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:43.436283 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ef5b8-b501-4c22-87dc-dc83ccb893e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:43.437020 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ef5b8-b501-4c22-87dc-dc83ccb893e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:03:43.437328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ef5b8-b501-4c22-87dc-dc83ccb893e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:43.438964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ef5b8-b501-4c22-87dc-dc83ccb893e3 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:43.452716 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1111/2217] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:03:43.457044 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eecac1-d1a0-4ed5-b611-79bd4a0ea00b None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:43.468221 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eecac1-d1a0-4ed5-b611-79bd4a0ea00b None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:43.474753 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4becfa-d2b4-417e-8720-2b8a3ed3ba71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:43.475763 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4becfa-d2b4-417e-8720-2b8a3ed3ba71 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:43.476045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4becfa-d2b4-417e-8720-2b8a3ed3ba71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:43.476383 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4becfa-d2b4-417e-8720-2b8a3ed3ba71 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:43.479230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4becfa-d2b4-417e-8720-2b8a3ed3ba71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:43.481404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4becfa-d2b4-417e-8720-2b8a3ed3ba71 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:43.513503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1107/2218] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:43 2022] POST /identity/v3/projects => generated 359 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:43.514900 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ef5b8-b501-4c22-87dc-dc83ccb893e3 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:43.525658 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ef5b8-b501-4c22-87dc-dc83ccb893e3 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:43.584814 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1149fd-4cda-4275-a47a-0b771c5db037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:43.585489 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1149fd-4cda-4275-a47a-0b771c5db037 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:43.585771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1149fd-4cda-4275-a47a-0b771c5db037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:43.586503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1149fd-4cda-4275-a47a-0b771c5db037 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:43.587277 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1149fd-4cda-4275-a47a-0b771c5db037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:43.589213 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1149fd-4cda-4275-a47a-0b771c5db037 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:43.618929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1112/2219] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:43 2022] POST /identity/v3/users => generated 280 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:43.620099 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4becfa-d2b4-417e-8720-2b8a3ed3ba71 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:43.638150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4becfa-d2b4-417e-8720-2b8a3ed3ba71 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:43.644509 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33bc1a-9061-4768-b03c-7f380474ea8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:43.646803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33bc1a-9061-4768-b03c-7f380474ea8b admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:43.646803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33bc1a-9061-4768-b03c-7f380474ea8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:43.646803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33bc1a-9061-4768-b03c-7f380474ea8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:43.646803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33bc1a-9061-4768-b03c-7f380474ea8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:43.650860 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33bc1a-9061-4768-b03c-7f380474ea8b admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:43.662843 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1108/2220] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:43.667227 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1149fd-4cda-4275-a47a-0b771c5db037 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:43.677684 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1149fd-4cda-4275-a47a-0b771c5db037 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:43.682992 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ecff7-0d58-448e-9548-eb40d37f54a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:43.683643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ecff7-0d58-448e-9548-eb40d37f54a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:43.683928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ecff7-0d58-448e-9548-eb40d37f54a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:43.684228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ecff7-0d58-448e-9548-eb40d37f54a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:43.684948 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ecff7-0d58-448e-9548-eb40d37f54a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:43.686620 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ecff7-0d58-448e-9548-eb40d37f54a1 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:43.697353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1113/2221] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:03:43.701123 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33bc1a-9061-4768-b03c-7f380474ea8b admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:43.711626 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33bc1a-9061-4768-b03c-7f380474ea8b admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:43.716691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec1e5b-e156-48f1-969f-da158f34eb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:43.717594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec1e5b-e156-48f1-969f-da158f34eb19 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:43.718549 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec1e5b-e156-48f1-969f-da158f34eb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:43.718671 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec1e5b-e156-48f1-969f-da158f34eb19 admin admin] PATH_INFO: `/v3/projects/1be0d7c802ad4ca39b5a28bacdae2fc9/users/b98b91be563b4b11a885dfb075454a86/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:43.736005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec1e5b-e156-48f1-969f-da158f34eb19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be0d7c802ad4ca39b5a28bacdae2fc9, user_id=b98b91be563b4b11a885dfb075454a86, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:43.738741 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec1e5b-e156-48f1-969f-da158f34eb19 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:43.759841 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1109/2222] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:43 2022] PUT /identity/v3/projects/1be0d7c802ad4ca39b5a28bacdae2fc9/users/b98b91be563b4b11a885dfb075454a86/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:43.770817 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdeb69-0b3e-4c0b-800b-bd08dd5e9e76 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:43.770817 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdeb69-0b3e-4c0b-800b-bd08dd5e9e76 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:43.771075 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdeb69-0b3e-4c0b-800b-bd08dd5e9e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:43.806022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-11cdeb69-0b3e-4c0b-800b-bd08dd5e9e76 None None] MFA Rules not processed for user `b98b91be563b4b11a885dfb075454a86`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:43.807366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-11cdeb69-0b3e-4c0b-800b-bd08dd5e9e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:43.879076 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1114/2223] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:43 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:43.912111 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec1e5b-e156-48f1-969f-da158f34eb19 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:43.913863 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-2dec1e5b-e156-48f1-969f-da158f34eb19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:43.975602 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec1e5b-e156-48f1-969f-da158f34eb19 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:43.979720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732d4c5-527b-4bf5-890a-65dd19f2d121 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:43.980389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732d4c5-527b-4bf5-890a-65dd19f2d121 service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:43.980671 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732d4c5-527b-4bf5-890a-65dd19f2d121 service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:43.980948 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732d4c5-527b-4bf5-890a-65dd19f2d121 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:43.990479 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732d4c5-527b-4bf5-890a-65dd19f2d121 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:43.991936 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732d4c5-527b-4bf5-890a-65dd19f2d121 service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:44.003110 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1110/2224] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:43 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:44.018413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdeb69-0b3e-4c0b-800b-bd08dd5e9e76 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:44.084820 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdeb69-0b3e-4c0b-800b-bd08dd5e9e76 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:44.090033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328917c-ced0-4eda-b183-f11d18c43893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:44.091005 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328917c-ced0-4eda-b183-f11d18c43893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:44.091290 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328917c-ced0-4eda-b183-f11d18c43893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:44.091561 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328917c-ced0-4eda-b183-f11d18c43893 admin admin] PATH_INFO: `/v3/users/b98b91be563b4b11a885dfb075454a86` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:44.092775 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328917c-ced0-4eda-b183-f11d18c43893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b98b91be563b4b11a885dfb075454a86)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:44.094742 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328917c-ced0-4eda-b183-f11d18c43893 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:44.143005 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a328917c-ced0-4eda-b183-f11d18c43893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b98b91be563b4b11a885dfb075454a86'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:44.143624 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a328917c-ced0-4eda-b183-f11d18c43893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b98b91be563b4b11a885dfb075454a86'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:44.158866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a328917c-ced0-4eda-b183-f11d18c43893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b98b91be563b4b11a885dfb075454a86'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:44.166934 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a328917c-ced0-4eda-b183-f11d18c43893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b98b91be563b4b11a885dfb075454a86'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:44.173910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a328917c-ced0-4eda-b183-f11d18c43893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b98b91be563b4b11a885dfb075454a86'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:44.179944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1115/2225] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:44 2022] DELETE /identity/v3/users/b98b91be563b4b11a885dfb075454a86 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:44.184468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd72645-1a37-45a2-952b-ce143a033db3 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:44.184758 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd72645-1a37-45a2-952b-ce143a033db3 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:44.185038 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd72645-1a37-45a2-952b-ce143a033db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:44.204755 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-afd72645-1a37-45a2-952b-ce143a033db3 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:44.205978 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-afd72645-1a37-45a2-952b-ce143a033db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:44.285168 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1111/2226] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:44.302654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328917c-ced0-4eda-b183-f11d18c43893 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:44.304101 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-a328917c-ced0-4eda-b183-f11d18c43893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:44.363957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd72645-1a37-45a2-952b-ce143a033db3 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:44.365403 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-afd72645-1a37-45a2-952b-ce143a033db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:44.412092 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328917c-ced0-4eda-b183-f11d18c43893 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:44.420713 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b07566-912c-46a1-b7c6-0c5cb89fb7bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:44.421956 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b07566-912c-46a1-b7c6-0c5cb89fb7bf service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:44.422276 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b07566-912c-46a1-b7c6-0c5cb89fb7bf service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:44.422571 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b07566-912c-46a1-b7c6-0c5cb89fb7bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:44.460597 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b07566-912c-46a1-b7c6-0c5cb89fb7bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:44.465412 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b07566-912c-46a1-b7c6-0c5cb89fb7bf service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:44.494110 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd72645-1a37-45a2-952b-ce143a033db3 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:44.498442 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1116/2227] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:44.499974 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720975f-2e61-48d7-9a92-c4c52f087582 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:44.500107 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720975f-2e61-48d7-9a92-c4c52f087582 service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:44.500321 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720975f-2e61-48d7-9a92-c4c52f087582 service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:44.500597 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720975f-2e61-48d7-9a92-c4c52f087582 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:44.502996 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-2720975f-2e61-48d7-9a92-c4c52f087582 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:44.549059 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b07566-912c-46a1-b7c6-0c5cb89fb7bf service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:44.553475 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-b8b07566-912c-46a1-b7c6-0c5cb89fb7bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:44.578500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b07566-912c-46a1-b7c6-0c5cb89fb7bf service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:44.590722 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5362f05-bd22-4a1f-9d76-9eefbcd26d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:44.592727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5362f05-bd22-4a1f-9d76-9eefbcd26d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:44.594990 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5362f05-bd22-4a1f-9d76-9eefbcd26d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:44.595390 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5362f05-bd22-4a1f-9d76-9eefbcd26d72 admin admin] PATH_INFO: `/v3/projects/3edcd25c3c3a4c4ba71f37a243b05c9d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:44.597845 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5362f05-bd22-4a1f-9d76-9eefbcd26d72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3edcd25c3c3a4c4ba71f37a243b05c9d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:44.603194 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5362f05-bd22-4a1f-9d76-9eefbcd26d72 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:44.612317 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720975f-2e61-48d7-9a92-c4c52f087582 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:44.616814 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720975f-2e61-48d7-9a92-c4c52f087582 service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:44.639209 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1112/2228] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:03:44.723181 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-b5362f05-bd22-4a1f-9d76-9eefbcd26d72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3edcd25c3c3a4c4ba71f37a243b05c9d', 'request_id': 'req-b5362f05-bd22-4a1f-9d76-9eefbcd26d72'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:44.739624 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-b5362f05-bd22-4a1f-9d76-9eefbcd26d72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3edcd25c3c3a4c4ba71f37a243b05c9d', 'request_id': 'req-b5362f05-bd22-4a1f-9d76-9eefbcd26d72'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:44.747649 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-b5362f05-bd22-4a1f-9d76-9eefbcd26d72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3edcd25c3c3a4c4ba71f37a243b05c9d', 'request_id': 'req-b5362f05-bd22-4a1f-9d76-9eefbcd26d72'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:44.770113 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-b5362f05-bd22-4a1f-9d76-9eefbcd26d72 admin admin] The token cache is being invalidate because project 3edcd25c3c3a4c4ba71f37a243b05c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:44.770442 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-b5362f05-bd22-4a1f-9d76-9eefbcd26d72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:44.771467 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-b5362f05-bd22-4a1f-9d76-9eefbcd26d72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:44.775509 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1117/2229] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:44 2022] DELETE /identity/v3/projects/3edcd25c3c3a4c4ba71f37a243b05c9d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:44.783958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d600f32-bd47-4860-b75e-9af1938758c1 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:44.784257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d600f32-bd47-4860-b75e-9af1938758c1 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:44.784710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d600f32-bd47-4860-b75e-9af1938758c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:44.841537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-2d600f32-bd47-4860-b75e-9af1938758c1 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:44.843983 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-2d600f32-bd47-4860-b75e-9af1938758c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:45.011216 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba1b2f-936b-4ac1-b1f7-1183bcfa7c8d None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:45.012157 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba1b2f-936b-4ac1-b1f7-1183bcfa7c8d None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:45.012715 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba1b2f-936b-4ac1-b1f7-1183bcfa7c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:45.025138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1113/2230] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:45.047701 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-93ba1b2f-936b-4ac1-b1f7-1183bcfa7c8d None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:45.049102 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-93ba1b2f-936b-4ac1-b1f7-1183bcfa7c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:45.056243 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86943a-8048-4805-86c7-5e2b621cdc20 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:45.056532 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86943a-8048-4805-86c7-5e2b621cdc20 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:45.056916 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86943a-8048-4805-86c7-5e2b621cdc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:45.089279 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1118/2231] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:45.091335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba1b2f-936b-4ac1-b1f7-1183bcfa7c8d None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:45.125737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba1b2f-936b-4ac1-b1f7-1183bcfa7c8d None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:45.130296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-fc86943a-8048-4805-86c7-5e2b621cdc20 None None] MFA Rules not processed for user `f98ac190ae8e4821b6946df324585941`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:45.131525 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-fc86943a-8048-4805-86c7-5e2b621cdc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:45.147687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a5e11-b021-417e-80b1-3b9d340fb51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:45.148753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a5e11-b021-417e-80b1-3b9d340fb51c admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:45.149003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a5e11-b021-417e-80b1-3b9d340fb51c admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:45.149227 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a5e11-b021-417e-80b1-3b9d340fb51c admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:45.152485 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a5e11-b021-417e-80b1-3b9d340fb51c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:03:45.152485 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a5e11-b021-417e-80b1-3b9d340fb51c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:45.154953 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a5e11-b021-417e-80b1-3b9d340fb51c admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:45.188852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1119/2232] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:03:45.198699 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a5e11-b021-417e-80b1-3b9d340fb51c admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:45.223744 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a5e11-b021-417e-80b1-3b9d340fb51c admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:45.245233 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd0449-5124-4854-8080-c9aff1ab3701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:45.245915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd0449-5124-4854-8080-c9aff1ab3701 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:45.246224 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd0449-5124-4854-8080-c9aff1ab3701 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:45.246493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd0449-5124-4854-8080-c9aff1ab3701 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:45.247200 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd0449-5124-4854-8080-c9aff1ab3701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:45.261899 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd0449-5124-4854-8080-c9aff1ab3701 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:45.314650 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1120/2233] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:45 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:45.316926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd0449-5124-4854-8080-c9aff1ab3701 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:45.336968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1114/2234] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:45 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:45.360513 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86943a-8048-4805-86c7-5e2b621cdc20 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:45.363158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-fc86943a-8048-4805-86c7-5e2b621cdc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:45.475924 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86943a-8048-4805-86c7-5e2b621cdc20 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:45.489369 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd0449-5124-4854-8080-c9aff1ab3701 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:45.496151 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798bd93-dafc-404c-95b5-9aee0ac48643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:45.496989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798bd93-dafc-404c-95b5-9aee0ac48643 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:45.497416 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798bd93-dafc-404c-95b5-9aee0ac48643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:45.497815 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798bd93-dafc-404c-95b5-9aee0ac48643 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:45.500012 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798bd93-dafc-404c-95b5-9aee0ac48643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:45.502135 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798bd93-dafc-404c-95b5-9aee0ac48643 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:45.537063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1121/2235] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:45 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:45.537063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798bd93-dafc-404c-95b5-9aee0ac48643 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:45.537063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-3798bd93-dafc-404c-95b5-9aee0ac48643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:45.572369 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798bd93-dafc-404c-95b5-9aee0ac48643 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:45.577927 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a3ead-6cff-4241-a3c6-f67e3f180298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:45.579572 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a3ead-6cff-4241-a3c6-f67e3f180298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:45.580005 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a3ead-6cff-4241-a3c6-f67e3f180298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:45.580404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a3ead-6cff-4241-a3c6-f67e3f180298 admin admin] PATH_INFO: `/v3/projects/1be0d7c802ad4ca39b5a28bacdae2fc9` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:45.581900 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a3ead-6cff-4241-a3c6-f67e3f180298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be0d7c802ad4ca39b5a28bacdae2fc9)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:45.585510 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a3ead-6cff-4241-a3c6-f67e3f180298 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:45.606521 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbfbf3-6fd2-4cc7-81a2-d15fce1b850b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:45.607401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbfbf3-6fd2-4cc7-81a2-d15fce1b850b service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:45.607790 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbfbf3-6fd2-4cc7-81a2-d15fce1b850b service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:45.608139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbfbf3-6fd2-4cc7-81a2-d15fce1b850b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:45.610442 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-fdcbfbf3-6fd2-4cc7-81a2-d15fce1b850b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:45.663217 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-b63a3ead-6cff-4241-a3c6-f67e3f180298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be0d7c802ad4ca39b5a28bacdae2fc9', 'request_id': 'req-b63a3ead-6cff-4241-a3c6-f67e3f180298'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:45.670985 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-b63a3ead-6cff-4241-a3c6-f67e3f180298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be0d7c802ad4ca39b5a28bacdae2fc9', 'request_id': 'req-b63a3ead-6cff-4241-a3c6-f67e3f180298'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:45.677889 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-b63a3ead-6cff-4241-a3c6-f67e3f180298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be0d7c802ad4ca39b5a28bacdae2fc9', 'request_id': 'req-b63a3ead-6cff-4241-a3c6-f67e3f180298'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:45.687442 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcbfbf3-6fd2-4cc7-81a2-d15fce1b850b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:45.689859 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcbfbf3-6fd2-4cc7-81a2-d15fce1b850b service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:45.692462 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-b63a3ead-6cff-4241-a3c6-f67e3f180298 admin admin] The token cache is being invalidate because project 1be0d7c802ad4ca39b5a28bacdae2fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:45.692752 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-b63a3ead-6cff-4241-a3c6-f67e3f180298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:45.693397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-b63a3ead-6cff-4241-a3c6-f67e3f180298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:45.696411 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1122/2236] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:45 2022] DELETE /identity/v3/projects/1be0d7c802ad4ca39b5a28bacdae2fc9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:45.697156 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a3ead-6cff-4241-a3c6-f67e3f180298 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:45.698540 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-b63a3ead-6cff-4241-a3c6-f67e3f180298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:45.702247 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1115/2237] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:45.707906 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b173242-3f27-49eb-93c5-403a3999b1eb None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:45.708202 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b173242-3f27-49eb-93c5-403a3999b1eb None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:45.708531 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b173242-3f27-49eb-93c5-403a3999b1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:45.730871 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-4b173242-3f27-49eb-93c5-403a3999b1eb None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:45.732452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-4b173242-3f27-49eb-93c5-403a3999b1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:45.781843 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a3ead-6cff-4241-a3c6-f67e3f180298 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:45.786967 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e127a66-7578-4ed7-9d5a-6281a3a76da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:45.787737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e127a66-7578-4ed7-9d5a-6281a3a76da8 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:45.787921 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e127a66-7578-4ed7-9d5a-6281a3a76da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:45.788196 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e127a66-7578-4ed7-9d5a-6281a3a76da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:45.788967 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e127a66-7578-4ed7-9d5a-6281a3a76da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:45.791132 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e127a66-7578-4ed7-9d5a-6281a3a76da8 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:45.801687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1123/2238] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:45.810246 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1116/2239] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:45.810436 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e127a66-7578-4ed7-9d5a-6281a3a76da8 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:45.811789 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a5b0d-77ea-49bb-a70f-ee32c7d2e00d None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:45.812069 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a5b0d-77ea-49bb-a70f-ee32c7d2e00d None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:45.812339 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a5b0d-77ea-49bb-a70f-ee32c7d2e00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:45.822809 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e127a66-7578-4ed7-9d5a-6281a3a76da8 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:45.827688 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0753f-7f71-4fcf-9428-09ed7bec7e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:45.828275 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0753f-7f71-4fcf-9428-09ed7bec7e9e admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:45.828555 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0753f-7f71-4fcf-9428-09ed7bec7e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:45.828831 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0753f-7f71-4fcf-9428-09ed7bec7e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:45.829579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0753f-7f71-4fcf-9428-09ed7bec7e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:45.831198 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0753f-7f71-4fcf-9428-09ed7bec7e9e admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:45.837976 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-0a6a5b0d-77ea-49bb-a70f-ee32c7d2e00d None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:45.839272 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-0a6a5b0d-77ea-49bb-a70f-ee32c7d2e00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:45.843454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1124/2240] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:45.847498 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0753f-7f71-4fcf-9428-09ed7bec7e9e admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:45.850684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1117/2241] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:45.853330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a5b0d-77ea-49bb-a70f-ee32c7d2e00d None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:45.860234 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0753f-7f71-4fcf-9428-09ed7bec7e9e admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:45.864428 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a5b0d-77ea-49bb-a70f-ee32c7d2e00d None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:45.869187 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036e507-41ae-45b5-bb3d-14c2019032a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:45.870767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce327616-7978-4a74-a69f-49e999406c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:45.870896 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036e507-41ae-45b5-bb3d-14c2019032a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:45.870896 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036e507-41ae-45b5-bb3d-14c2019032a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:45.871355 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036e507-41ae-45b5-bb3d-14c2019032a2 admin admin] PATH_INFO: `/v3/projects/fc121f370346443b9a5d9c3c6c9788a1/users/22b8c19bcde943bcb309e7178daf224f/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:45.871499 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce327616-7978-4a74-a69f-49e999406c8b admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:45.871583 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce327616-7978-4a74-a69f-49e999406c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:45.871843 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce327616-7978-4a74-a69f-49e999406c8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:45.872584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce327616-7978-4a74-a69f-49e999406c8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:03:45.872887 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce327616-7978-4a74-a69f-49e999406c8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:45.874540 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce327616-7978-4a74-a69f-49e999406c8b admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:45.890329 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1118/2242] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:03:45.891979 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036e507-41ae-45b5-bb3d-14c2019032a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc121f370346443b9a5d9c3c6c9788a1, user_id=22b8c19bcde943bcb309e7178daf224f, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:45.892536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce327616-7978-4a74-a69f-49e999406c8b admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:45.894739 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036e507-41ae-45b5-bb3d-14c2019032a2 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:45.903099 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce327616-7978-4a74-a69f-49e999406c8b admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:45.910567 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1125/2243] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:45 2022] PUT /identity/v3/projects/fc121f370346443b9a5d9c3c6c9788a1/users/22b8c19bcde943bcb309e7178daf224f/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:45.922703 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901b8fd-2a33-4378-a73f-85d083d3bb71 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:45.923580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901b8fd-2a33-4378-a73f-85d083d3bb71 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:45.923580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901b8fd-2a33-4378-a73f-85d083d3bb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:45.960633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-5901b8fd-2a33-4378-a73f-85d083d3bb71 None None] MFA Rules not processed for user `22b8c19bcde943bcb309e7178daf224f`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:45.963963 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-5901b8fd-2a33-4378-a73f-85d083d3bb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:45.979554 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2922c-8ae8-4914-a91e-15bab92e4bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:45.980226 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2922c-8ae8-4914-a91e-15bab92e4bad admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:45.980510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2922c-8ae8-4914-a91e-15bab92e4bad admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:45.980785 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2922c-8ae8-4914-a91e-15bab92e4bad admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:45.982025 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2922c-8ae8-4914-a91e-15bab92e4bad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:45.983675 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2922c-8ae8-4914-a91e-15bab92e4bad admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:46.019390 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1119/2244] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:45 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:46.021409 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2922c-8ae8-4914-a91e-15bab92e4bad admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:46.061449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1126/2245] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:46.078402 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901b8fd-2a33-4378-a73f-85d083d3bb71 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:46.088809 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-5901b8fd-2a33-4378-a73f-85d083d3bb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:46.104711 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2922c-8ae8-4914-a91e-15bab92e4bad admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:46.111336 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf953bd-bf3a-4b1b-8c8c-6900c715209b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:46.112016 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf953bd-bf3a-4b1b-8c8c-6900c715209b admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:46.112294 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf953bd-bf3a-4b1b-8c8c-6900c715209b admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:46.112739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf953bd-bf3a-4b1b-8c8c-6900c715209b admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:46.113579 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf953bd-bf3a-4b1b-8c8c-6900c715209b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:46.116484 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf953bd-bf3a-4b1b-8c8c-6900c715209b admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:46.144825 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1120/2246] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:46 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:46.149320 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf953bd-bf3a-4b1b-8c8c-6900c715209b admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:46.153533 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901b8fd-2a33-4378-a73f-85d083d3bb71 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:46.162175 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf953bd-bf3a-4b1b-8c8c-6900c715209b admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:46.170947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3446ff8-394b-4fac-9b63-6cf00aecaafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:46.172215 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3446ff8-394b-4fac-9b63-6cf00aecaafb admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:46.172780 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3446ff8-394b-4fac-9b63-6cf00aecaafb admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:46.173231 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3446ff8-394b-4fac-9b63-6cf00aecaafb admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:46.174301 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3446ff8-394b-4fac-9b63-6cf00aecaafb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:46.175896 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3446ff8-394b-4fac-9b63-6cf00aecaafb admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:46.187489 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1121/2247] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:03:46.191208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3446ff8-394b-4fac-9b63-6cf00aecaafb admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:46.201172 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3446ff8-394b-4fac-9b63-6cf00aecaafb admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:46.208809 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612e64c-716c-43c1-97c1-503413851045 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:46.209401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612e64c-716c-43c1-97c1-503413851045 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:46.209762 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612e64c-716c-43c1-97c1-503413851045 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:46.210042 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612e64c-716c-43c1-97c1-503413851045 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:46.226004 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f17e5-7589-4989-afbd-3c0e81508915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:46.227764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f17e5-7589-4989-afbd-3c0e81508915 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:46.228053 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f17e5-7589-4989-afbd-3c0e81508915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:46.228739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f17e5-7589-4989-afbd-3c0e81508915 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:46.229070 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f17e5-7589-4989-afbd-3c0e81508915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:46.230961 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f17e5-7589-4989-afbd-3c0e81508915 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:46.242240 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1122/2248] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:03:46.246431 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f17e5-7589-4989-afbd-3c0e81508915 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:46.256082 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f17e5-7589-4989-afbd-3c0e81508915 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:46.262925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e4bb9-a9e6-46f2-9444-946faaafd0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:46.263912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e4bb9-a9e6-46f2-9444-946faaafd0c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:46.264429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e4bb9-a9e6-46f2-9444-946faaafd0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:46.264715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e4bb9-a9e6-46f2-9444-946faaafd0c1 admin admin] PATH_INFO: `/v3/projects/394a1538daf542719e52bb33b6eae420/users/dcae86e2f04b41b98b25835cecaca845/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:46.282379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e4bb9-a9e6-46f2-9444-946faaafd0c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=394a1538daf542719e52bb33b6eae420, user_id=dcae86e2f04b41b98b25835cecaca845, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:46.282589 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612e64c-716c-43c1-97c1-503413851045 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:46.284240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612e64c-716c-43c1-97c1-503413851045 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:46.286120 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e4bb9-a9e6-46f2-9444-946faaafd0c1 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:46.296535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1127/2249] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:46.305722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1123/2250] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:46 2022] PUT /identity/v3/projects/394a1538daf542719e52bb33b6eae420/users/dcae86e2f04b41b98b25835cecaca845/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:46.316301 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aba7c0-4dd6-48fb-9535-e8e833a9b061 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:46.316578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aba7c0-4dd6-48fb-9535-e8e833a9b061 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:46.316844 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aba7c0-4dd6-48fb-9535-e8e833a9b061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:46.328819 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e4bb9-a9e6-46f2-9444-946faaafd0c1 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:46.357810 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-f9aba7c0-4dd6-48fb-9535-e8e833a9b061 None None] MFA Rules not processed for user `dcae86e2f04b41b98b25835cecaca845`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:46.360496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f9aba7c0-4dd6-48fb-9535-e8e833a9b061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:46.450433 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1128/2251] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:46.463750 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aba7c0-4dd6-48fb-9535-e8e833a9b061 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:46.464310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e4bb9-a9e6-46f2-9444-946faaafd0c1 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:46.465347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f9aba7c0-4dd6-48fb-9535-e8e833a9b061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:46.472522 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6ff53-7ada-4eb2-a99a-bf83ac3547b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:46.473594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6ff53-7ada-4eb2-a99a-bf83ac3547b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:46.473879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6ff53-7ada-4eb2-a99a-bf83ac3547b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:46.476196 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6ff53-7ada-4eb2-a99a-bf83ac3547b3 admin admin] PATH_INFO: `/v3/users/22b8c19bcde943bcb309e7178daf224f` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:46.477127 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6ff53-7ada-4eb2-a99a-bf83ac3547b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22b8c19bcde943bcb309e7178daf224f)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:46.479258 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6ff53-7ada-4eb2-a99a-bf83ac3547b3 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:46.548667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0db6ff53-7ada-4eb2-a99a-bf83ac3547b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22b8c19bcde943bcb309e7178daf224f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:46.560674 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aba7c0-4dd6-48fb-9535-e8e833a9b061 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:46.563000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0db6ff53-7ada-4eb2-a99a-bf83ac3547b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22b8c19bcde943bcb309e7178daf224f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:46.569732 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcdcb7-8d20-45ea-938a-4ca77e4132c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:46.571011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcdcb7-8d20-45ea-938a-4ca77e4132c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:46.571299 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcdcb7-8d20-45ea-938a-4ca77e4132c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:46.571573 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcdcb7-8d20-45ea-938a-4ca77e4132c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:46.581689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcdcb7-8d20-45ea-938a-4ca77e4132c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:46.583241 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcdcb7-8d20-45ea-938a-4ca77e4132c3 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:46.584248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0db6ff53-7ada-4eb2-a99a-bf83ac3547b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22b8c19bcde943bcb309e7178daf224f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:46.586240 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0db6ff53-7ada-4eb2-a99a-bf83ac3547b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22b8c19bcde943bcb309e7178daf224f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:46.587451 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0db6ff53-7ada-4eb2-a99a-bf83ac3547b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22b8c19bcde943bcb309e7178daf224f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:46.594083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1129/2252] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:46.614472 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1124/2253] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:46 2022] DELETE /identity/v3/users/22b8c19bcde943bcb309e7178daf224f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:46.620052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d811bc2-a141-4c9a-bf05-ff56f5ba2a33 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:46.620145 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d811bc2-a141-4c9a-bf05-ff56f5ba2a33 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:46.620428 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d811bc2-a141-4c9a-bf05-ff56f5ba2a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:46.644075 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-6d811bc2-a141-4c9a-bf05-ff56f5ba2a33 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:46.645354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-6d811bc2-a141-4c9a-bf05-ff56f5ba2a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:46.728080 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1130/2254] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:46.746245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6ff53-7ada-4eb2-a99a-bf83ac3547b3 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:46.746245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-0db6ff53-7ada-4eb2-a99a-bf83ac3547b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:46.904002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6ff53-7ada-4eb2-a99a-bf83ac3547b3 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:46.908787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1a4ae-d87d-4f69-8506-1bfd7229503a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:46.909807 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1a4ae-d87d-4f69-8506-1bfd7229503a service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:46.910238 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1a4ae-d87d-4f69-8506-1bfd7229503a service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:46.910589 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1a4ae-d87d-4f69-8506-1bfd7229503a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:46.924598 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1a4ae-d87d-4f69-8506-1bfd7229503a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:46.925908 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1a4ae-d87d-4f69-8506-1bfd7229503a service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:46.949245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1125/2255] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:47.314163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d811bc2-a141-4c9a-bf05-ff56f5ba2a33 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:47.316274 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-6d811bc2-a141-4c9a-bf05-ff56f5ba2a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:47.368068 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1a4ae-d87d-4f69-8506-1bfd7229503a service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:47.370077 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-34e1a4ae-d87d-4f69-8506-1bfd7229503a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:47.389989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1a4ae-d87d-4f69-8506-1bfd7229503a service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:47.393626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d811bc2-a141-4c9a-bf05-ff56f5ba2a33 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:47.397840 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8b65b-66e1-45de-8d04-c54bfea44fae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:47.399517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8b65b-66e1-45de-8d04-c54bfea44fae service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:47.399845 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8b65b-66e1-45de-8d04-c54bfea44fae service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:47.400031 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8b65b-66e1-45de-8d04-c54bfea44fae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:47.402161 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-8cd8b65b-66e1-45de-8d04-c54bfea44fae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:47.407644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b1a00-8434-47d1-bc8f-61dcd4d0ba62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:47.409098 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b1a00-8434-47d1-bc8f-61dcd4d0ba62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:47.409440 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b1a00-8434-47d1-bc8f-61dcd4d0ba62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:47.409975 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b1a00-8434-47d1-bc8f-61dcd4d0ba62 admin admin] PATH_INFO: `/v3/projects/fc121f370346443b9a5d9c3c6c9788a1` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:47.411822 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b1a00-8434-47d1-bc8f-61dcd4d0ba62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc121f370346443b9a5d9c3c6c9788a1)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:47.414106 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b1a00-8434-47d1-bc8f-61dcd4d0ba62 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:47.497378 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-4b9b1a00-8434-47d1-bc8f-61dcd4d0ba62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc121f370346443b9a5d9c3c6c9788a1', 'request_id': 'req-4b9b1a00-8434-47d1-bc8f-61dcd4d0ba62'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:47.500370 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8b65b-66e1-45de-8d04-c54bfea44fae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:47.502263 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8b65b-66e1-45de-8d04-c54bfea44fae service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:47.503731 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-4b9b1a00-8434-47d1-bc8f-61dcd4d0ba62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc121f370346443b9a5d9c3c6c9788a1', 'request_id': 'req-4b9b1a00-8434-47d1-bc8f-61dcd4d0ba62'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:47.515168 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-4b9b1a00-8434-47d1-bc8f-61dcd4d0ba62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc121f370346443b9a5d9c3c6c9788a1', 'request_id': 'req-4b9b1a00-8434-47d1-bc8f-61dcd4d0ba62'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:47.515815 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1131/2256] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:47 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:47.544656 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-4b9b1a00-8434-47d1-bc8f-61dcd4d0ba62 admin admin] The token cache is being invalidate because project fc121f370346443b9a5d9c3c6c9788a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:47.544656 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-4b9b1a00-8434-47d1-bc8f-61dcd4d0ba62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:47.546908 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-4b9b1a00-8434-47d1-bc8f-61dcd4d0ba62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:47.548531 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1126/2257] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:47 2022] DELETE /identity/v3/projects/fc121f370346443b9a5d9c3c6c9788a1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:47.553569 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7217ca-15f1-4f37-bd57-2f28a8540a45 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:47.553938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7217ca-15f1-4f37-bd57-2f28a8540a45 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:47.554339 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7217ca-15f1-4f37-bd57-2f28a8540a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:47.574436 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-3b7217ca-15f1-4f37-bd57-2f28a8540a45 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:47.575727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-3b7217ca-15f1-4f37-bd57-2f28a8540a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:47.639338 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1132/2258] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:47.646945 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6970f-596b-4b8b-8873-cb05ee14edf5 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:47.647235 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6970f-596b-4b8b-8873-cb05ee14edf5 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:47.647513 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6970f-596b-4b8b-8873-cb05ee14edf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:47.667324 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-80a6970f-596b-4b8b-8873-cb05ee14edf5 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:47.668568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-80a6970f-596b-4b8b-8873-cb05ee14edf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:47.677215 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1127/2259] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:47.682562 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7217ca-15f1-4f37-bd57-2f28a8540a45 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:47.692429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7217ca-15f1-4f37-bd57-2f28a8540a45 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:47.698646 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f33c82-dae1-419c-a993-22abcd7bc31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:47.699775 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f33c82-dae1-419c-a993-22abcd7bc31d admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:47.700008 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f33c82-dae1-419c-a993-22abcd7bc31d admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:47.700260 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f33c82-dae1-419c-a993-22abcd7bc31d admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:47.701082 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f33c82-dae1-419c-a993-22abcd7bc31d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:03:47.701387 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f33c82-dae1-419c-a993-22abcd7bc31d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:47.705266 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f33c82-dae1-419c-a993-22abcd7bc31d admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:47.722397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1133/2260] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:03:47.723566 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6970f-596b-4b8b-8873-cb05ee14edf5 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:47.739614 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6970f-596b-4b8b-8873-cb05ee14edf5 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:47.751345 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73a906-ed25-4b09-8c89-660ac48b8917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:47.752099 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73a906-ed25-4b09-8c89-660ac48b8917 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:47.752389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73a906-ed25-4b09-8c89-660ac48b8917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:47.752664 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73a906-ed25-4b09-8c89-660ac48b8917 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:47.753360 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73a906-ed25-4b09-8c89-660ac48b8917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:47.755446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73a906-ed25-4b09-8c89-660ac48b8917 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:47.787558 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1128/2261] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:47 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:47.792084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f33c82-dae1-419c-a993-22abcd7bc31d admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:47.803434 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f33c82-dae1-419c-a993-22abcd7bc31d admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:47.859777 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743cbfc-76fd-4d40-8dc9-1419ce5cf7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:47.860451 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743cbfc-76fd-4d40-8dc9-1419ce5cf7aa admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:47.860758 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743cbfc-76fd-4d40-8dc9-1419ce5cf7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:47.861034 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743cbfc-76fd-4d40-8dc9-1419ce5cf7aa admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:47.861717 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743cbfc-76fd-4d40-8dc9-1419ce5cf7aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:47.863751 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743cbfc-76fd-4d40-8dc9-1419ce5cf7aa admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:47.884137 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1134/2262] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:47 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:47.888187 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73a906-ed25-4b09-8c89-660ac48b8917 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:47.898161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73a906-ed25-4b09-8c89-660ac48b8917 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:47.903426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2054a-6253-464b-8f6f-5c0cbebf9147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:47.904071 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2054a-6253-464b-8f6f-5c0cbebf9147 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:47.904350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2054a-6253-464b-8f6f-5c0cbebf9147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:47.904622 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2054a-6253-464b-8f6f-5c0cbebf9147 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:47.905346 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c2054a-6253-464b-8f6f-5c0cbebf9147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:47.907298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c2054a-6253-464b-8f6f-5c0cbebf9147 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:47.917512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1129/2263] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:47.921243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743cbfc-76fd-4d40-8dc9-1419ce5cf7aa admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:47.931252 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743cbfc-76fd-4d40-8dc9-1419ce5cf7aa admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:47.935937 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccefbb-bbcf-417d-9f79-a3a0878f8a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:47.936538 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccefbb-bbcf-417d-9f79-a3a0878f8a12 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:47.936821 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccefbb-bbcf-417d-9f79-a3a0878f8a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:47.937092 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccefbb-bbcf-417d-9f79-a3a0878f8a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:47.937845 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccefbb-bbcf-417d-9f79-a3a0878f8a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:47.939463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccefbb-bbcf-417d-9f79-a3a0878f8a12 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:47.951679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1135/2264] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:47.955737 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2054a-6253-464b-8f6f-5c0cbebf9147 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:47.966086 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2054a-6253-464b-8f6f-5c0cbebf9147 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:47.970667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a5c66-739c-4bdb-bb1a-d987fdf763df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:47.971550 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a5c66-739c-4bdb-bb1a-d987fdf763df admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:47.971813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a5c66-739c-4bdb-bb1a-d987fdf763df admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:47.972088 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a5c66-739c-4bdb-bb1a-d987fdf763df admin admin] PATH_INFO: `/v3/projects/f7151edbac0840dd801f21d540b05126/users/be7c03d9578b4f0780299706f5405532/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:47.987480 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a5c66-739c-4bdb-bb1a-d987fdf763df admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7151edbac0840dd801f21d540b05126, user_id=be7c03d9578b4f0780299706f5405532, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:47.990140 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a5c66-739c-4bdb-bb1a-d987fdf763df admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:48.002966 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1130/2265] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:47 2022] PUT /identity/v3/projects/f7151edbac0840dd801f21d540b05126/users/be7c03d9578b4f0780299706f5405532/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:48.014692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b21c16-7af3-4c9f-8b97-f04d3895169e None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:48.015012 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b21c16-7af3-4c9f-8b97-f04d3895169e None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:48.015289 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b21c16-7af3-4c9f-8b97-f04d3895169e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:48.041796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-35b21c16-7af3-4c9f-8b97-f04d3895169e None None] MFA Rules not processed for user `be7c03d9578b4f0780299706f5405532`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:48.043036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-35b21c16-7af3-4c9f-8b97-f04d3895169e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:48.111148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1136/2266] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:48.121913 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a5c66-739c-4bdb-bb1a-d987fdf763df admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:48.123621 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-917a5c66-739c-4bdb-bb1a-d987fdf763df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:48.194590 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a5c66-739c-4bdb-bb1a-d987fdf763df admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:48.202435 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c979cfa-6048-478b-a216-6ebd2efaf46e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:48.205728 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c979cfa-6048-478b-a216-6ebd2efaf46e service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:48.205728 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c979cfa-6048-478b-a216-6ebd2efaf46e service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:48.205728 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c979cfa-6048-478b-a216-6ebd2efaf46e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:48.215429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c979cfa-6048-478b-a216-6ebd2efaf46e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:48.218609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c979cfa-6048-478b-a216-6ebd2efaf46e service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:48.232392 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1131/2267] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:49.583540 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19adb5e-d8c7-4440-8af9-dacabdda9bae None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:49.584094 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19adb5e-d8c7-4440-8af9-dacabdda9bae None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:49.584215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19adb5e-d8c7-4440-8af9-dacabdda9bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:49.603213 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-f19adb5e-d8c7-4440-8af9-dacabdda9bae None None] MFA Rules not processed for user `be7c03d9578b4f0780299706f5405532`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:49.609295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f19adb5e-d8c7-4440-8af9-dacabdda9bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:49.618641 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1137/2268] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:50.349692 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c979cfa-6048-478b-a216-6ebd2efaf46e service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:50.351890 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-0c979cfa-6048-478b-a216-6ebd2efaf46e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:50.427017 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c979cfa-6048-478b-a216-6ebd2efaf46e service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:50.432910 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ba165-5060-4b19-9e12-7847208675fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:50.433785 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ba165-5060-4b19-9e12-7847208675fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:50.434069 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ba165-5060-4b19-9e12-7847208675fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:50.434389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ba165-5060-4b19-9e12-7847208675fe admin admin] PATH_INFO: `/v3/users/dcae86e2f04b41b98b25835cecaca845` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:50.435707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ba165-5060-4b19-9e12-7847208675fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcae86e2f04b41b98b25835cecaca845)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:50.437878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ba165-5060-4b19-9e12-7847208675fe admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:50.488473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-4a5ba165-5060-4b19-9e12-7847208675fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcae86e2f04b41b98b25835cecaca845'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:50.498464 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-4a5ba165-5060-4b19-9e12-7847208675fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcae86e2f04b41b98b25835cecaca845'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:50.511293 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-4a5ba165-5060-4b19-9e12-7847208675fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcae86e2f04b41b98b25835cecaca845'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:50.511872 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-4a5ba165-5060-4b19-9e12-7847208675fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcae86e2f04b41b98b25835cecaca845'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:50.512455 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-4a5ba165-5060-4b19-9e12-7847208675fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcae86e2f04b41b98b25835cecaca845'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:50.525083 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1132/2269] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:50 2022] DELETE /identity/v3/users/dcae86e2f04b41b98b25835cecaca845 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:50.529615 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6644b0-84ba-43fe-86ef-f45cf2e43d4a None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:50.529908 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6644b0-84ba-43fe-86ef-f45cf2e43d4a None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:50.530187 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6644b0-84ba-43fe-86ef-f45cf2e43d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:50.548392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-1f6644b0-84ba-43fe-86ef-f45cf2e43d4a None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:50.549603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-1f6644b0-84ba-43fe-86ef-f45cf2e43d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:50.609607 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1138/2270] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:50.621928 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ba165-5060-4b19-9e12-7847208675fe admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:50.623567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-4a5ba165-5060-4b19-9e12-7847208675fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:50.688946 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ba165-5060-4b19-9e12-7847208675fe admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:50.693001 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765afd3-6d08-4007-8378-dced7f5dd081 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:50.693666 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765afd3-6d08-4007-8378-dced7f5dd081 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:50.693981 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765afd3-6d08-4007-8378-dced7f5dd081 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:50.694302 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765afd3-6d08-4007-8378-dced7f5dd081 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:50.704297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765afd3-6d08-4007-8378-dced7f5dd081 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:50.705742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765afd3-6d08-4007-8378-dced7f5dd081 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:50.717847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1133/2271] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:03:51.036036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6644b0-84ba-43fe-86ef-f45cf2e43d4a None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:51.037452 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-1f6644b0-84ba-43fe-86ef-f45cf2e43d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:51.061724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6644b0-84ba-43fe-86ef-f45cf2e43d4a None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:51.068341 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f9c51-6a8c-439a-8413-4ab6511e6db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:51.069194 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f9c51-6a8c-439a-8413-4ab6511e6db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:51.069923 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f9c51-6a8c-439a-8413-4ab6511e6db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:51.070863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f9c51-6a8c-439a-8413-4ab6511e6db0 admin admin] PATH_INFO: `/v3/projects/394a1538daf542719e52bb33b6eae420` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:51.074860 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f9c51-6a8c-439a-8413-4ab6511e6db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=394a1538daf542719e52bb33b6eae420)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:51.077061 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f9c51-6a8c-439a-8413-4ab6511e6db0 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:51.101169 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765afd3-6d08-4007-8378-dced7f5dd081 service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:51.110122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-3765afd3-6d08-4007-8378-dced7f5dd081 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:51.120661 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765afd3-6d08-4007-8378-dced7f5dd081 service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:51.134884 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-552f9c51-6a8c-439a-8413-4ab6511e6db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '394a1538daf542719e52bb33b6eae420', 'request_id': 'req-552f9c51-6a8c-439a-8413-4ab6511e6db0'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:51.142165 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-552f9c51-6a8c-439a-8413-4ab6511e6db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '394a1538daf542719e52bb33b6eae420', 'request_id': 'req-552f9c51-6a8c-439a-8413-4ab6511e6db0'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:51.150977 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-552f9c51-6a8c-439a-8413-4ab6511e6db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '394a1538daf542719e52bb33b6eae420', 'request_id': 'req-552f9c51-6a8c-439a-8413-4ab6511e6db0'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:51.168266 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-552f9c51-6a8c-439a-8413-4ab6511e6db0 admin admin] The token cache is being invalidate because project 394a1538daf542719e52bb33b6eae420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:51.168760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-552f9c51-6a8c-439a-8413-4ab6511e6db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:51.170672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-552f9c51-6a8c-439a-8413-4ab6511e6db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:51.173413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1139/2272] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:51 2022] DELETE /identity/v3/projects/394a1538daf542719e52bb33b6eae420 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:51.185205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed3c98-b927-4511-a07e-acd3db92ae13 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:51.185600 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed3c98-b927-4511-a07e-acd3db92ae13 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:51.185822 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed3c98-b927-4511-a07e-acd3db92ae13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:51.209193 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-20ed3c98-b927-4511-a07e-acd3db92ae13 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:51.210885 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-20ed3c98-b927-4511-a07e-acd3db92ae13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:51.231625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ab108-54b3-45d8-bba8-fa20fe601723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:51.232515 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ab108-54b3-45d8-bba8-fa20fe601723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:51.232794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ab108-54b3-45d8-bba8-fa20fe601723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:51.233063 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ab108-54b3-45d8-bba8-fa20fe601723 admin admin] PATH_INFO: `/v3/users/cc963bc87b34479a8bd76f3e6a9ba208` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:51.238374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ab108-54b3-45d8-bba8-fa20fe601723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc963bc87b34479a8bd76f3e6a9ba208)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:51.240317 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ab108-54b3-45d8-bba8-fa20fe601723 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:51.339322 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1140/2273] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:51.347547 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895d906-3385-419a-a0c7-19c6bef097c8 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:51.347796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895d906-3385-419a-a0c7-19c6bef097c8 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:51.348527 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895d906-3385-419a-a0c7-19c6bef097c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:51.365981 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-3a5ab108-54b3-45d8-bba8-fa20fe601723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc963bc87b34479a8bd76f3e6a9ba208'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:51.380234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-3a5ab108-54b3-45d8-bba8-fa20fe601723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc963bc87b34479a8bd76f3e6a9ba208'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:51.382077 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-e895d906-3385-419a-a0c7-19c6bef097c8 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:51.384569 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-e895d906-3385-419a-a0c7-19c6bef097c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:51.393763 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1141/2274] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:51.396509 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-3a5ab108-54b3-45d8-bba8-fa20fe601723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc963bc87b34479a8bd76f3e6a9ba208'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:51.398159 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895d906-3385-419a-a0c7-19c6bef097c8 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:51.400745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-3a5ab108-54b3-45d8-bba8-fa20fe601723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc963bc87b34479a8bd76f3e6a9ba208'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:51.402488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-3a5ab108-54b3-45d8-bba8-fa20fe601723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc963bc87b34479a8bd76f3e6a9ba208'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:51.419336 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895d906-3385-419a-a0c7-19c6bef097c8 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:51.432108 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59a1fc-4a7c-4740-a997-cda57c6a6d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:51.432793 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59a1fc-4a7c-4740-a997-cda57c6a6d62 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:51.435735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1134/2275] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:51 2022] DELETE /identity/v3/users/cc963bc87b34479a8bd76f3e6a9ba208 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:51.435865 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59a1fc-4a7c-4740-a997-cda57c6a6d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:51.435865 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59a1fc-4a7c-4740-a997-cda57c6a6d62 admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:51.435865 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59a1fc-4a7c-4740-a997-cda57c6a6d62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:03:51.435865 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59a1fc-4a7c-4740-a997-cda57c6a6d62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:51.438165 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8145f-589f-46f3-be47-051a740931cc None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:51.438165 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8145f-589f-46f3-be47-051a740931cc None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:51.438165 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8145f-589f-46f3-be47-051a740931cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:51.441209 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59a1fc-4a7c-4740-a997-cda57c6a6d62 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:51.457915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1142/2276] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:03:51.463710 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59a1fc-4a7c-4740-a997-cda57c6a6d62 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:51.466707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-a3c8145f-589f-46f3-be47-051a740931cc None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:51.469887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-9f59a1fc-4a7c-4740-a997-cda57c6a6d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:51.476127 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a3c8145f-589f-46f3-be47-051a740931cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:51.486673 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59a1fc-4a7c-4740-a997-cda57c6a6d62 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:51.554728 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1135/2277] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:51.562037 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8145f-589f-46f3-be47-051a740931cc None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:51.563560 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a3c8145f-589f-46f3-be47-051a740931cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:51.569764 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8251ca-6786-4b59-aa4c-f7c8f04d0195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:51.570604 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8251ca-6786-4b59-aa4c-f7c8f04d0195 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:51.570604 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8251ca-6786-4b59-aa4c-f7c8f04d0195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:51.571189 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8251ca-6786-4b59-aa4c-f7c8f04d0195 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:51.571759 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8251ca-6786-4b59-aa4c-f7c8f04d0195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:51.573860 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8251ca-6786-4b59-aa4c-f7c8f04d0195 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:51.603665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1143/2278] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:51 2022] POST /identity/v3/projects => generated 397 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:51.604950 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8251ca-6786-4b59-aa4c-f7c8f04d0195 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:51.628323 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8145f-589f-46f3-be47-051a740931cc None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:51.675781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8251ca-6786-4b59-aa4c-f7c8f04d0195 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:51.684110 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e20b4-3b08-43f6-975b-841ca1b98107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:51.685420 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e20b4-3b08-43f6-975b-841ca1b98107 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:51.685851 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e20b4-3b08-43f6-975b-841ca1b98107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:51.686129 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e20b4-3b08-43f6-975b-841ca1b98107 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:51.687076 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e20b4-3b08-43f6-975b-841ca1b98107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:51.690258 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e20b4-3b08-43f6-975b-841ca1b98107 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:51.693220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e91f6-864f-4b19-b21b-18595394af9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:51.693877 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e91f6-864f-4b19-b21b-18595394af9d service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:51.694162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e91f6-864f-4b19-b21b-18595394af9d service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:51.694469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e91f6-864f-4b19-b21b-18595394af9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:51.708923 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e91f6-864f-4b19-b21b-18595394af9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:51.710558 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e91f6-864f-4b19-b21b-18595394af9d service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:51.717437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1144/2279] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:51 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:51.721542 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e20b4-3b08-43f6-975b-841ca1b98107 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:51.722415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1136/2280] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:03:51.732383 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e20b4-3b08-43f6-975b-841ca1b98107 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:51.737317 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756691c-62bd-41e3-b4c9-30fcddd99719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:51.738094 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756691c-62bd-41e3-b4c9-30fcddd99719 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:51.738486 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756691c-62bd-41e3-b4c9-30fcddd99719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:51.738846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756691c-62bd-41e3-b4c9-30fcddd99719 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:51.739640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756691c-62bd-41e3-b4c9-30fcddd99719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:51.741309 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756691c-62bd-41e3-b4c9-30fcddd99719 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:51.753303 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1145/2281] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:03:51.757410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e91f6-864f-4b19-b21b-18595394af9d service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:51.767517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e91f6-864f-4b19-b21b-18595394af9d service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:51.772373 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05514542-6fef-4b1c-af4f-f85e487314e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:51.773027 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05514542-6fef-4b1c-af4f-f85e487314e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:51.773337 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05514542-6fef-4b1c-af4f-f85e487314e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:51.773622 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05514542-6fef-4b1c-af4f-f85e487314e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:51.774595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05514542-6fef-4b1c-af4f-f85e487314e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:51.776107 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05514542-6fef-4b1c-af4f-f85e487314e6 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:51.787134 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1137/2282] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:51.792213 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756691c-62bd-41e3-b4c9-30fcddd99719 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:51.802497 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756691c-62bd-41e3-b4c9-30fcddd99719 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:51.808293 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f46ee-6cb6-4a04-bd12-13c1ed1f037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:51.809205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f46ee-6cb6-4a04-bd12-13c1ed1f037a admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:51.809540 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f46ee-6cb6-4a04-bd12-13c1ed1f037a admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:51.809820 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f46ee-6cb6-4a04-bd12-13c1ed1f037a admin admin] PATH_INFO: `/v3/projects/268d118b8ac749cc9d6a3a085eacbbbb/users/861677c0d08e43b2a71b2ba8e86fa04e/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:51.840373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f46ee-6cb6-4a04-bd12-13c1ed1f037a admin admin] RBAC: Authorizing `identity:create_grant(project_id=268d118b8ac749cc9d6a3a085eacbbbb, user_id=861677c0d08e43b2a71b2ba8e86fa04e, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:51.843357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f46ee-6cb6-4a04-bd12-13c1ed1f037a admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:51.864096 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1146/2283] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:51 2022] PUT /identity/v3/projects/268d118b8ac749cc9d6a3a085eacbbbb/users/861677c0d08e43b2a71b2ba8e86fa04e/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:51.876560 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ebee1-909c-4d5f-b35c-e2311d2a8c39 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:51.876882 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ebee1-909c-4d5f-b35c-e2311d2a8c39 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:51.877126 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ebee1-909c-4d5f-b35c-e2311d2a8c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:51.906292 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-2b7ebee1-909c-4d5f-b35c-e2311d2a8c39 None None] MFA Rules not processed for user `861677c0d08e43b2a71b2ba8e86fa04e`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:51.907542 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-2b7ebee1-909c-4d5f-b35c-e2311d2a8c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:51.986921 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1138/2284] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:52.000095 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f46ee-6cb6-4a04-bd12-13c1ed1f037a admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:52.002236 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-7a2f46ee-6cb6-4a04-bd12-13c1ed1f037a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:52.106739 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f46ee-6cb6-4a04-bd12-13c1ed1f037a admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:52.136633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc60fab-a212-42e5-9073-4f74bbf2c4fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:52.137885 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc60fab-a212-42e5-9073-4f74bbf2c4fc service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:52.137885 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc60fab-a212-42e5-9073-4f74bbf2c4fc service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:52.137885 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc60fab-a212-42e5-9073-4f74bbf2c4fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:52.160867 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc60fab-a212-42e5-9073-4f74bbf2c4fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:52.162361 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc60fab-a212-42e5-9073-4f74bbf2c4fc service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:52.180656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1147/2285] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:52.185657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ebee1-909c-4d5f-b35c-e2311d2a8c39 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:52.187142 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-2b7ebee1-909c-4d5f-b35c-e2311d2a8c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:52.306020 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ebee1-909c-4d5f-b35c-e2311d2a8c39 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:52.312023 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b721cf-988d-4331-abf8-eb320f492285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:52.318708 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b721cf-988d-4331-abf8-eb320f492285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:52.319378 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b721cf-988d-4331-abf8-eb320f492285 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:52.322173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b721cf-988d-4331-abf8-eb320f492285 admin admin] PATH_INFO: `/v3/projects/99a2df78f43c4dd4a9df29a301180ef8` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:52.323966 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b721cf-988d-4331-abf8-eb320f492285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99a2df78f43c4dd4a9df29a301180ef8)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:52.326671 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b721cf-988d-4331-abf8-eb320f492285 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:52.394113 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e0b721cf-988d-4331-abf8-eb320f492285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99a2df78f43c4dd4a9df29a301180ef8', 'request_id': 'req-e0b721cf-988d-4331-abf8-eb320f492285'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:52.400375 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e0b721cf-988d-4331-abf8-eb320f492285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99a2df78f43c4dd4a9df29a301180ef8', 'request_id': 'req-e0b721cf-988d-4331-abf8-eb320f492285'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:52.411447 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e0b721cf-988d-4331-abf8-eb320f492285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99a2df78f43c4dd4a9df29a301180ef8', 'request_id': 'req-e0b721cf-988d-4331-abf8-eb320f492285'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:52.432421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e0b721cf-988d-4331-abf8-eb320f492285 admin admin] The token cache is being invalidate because project 99a2df78f43c4dd4a9df29a301180ef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:52.432873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e0b721cf-988d-4331-abf8-eb320f492285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:52.433825 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e0b721cf-988d-4331-abf8-eb320f492285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:52.435995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1139/2286] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:52 2022] DELETE /identity/v3/projects/99a2df78f43c4dd4a9df29a301180ef8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:52.440335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc60fab-a212-42e5-9073-4f74bbf2c4fc service cinder] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:52.458730 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc60fab-a212-42e5-9073-4f74bbf2c4fc service cinder] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:52.588023 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c92284-8349-427c-a1a1-2a90028edb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:52.589211 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c92284-8349-427c-a1a1-2a90028edb97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:52.589645 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c92284-8349-427c-a1a1-2a90028edb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:52.590143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c92284-8349-427c-a1a1-2a90028edb97 admin admin] PATH_INFO: `/v3/users/895ba26f628846979b51ec5157adc3bf` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:52.591710 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c92284-8349-427c-a1a1-2a90028edb97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=895ba26f628846979b51ec5157adc3bf)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:52.594713 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c92284-8349-427c-a1a1-2a90028edb97 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:52.751928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-50c92284-8349-427c-a1a1-2a90028edb97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '895ba26f628846979b51ec5157adc3bf'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:52.754863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-50c92284-8349-427c-a1a1-2a90028edb97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '895ba26f628846979b51ec5157adc3bf'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:52.774280 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-50c92284-8349-427c-a1a1-2a90028edb97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '895ba26f628846979b51ec5157adc3bf'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:52.795786 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-50c92284-8349-427c-a1a1-2a90028edb97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '895ba26f628846979b51ec5157adc3bf'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:52.823602 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-50c92284-8349-427c-a1a1-2a90028edb97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '895ba26f628846979b51ec5157adc3bf'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:52.841658 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1148/2287] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:52 2022] DELETE /identity/v3/users/895ba26f628846979b51ec5157adc3bf => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:53.240259 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b721cf-988d-4331-abf8-eb320f492285 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:53.241830 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-e0b721cf-988d-4331-abf8-eb320f492285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:53.256658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b721cf-988d-4331-abf8-eb320f492285 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:53.310728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c92284-8349-427c-a1a1-2a90028edb97 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:53.312178 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-50c92284-8349-427c-a1a1-2a90028edb97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:53.346182 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b7507-85b5-4f38-b2de-a1e5aaab7aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:53.347493 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b7507-85b5-4f38-b2de-a1e5aaab7aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:53.347840 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b7507-85b5-4f38-b2de-a1e5aaab7aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:53.348177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b7507-85b5-4f38-b2de-a1e5aaab7aba admin admin] PATH_INFO: `/v3/users/25c46273f24c40a8996a6da129fb8bd7` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:53.349442 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b7507-85b5-4f38-b2de-a1e5aaab7aba admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c46273f24c40a8996a6da129fb8bd7)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:53.351790 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b7507-85b5-4f38-b2de-a1e5aaab7aba admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:53.400456 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c92284-8349-427c-a1a1-2a90028edb97 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:53.405001 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-573b7507-85b5-4f38-b2de-a1e5aaab7aba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c46273f24c40a8996a6da129fb8bd7'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:53.409291 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2d30c-efba-4ec7-b893-d6224a3a99e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:53.410487 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2d30c-efba-4ec7-b893-d6224a3a99e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:53.410842 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2d30c-efba-4ec7-b893-d6224a3a99e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:53.411958 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2d30c-efba-4ec7-b893-d6224a3a99e7 admin admin] PATH_INFO: `/v3/projects/e68feaf42f9a49c2bb86369fbca44217` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:53.413536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2d30c-efba-4ec7-b893-d6224a3a99e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e68feaf42f9a49c2bb86369fbca44217)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:53.415999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-573b7507-85b5-4f38-b2de-a1e5aaab7aba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c46273f24c40a8996a6da129fb8bd7'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:53.416954 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2d30c-efba-4ec7-b893-d6224a3a99e7 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:53.430844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-573b7507-85b5-4f38-b2de-a1e5aaab7aba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c46273f24c40a8996a6da129fb8bd7'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:53.432303 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-573b7507-85b5-4f38-b2de-a1e5aaab7aba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c46273f24c40a8996a6da129fb8bd7'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:53.434689 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-573b7507-85b5-4f38-b2de-a1e5aaab7aba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c46273f24c40a8996a6da129fb8bd7'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:53.452886 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1140/2288] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:03:53 2022] DELETE /identity/v3/users/25c46273f24c40a8996a6da129fb8bd7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:53.457438 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632b288-2a55-4f4a-8825-2abc9db6b8a3 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:53.457816 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632b288-2a55-4f4a-8825-2abc9db6b8a3 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:53.458178 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632b288-2a55-4f4a-8825-2abc9db6b8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:53.476236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-c632b288-2a55-4f4a-8825-2abc9db6b8a3 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:53.477780 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-88a2d30c-efba-4ec7-b893-d6224a3a99e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e68feaf42f9a49c2bb86369fbca44217', 'request_id': 'req-88a2d30c-efba-4ec7-b893-d6224a3a99e7'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:53.477910 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-c632b288-2a55-4f4a-8825-2abc9db6b8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:53.483205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-88a2d30c-efba-4ec7-b893-d6224a3a99e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e68feaf42f9a49c2bb86369fbca44217', 'request_id': 'req-88a2d30c-efba-4ec7-b893-d6224a3a99e7'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:53.489873 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-88a2d30c-efba-4ec7-b893-d6224a3a99e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e68feaf42f9a49c2bb86369fbca44217', 'request_id': 'req-88a2d30c-efba-4ec7-b893-d6224a3a99e7'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:53.504980 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-88a2d30c-efba-4ec7-b893-d6224a3a99e7 admin admin] The token cache is being invalidate because project e68feaf42f9a49c2bb86369fbca44217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:53.505691 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-88a2d30c-efba-4ec7-b893-d6224a3a99e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:53.506130 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-88a2d30c-efba-4ec7-b893-d6224a3a99e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:53.508134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1149/2289] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:53 2022] DELETE /identity/v3/projects/e68feaf42f9a49c2bb86369fbca44217 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:53.513768 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7b9ff-88e8-44e8-86b5-6c8b5fdbd7c5 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:53.514339 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7b9ff-88e8-44e8-86b5-6c8b5fdbd7c5 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:53.514708 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7b9ff-88e8-44e8-86b5-6c8b5fdbd7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:53.535843 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-22f7b9ff-88e8-44e8-86b5-6c8b5fdbd7c5 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:53.537268 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-22f7b9ff-88e8-44e8-86b5-6c8b5fdbd7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:53.542172 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1141/2290] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:53.546706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1150/2291] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:53.555323 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7b9ff-88e8-44e8-86b5-6c8b5fdbd7c5 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:53.555562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc64b2-25bb-48cf-ac59-459f41cc0d69 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:53.556046 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc64b2-25bb-48cf-ac59-459f41cc0d69 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:53.556337 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc64b2-25bb-48cf-ac59-459f41cc0d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:53.556714 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-22f7b9ff-88e8-44e8-86b5-6c8b5fdbd7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:53.575666 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-10bc64b2-25bb-48cf-ac59-459f41cc0d69 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:53.576787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-10bc64b2-25bb-48cf-ac59-459f41cc0d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:53.587781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1142/2292] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:53.592175 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc64b2-25bb-48cf-ac59-459f41cc0d69 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:53.602948 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc64b2-25bb-48cf-ac59-459f41cc0d69 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:53.607974 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab87e8-c043-4061-a515-078bd3a52886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:53.608942 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab87e8-c043-4061-a515-078bd3a52886 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:53.609463 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab87e8-c043-4061-a515-078bd3a52886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:53.609843 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab87e8-c043-4061-a515-078bd3a52886 admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:53.610844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab87e8-c043-4061-a515-078bd3a52886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:03:53.611269 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab87e8-c043-4061-a515-078bd3a52886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:53.613208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab87e8-c043-4061-a515-078bd3a52886 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:53.624509 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7b9ff-88e8-44e8-86b5-6c8b5fdbd7c5 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:53.627572 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1143/2293] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:03:53.631609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab87e8-c043-4061-a515-078bd3a52886 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:53.632120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c52e6-83f6-42f8-a49d-3e0662051672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:53.632977 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c52e6-83f6-42f8-a49d-3e0662051672 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:53.633248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c52e6-83f6-42f8-a49d-3e0662051672 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:53.633520 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c52e6-83f6-42f8-a49d-3e0662051672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:53.642607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab87e8-c043-4061-a515-078bd3a52886 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:53.645471 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c52e6-83f6-42f8-a49d-3e0662051672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:53.647009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c52e6-83f6-42f8-a49d-3e0662051672 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:53.650420 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afd203-9586-4c46-94dc-97b76c74f62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:53.651526 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afd203-9586-4c46-94dc-97b76c74f62c admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:53.651970 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afd203-9586-4c46-94dc-97b76c74f62c admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:53.652433 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afd203-9586-4c46-94dc-97b76c74f62c admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:53.654784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afd203-9586-4c46-94dc-97b76c74f62c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:53.658602 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1151/2294] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:03:53.660251 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afd203-9586-4c46-94dc-97b76c74f62c admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:53.703362 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1144/2295] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:53 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:53.704659 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c52e6-83f6-42f8-a49d-3e0662051672 service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:53.716359 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c52e6-83f6-42f8-a49d-3e0662051672 service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:53.793586 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91649460-196a-4291-bd6d-62ccc9fead9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:53.794677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91649460-196a-4291-bd6d-62ccc9fead9e admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:53.795223 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91649460-196a-4291-bd6d-62ccc9fead9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:53.795719 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91649460-196a-4291-bd6d-62ccc9fead9e admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:53.796523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91649460-196a-4291-bd6d-62ccc9fead9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:53.798592 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91649460-196a-4291-bd6d-62ccc9fead9e admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:53.828649 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1152/2296] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:53 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:53.838814 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afd203-9586-4c46-94dc-97b76c74f62c admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:53.861667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afd203-9586-4c46-94dc-97b76c74f62c admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:53.872341 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39769a73-8e00-412c-9417-830d135110fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:53.873688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39769a73-8e00-412c-9417-830d135110fa admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:53.874121 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39769a73-8e00-412c-9417-830d135110fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:53.874759 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39769a73-8e00-412c-9417-830d135110fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:53.875942 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39769a73-8e00-412c-9417-830d135110fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:53.878185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39769a73-8e00-412c-9417-830d135110fa admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:53.891511 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1145/2297] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:53.895614 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91649460-196a-4291-bd6d-62ccc9fead9e admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:53.912777 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91649460-196a-4291-bd6d-62ccc9fead9e admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:53.931863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ea609-e17a-4879-a1ca-498868d905d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:53.933204 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ea609-e17a-4879-a1ca-498868d905d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:53.933699 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ea609-e17a-4879-a1ca-498868d905d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:53.934391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ea609-e17a-4879-a1ca-498868d905d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:53.935870 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ea609-e17a-4879-a1ca-498868d905d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:53.937893 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ea609-e17a-4879-a1ca-498868d905d6 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:53.956873 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1153/2298] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:03:53.961875 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39769a73-8e00-412c-9417-830d135110fa admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:53.972713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39769a73-8e00-412c-9417-830d135110fa admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:53.980091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ef1c1-b538-4ff8-955f-1e1b9e502525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:53.981319 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ef1c1-b538-4ff8-955f-1e1b9e502525 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:53.982326 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ef1c1-b538-4ff8-955f-1e1b9e502525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:53.982895 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ef1c1-b538-4ff8-955f-1e1b9e502525 admin admin] PATH_INFO: `/v3/projects/74e8426a3b2648519584d93fc1d80420/users/fee99d1e68e24ed9b87ed8b8bab48077/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:54.002866 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ef1c1-b538-4ff8-955f-1e1b9e502525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74e8426a3b2648519584d93fc1d80420, user_id=fee99d1e68e24ed9b87ed8b8bab48077, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:54.005841 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ef1c1-b538-4ff8-955f-1e1b9e502525 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:54.029246 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1146/2299] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:53 2022] PUT /identity/v3/projects/74e8426a3b2648519584d93fc1d80420/users/fee99d1e68e24ed9b87ed8b8bab48077/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:54.040564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0f67d-84a0-4091-910c-1980b115a125 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:54.041175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0f67d-84a0-4091-910c-1980b115a125 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:54.041372 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0f67d-84a0-4091-910c-1980b115a125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:54.073851 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-d2f0f67d-84a0-4091-910c-1980b115a125 None None] MFA Rules not processed for user `fee99d1e68e24ed9b87ed8b8bab48077`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:54.075214 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-d2f0f67d-84a0-4091-910c-1980b115a125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:54.172783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1154/2300] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:54.177245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ef1c1-b538-4ff8-955f-1e1b9e502525 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:54.246855 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0f67d-84a0-4091-910c-1980b115a125 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:54.249447 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-d2f0f67d-84a0-4091-910c-1980b115a125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:54.300635 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ef1c1-b538-4ff8-955f-1e1b9e502525 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:54.307042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ce608-3797-4f9c-a983-2e3d0464d42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:54.307964 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ce608-3797-4f9c-a983-2e3d0464d42e admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:54.308247 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ce608-3797-4f9c-a983-2e3d0464d42e admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:54.308520 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ce608-3797-4f9c-a983-2e3d0464d42e admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:54.309218 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ce608-3797-4f9c-a983-2e3d0464d42e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:54.312033 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ce608-3797-4f9c-a983-2e3d0464d42e admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:54.353946 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1147/2301] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:54 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:54.359143 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ce608-3797-4f9c-a983-2e3d0464d42e admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:54.366799 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0f67d-84a0-4091-910c-1980b115a125 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:54.438890 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ce608-3797-4f9c-a983-2e3d0464d42e admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:54.443982 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcd21d-987f-404b-9578-f42b84484d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:54.444658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcd21d-987f-404b-9578-f42b84484d9a admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:54.444944 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcd21d-987f-404b-9578-f42b84484d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:54.445370 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcd21d-987f-404b-9578-f42b84484d9a admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:54.446282 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcd21d-987f-404b-9578-f42b84484d9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:54.448249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcd21d-987f-404b-9578-f42b84484d9a admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:54.456570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07617495-ce92-4bc5-925c-571190581d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:54.457463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07617495-ce92-4bc5-925c-571190581d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:54.457738 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07617495-ce92-4bc5-925c-571190581d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:54.458009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07617495-ce92-4bc5-925c-571190581d03 admin admin] PATH_INFO: `/v3/projects/ec945b6dd8c748c995d75462be200273` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:54.459234 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07617495-ce92-4bc5-925c-571190581d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec945b6dd8c748c995d75462be200273)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:54.464315 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07617495-ce92-4bc5-925c-571190581d03 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:54.474029 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1148/2302] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:54 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:54.478409 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcd21d-987f-404b-9578-f42b84484d9a admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:54.488621 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcd21d-987f-404b-9578-f42b84484d9a admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:54.494737 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14693268-7fd0-4206-85db-8267b32e7f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:54.495413 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14693268-7fd0-4206-85db-8267b32e7f0d admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:54.495700 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14693268-7fd0-4206-85db-8267b32e7f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:54.496286 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14693268-7fd0-4206-85db-8267b32e7f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:54.496706 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14693268-7fd0-4206-85db-8267b32e7f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:54.499275 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14693268-7fd0-4206-85db-8267b32e7f0d admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:54.512643 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1149/2303] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:54.516725 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14693268-7fd0-4206-85db-8267b32e7f0d admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:54.530466 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14693268-7fd0-4206-85db-8267b32e7f0d admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:54.533125 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-07617495-ce92-4bc5-925c-571190581d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec945b6dd8c748c995d75462be200273', 'request_id': 'req-07617495-ce92-4bc5-925c-571190581d03'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:54.540857 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-07617495-ce92-4bc5-925c-571190581d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec945b6dd8c748c995d75462be200273', 'request_id': 'req-07617495-ce92-4bc5-925c-571190581d03'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:54.547211 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-07617495-ce92-4bc5-925c-571190581d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec945b6dd8c748c995d75462be200273', 'request_id': 'req-07617495-ce92-4bc5-925c-571190581d03'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:54.563668 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-07617495-ce92-4bc5-925c-571190581d03 admin admin] The token cache is being invalidate because project ec945b6dd8c748c995d75462be200273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:03:54.564117 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-07617495-ce92-4bc5-925c-571190581d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:54.564799 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-07617495-ce92-4bc5-925c-571190581d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:03:54.566620 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1155/2304] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:03:54 2022] DELETE /identity/v3/projects/ec945b6dd8c748c995d75462be200273 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:54.572969 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115b962-d826-428d-b6b4-2aebcb7fc065 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:54.573283 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115b962-d826-428d-b6b4-2aebcb7fc065 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:54.573558 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115b962-d826-428d-b6b4-2aebcb7fc065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:54.594990 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-8115b962-d826-428d-b6b4-2aebcb7fc065 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:54.596199 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-8115b962-d826-428d-b6b4-2aebcb7fc065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:54.613380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8d43c-6f36-415f-828b-86ec0ff1d6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:54.614458 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8d43c-6f36-415f-828b-86ec0ff1d6cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:54.614811 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8d43c-6f36-415f-828b-86ec0ff1d6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:54.615154 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8d43c-6f36-415f-828b-86ec0ff1d6cd admin admin] PATH_INFO: `/v3/projects/f54cd10ff0f1412ab507ee4b7ca67eab/users/2e431a21effd40c1930ec6a1155717dd/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:54.637986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8d43c-6f36-415f-828b-86ec0ff1d6cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54cd10ff0f1412ab507ee4b7ca67eab, user_id=2e431a21effd40c1930ec6a1155717dd, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:54.641308 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8d43c-6f36-415f-828b-86ec0ff1d6cd admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:54.661152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1150/2305] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:54 2022] PUT /identity/v3/projects/f54cd10ff0f1412ab507ee4b7ca67eab/users/2e431a21effd40c1930ec6a1155717dd/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:54.665618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8d43c-6f36-415f-828b-86ec0ff1d6cd admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:54.666402 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1156/2306] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:54.667420 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-93b8d43c-6f36-415f-828b-86ec0ff1d6cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:54.674521 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f731e-5c23-4583-8c07-57091d4d07a8 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:54.674819 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f731e-5c23-4583-8c07-57091d4d07a8 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:54.675378 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f731e-5c23-4583-8c07-57091d4d07a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:54.696008 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-fb7f731e-5c23-4583-8c07-57091d4d07a8 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:54.697220 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-fb7f731e-5c23-4583-8c07-57091d4d07a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:54.745796 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8d43c-6f36-415f-828b-86ec0ff1d6cd admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:54.751095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba52b4-ce51-418a-89e0-eff5a99be334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:54.751762 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba52b4-ce51-418a-89e0-eff5a99be334 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:54.752042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba52b4-ce51-418a-89e0-eff5a99be334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:54.752313 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba52b4-ce51-418a-89e0-eff5a99be334 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:54.753071 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba52b4-ce51-418a-89e0-eff5a99be334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:54.754703 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba52b4-ce51-418a-89e0-eff5a99be334 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:54.761460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1157/2307] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:54.766159 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f731e-5c23-4583-8c07-57091d4d07a8 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:54.770412 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1151/2308] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:54.771398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba52b4-ce51-418a-89e0-eff5a99be334 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:54.776935 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f731e-5c23-4583-8c07-57091d4d07a8 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:54.783074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba52b4-ce51-418a-89e0-eff5a99be334 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:54.783260 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59aa060-9de7-4a0f-852a-ab13e745de1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:54.783963 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59aa060-9de7-4a0f-852a-ab13e745de1a admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:54.784343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59aa060-9de7-4a0f-852a-ab13e745de1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:54.784757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59aa060-9de7-4a0f-852a-ab13e745de1a admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:54.785643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59aa060-9de7-4a0f-852a-ab13e745de1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:03:54.786072 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59aa060-9de7-4a0f-852a-ab13e745de1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:54.787858 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df282030-544a-45d1-b56b-4edeebc14e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:54.788027 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59aa060-9de7-4a0f-852a-ab13e745de1a admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:54.788907 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df282030-544a-45d1-b56b-4edeebc14e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:54.789346 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df282030-544a-45d1-b56b-4edeebc14e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:54.789629 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df282030-544a-45d1-b56b-4edeebc14e9a admin admin] PATH_INFO: `/v3/projects/f54cd10ff0f1412ab507ee4b7ca67eab/users/2e431a21effd40c1930ec6a1155717dd/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:54.791688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df282030-544a-45d1-b56b-4edeebc14e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54cd10ff0f1412ab507ee4b7ca67eab, user_id=2e431a21effd40c1930ec6a1155717dd, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:54.794562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df282030-544a-45d1-b56b-4edeebc14e9a admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:54.804890 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1158/2309] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:03:54.807282 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1152/2310] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:54 2022] PUT /identity/v3/projects/f54cd10ff0f1412ab507ee4b7ca67eab/users/2e431a21effd40c1930ec6a1155717dd/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:03:54.809221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59aa060-9de7-4a0f-852a-ab13e745de1a admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:54.818561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c48563-a074-4663-bc39-bdd12355d7b6 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:54.819101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c48563-a074-4663-bc39-bdd12355d7b6 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:54.819241 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59aa060-9de7-4a0f-852a-ab13e745de1a admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:54.819552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c48563-a074-4663-bc39-bdd12355d7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:54.848595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-e1c48563-a074-4663-bc39-bdd12355d7b6 None None] MFA Rules not processed for user `2e431a21effd40c1930ec6a1155717dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:54.849866 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-e1c48563-a074-4663-bc39-bdd12355d7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:54.876280 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006b6c3-1374-416d-abb2-9681215d0453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:54.876880 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006b6c3-1374-416d-abb2-9681215d0453 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:54.877220 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006b6c3-1374-416d-abb2-9681215d0453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:54.877427 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006b6c3-1374-416d-abb2-9681215d0453 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:54.878110 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006b6c3-1374-416d-abb2-9681215d0453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:54.880091 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006b6c3-1374-416d-abb2-9681215d0453 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:54.909046 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1159/2311] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:03:54 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:03:54.910121 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006b6c3-1374-416d-abb2-9681215d0453 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:54.918602 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1153/2312] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:03:54.930927 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c48563-a074-4663-bc39-bdd12355d7b6 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:54.932382 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-e1c48563-a074-4663-bc39-bdd12355d7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:54.975123 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006b6c3-1374-416d-abb2-9681215d0453 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:54.980759 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67823374-3277-46fd-9cfe-68e40218814f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:54.981425 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67823374-3277-46fd-9cfe-68e40218814f admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:54.981842 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67823374-3277-46fd-9cfe-68e40218814f admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:54.982120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67823374-3277-46fd-9cfe-68e40218814f admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:54.982838 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67823374-3277-46fd-9cfe-68e40218814f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:54.984766 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67823374-3277-46fd-9cfe-68e40218814f admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:54.993791 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c48563-a074-4663-bc39-bdd12355d7b6 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:55.011255 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1160/2313] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:03:54 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:03:55.014424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67823374-3277-46fd-9cfe-68e40218814f admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:55.025454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67823374-3277-46fd-9cfe-68e40218814f admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:55.030087 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c63a99-8671-4482-904f-15c11c899853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:55.030843 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c63a99-8671-4482-904f-15c11c899853 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:55.031199 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c63a99-8671-4482-904f-15c11c899853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:55.031539 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c63a99-8671-4482-904f-15c11c899853 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:55.032359 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c63a99-8671-4482-904f-15c11c899853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:55.034145 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c63a99-8671-4482-904f-15c11c899853 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:55.045639 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1161/2314] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:03:55.049451 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c63a99-8671-4482-904f-15c11c899853 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:55.050392 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e7374-545d-4beb-bf7c-cc285b361629 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:55.051047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e7374-545d-4beb-bf7c-cc285b361629 service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:55.051429 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e7374-545d-4beb-bf7c-cc285b361629 service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:55.051784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e7374-545d-4beb-bf7c-cc285b361629 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:55.054064 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-254e7374-545d-4beb-bf7c-cc285b361629 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:55.060062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c63a99-8671-4482-904f-15c11c899853 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:55.064971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d9202-a1c4-4ea7-8a7f-69b40edb80cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:55.065637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d9202-a1c4-4ea7-8a7f-69b40edb80cc admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:55.065935 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d9202-a1c4-4ea7-8a7f-69b40edb80cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:55.066187 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d9202-a1c4-4ea7-8a7f-69b40edb80cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:55.067090 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d9202-a1c4-4ea7-8a7f-69b40edb80cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:55.068886 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d9202-a1c4-4ea7-8a7f-69b40edb80cc admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:55.080124 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1162/2315] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:03:55.087203 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d9202-a1c4-4ea7-8a7f-69b40edb80cc admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:55.098024 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d9202-a1c4-4ea7-8a7f-69b40edb80cc admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:55.110760 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de98e73-c9c1-49f0-8b65-708c4b9c5904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:55.111679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de98e73-c9c1-49f0-8b65-708c4b9c5904 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:55.111960 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de98e73-c9c1-49f0-8b65-708c4b9c5904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:55.112232 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de98e73-c9c1-49f0-8b65-708c4b9c5904 admin admin] PATH_INFO: `/v3/projects/44ce7f2d40cc444091bd73777443a0b0/users/3dd1e8dc01b3416e8e78a50372b316e9/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:55.115103 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e7374-545d-4beb-bf7c-cc285b361629 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:55.116735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e7374-545d-4beb-bf7c-cc285b361629 service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:55.125925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1154/2316] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:03:55.126973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de98e73-c9c1-49f0-8b65-708c4b9c5904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44ce7f2d40cc444091bd73777443a0b0, user_id=3dd1e8dc01b3416e8e78a50372b316e9, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:55.129616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de98e73-c9c1-49f0-8b65-708c4b9c5904 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:55.150367 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1163/2317] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:03:55 2022] PUT /identity/v3/projects/44ce7f2d40cc444091bd73777443a0b0/users/3dd1e8dc01b3416e8e78a50372b316e9/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:03:55.156185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55404d66-a074-4846-86c4-df2c7002f7c7 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:55.156185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55404d66-a074-4846-86c4-df2c7002f7c7 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:55.156185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55404d66-a074-4846-86c4-df2c7002f7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:55.198662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-55404d66-a074-4846-86c4-df2c7002f7c7 None None] MFA Rules not processed for user `3dd1e8dc01b3416e8e78a50372b316e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:55.200090 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-55404d66-a074-4846-86c4-df2c7002f7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:55.306116 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1155/2318] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:03:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:55.350051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de98e73-c9c1-49f0-8b65-708c4b9c5904 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:55.352398 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-8de98e73-c9c1-49f0-8b65-708c4b9c5904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:55.427770 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de98e73-c9c1-49f0-8b65-708c4b9c5904 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:55.427770 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ec6a1-9339-4880-8486-bf89e316abef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:55.427770 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ec6a1-9339-4880-8486-bf89e316abef service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:55.427770 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ec6a1-9339-4880-8486-bf89e316abef service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:55.428096 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ec6a1-9339-4880-8486-bf89e316abef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:55.433975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ec6a1-9339-4880-8486-bf89e316abef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:55.435638 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ec6a1-9339-4880-8486-bf89e316abef service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:55.446517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1164/2319] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:03:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:04:01.939839 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55404d66-a074-4846-86c4-df2c7002f7c7 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:01.941340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-55404d66-a074-4846-86c4-df2c7002f7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:02.010761 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55404d66-a074-4846-86c4-df2c7002f7c7 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:02.015440 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcdf63-b72e-4208-b1ff-36676663874f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:02.016306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcdf63-b72e-4208-b1ff-36676663874f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:02.016585 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcdf63-b72e-4208-b1ff-36676663874f admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:02.016857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcdf63-b72e-4208-b1ff-36676663874f admin admin] PATH_INFO: `/v3/users/861677c0d08e43b2a71b2ba8e86fa04e` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:02.018282 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcdf63-b72e-4208-b1ff-36676663874f admin admin] RBAC: Authorizing `identity:delete_user(user_id=861677c0d08e43b2a71b2ba8e86fa04e)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:02.020372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcdf63-b72e-4208-b1ff-36676663874f admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:02.067517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e2fcdf63-b72e-4208-b1ff-36676663874f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '861677c0d08e43b2a71b2ba8e86fa04e'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:02.075682 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e2fcdf63-b72e-4208-b1ff-36676663874f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '861677c0d08e43b2a71b2ba8e86fa04e'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:02.092795 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e2fcdf63-b72e-4208-b1ff-36676663874f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '861677c0d08e43b2a71b2ba8e86fa04e'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:02.093980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e2fcdf63-b72e-4208-b1ff-36676663874f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '861677c0d08e43b2a71b2ba8e86fa04e'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:02.094728 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e2fcdf63-b72e-4208-b1ff-36676663874f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '861677c0d08e43b2a71b2ba8e86fa04e'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:02.102226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ec6a1-9339-4880-8486-bf89e316abef service cinder] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:02.112265 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1156/2320] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:04:01 2022] DELETE /identity/v3/users/861677c0d08e43b2a71b2ba8e86fa04e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:02.114790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ec6a1-9339-4880-8486-bf89e316abef service cinder] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:02.116672 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac0cc8-94a4-48c1-a0c5-01e7357c9848 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:02.117529 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac0cc8-94a4-48c1-a0c5-01e7357c9848 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:02.117820 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac0cc8-94a4-48c1-a0c5-01e7357c9848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:02.135910 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-e3ac0cc8-94a4-48c1-a0c5-01e7357c9848 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:02.137134 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-e3ac0cc8-94a4-48c1-a0c5-01e7357c9848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:02.183928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b432f9c-f6dc-42ee-9303-948c0b880097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:02.184903 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b432f9c-f6dc-42ee-9303-948c0b880097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:02.185238 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b432f9c-f6dc-42ee-9303-948c0b880097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:02.185576 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b432f9c-f6dc-42ee-9303-948c0b880097 admin admin] PATH_INFO: `/v3/users/fee99d1e68e24ed9b87ed8b8bab48077` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:02.187204 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b432f9c-f6dc-42ee-9303-948c0b880097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fee99d1e68e24ed9b87ed8b8bab48077)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:02.189166 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b432f9c-f6dc-42ee-9303-948c0b880097 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:02.211425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1157/2321] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:04:02.221093 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac0cc8-94a4-48c1-a0c5-01e7357c9848 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:02.222751 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-e3ac0cc8-94a4-48c1-a0c5-01e7357c9848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:02.250476 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-5b432f9c-f6dc-42ee-9303-948c0b880097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fee99d1e68e24ed9b87ed8b8bab48077'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:02.251400 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-5b432f9c-f6dc-42ee-9303-948c0b880097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fee99d1e68e24ed9b87ed8b8bab48077'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:02.264020 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-5b432f9c-f6dc-42ee-9303-948c0b880097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fee99d1e68e24ed9b87ed8b8bab48077'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:02.271917 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-5b432f9c-f6dc-42ee-9303-948c0b880097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fee99d1e68e24ed9b87ed8b8bab48077'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:02.283329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-5b432f9c-f6dc-42ee-9303-948c0b880097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fee99d1e68e24ed9b87ed8b8bab48077'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:02.293140 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1165/2322] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:04:02 2022] DELETE /identity/v3/users/fee99d1e68e24ed9b87ed8b8bab48077 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:04:02.298411 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dd2e8-e5a8-4970-b5d1-cc4bc0496c12 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:02.298738 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dd2e8-e5a8-4970-b5d1-cc4bc0496c12 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:02.298884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac0cc8-94a4-48c1-a0c5-01e7357c9848 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:02.299034 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dd2e8-e5a8-4970-b5d1-cc4bc0496c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:02.320327 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-ba6dd2e8-e5a8-4970-b5d1-cc4bc0496c12 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:02.321477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-ba6dd2e8-e5a8-4970-b5d1-cc4bc0496c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:02.357613 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79429a73-16a4-4f59-abec-666b8ab363a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:02.358335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79429a73-16a4-4f59-abec-666b8ab363a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:02.358614 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79429a73-16a4-4f59-abec-666b8ab363a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:02.358884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79429a73-16a4-4f59-abec-666b8ab363a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:02.360972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-79429a73-16a4-4f59-abec-666b8ab363a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:02.395360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1166/2323] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:04:02.407586 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dd2e8-e5a8-4970-b5d1-cc4bc0496c12 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:02.409161 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-ba6dd2e8-e5a8-4970-b5d1-cc4bc0496c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:02.428594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dd2e8-e5a8-4970-b5d1-cc4bc0496c12 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:02.434357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b12af-f516-4f83-81cd-a9cb94b9c625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:02.435151 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b12af-f516-4f83-81cd-a9cb94b9c625 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:02.435444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b12af-f516-4f83-81cd-a9cb94b9c625 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:02.435721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b12af-f516-4f83-81cd-a9cb94b9c625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:02.447164 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b12af-f516-4f83-81cd-a9cb94b9c625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:02.448606 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b12af-f516-4f83-81cd-a9cb94b9c625 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:02.449835 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79429a73-16a4-4f59-abec-666b8ab363a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:02.451603 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79429a73-16a4-4f59-abec-666b8ab363a6 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:02.460215 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1167/2324] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:04:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:04:02.464106 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1158/2325] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:04:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:04:02.844211 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b12af-f516-4f83-81cd-a9cb94b9c625 service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:02.845925 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-3f2b12af-f516-4f83-81cd-a9cb94b9c625 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:02.866348 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b12af-f516-4f83-81cd-a9cb94b9c625 service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:02.872171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe376d-cd08-49e6-ab4d-e4426e259cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:02.873103 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe376d-cd08-49e6-ab4d-e4426e259cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:02.873375 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe376d-cd08-49e6-ab4d-e4426e259cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:02.873650 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe376d-cd08-49e6-ab4d-e4426e259cbe admin admin] PATH_INFO: `/v3/projects/74e8426a3b2648519584d93fc1d80420` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:02.875074 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe376d-cd08-49e6-ab4d-e4426e259cbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=74e8426a3b2648519584d93fc1d80420)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:02.876909 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe376d-cd08-49e6-ab4d-e4426e259cbe admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:02.917868 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79429a73-16a4-4f59-abec-666b8ab363a6 service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:02.920004 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-79429a73-16a4-4f59-abec-666b8ab363a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:02.947785 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79429a73-16a4-4f59-abec-666b8ab363a6 service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:02.959111 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-30fe376d-cd08-49e6-ab4d-e4426e259cbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74e8426a3b2648519584d93fc1d80420', 'request_id': 'req-30fe376d-cd08-49e6-ab4d-e4426e259cbe'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:02.967531 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-30fe376d-cd08-49e6-ab4d-e4426e259cbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74e8426a3b2648519584d93fc1d80420', 'request_id': 'req-30fe376d-cd08-49e6-ab4d-e4426e259cbe'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:02.974710 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-30fe376d-cd08-49e6-ab4d-e4426e259cbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74e8426a3b2648519584d93fc1d80420', 'request_id': 'req-30fe376d-cd08-49e6-ab4d-e4426e259cbe'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:02.990604 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-30fe376d-cd08-49e6-ab4d-e4426e259cbe admin admin] The token cache is being invalidate because project 74e8426a3b2648519584d93fc1d80420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:04:02.990918 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-30fe376d-cd08-49e6-ab4d-e4426e259cbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:02.991550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-30fe376d-cd08-49e6-ab4d-e4426e259cbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:02.993831 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1168/2326] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:04:02 2022] DELETE /identity/v3/projects/74e8426a3b2648519584d93fc1d80420 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:02.997680 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe376d-cd08-49e6-ab4d-e4426e259cbe admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:02.999461 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-30fe376d-cd08-49e6-ab4d-e4426e259cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:03.016913 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c43498-ad83-44ba-837a-064dffa4e922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:03.017775 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c43498-ad83-44ba-837a-064dffa4e922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:03.018055 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c43498-ad83-44ba-837a-064dffa4e922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:03.018365 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c43498-ad83-44ba-837a-064dffa4e922 admin admin] PATH_INFO: `/v3/projects/268d118b8ac749cc9d6a3a085eacbbbb` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:03.019556 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c43498-ad83-44ba-837a-064dffa4e922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=268d118b8ac749cc9d6a3a085eacbbbb)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:03.021723 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c43498-ad83-44ba-837a-064dffa4e922 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:03.072670 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-93c43498-ad83-44ba-837a-064dffa4e922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '268d118b8ac749cc9d6a3a085eacbbbb', 'request_id': 'req-93c43498-ad83-44ba-837a-064dffa4e922'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:03.075763 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe376d-cd08-49e6-ab4d-e4426e259cbe admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:03.078518 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-93c43498-ad83-44ba-837a-064dffa4e922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '268d118b8ac749cc9d6a3a085eacbbbb', 'request_id': 'req-93c43498-ad83-44ba-837a-064dffa4e922'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:03.085483 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-93c43498-ad83-44ba-837a-064dffa4e922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '268d118b8ac749cc9d6a3a085eacbbbb', 'request_id': 'req-93c43498-ad83-44ba-837a-064dffa4e922'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:03.100438 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-93c43498-ad83-44ba-837a-064dffa4e922 admin admin] The token cache is being invalidate because project 268d118b8ac749cc9d6a3a085eacbbbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:04:03.100772 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-93c43498-ad83-44ba-837a-064dffa4e922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:03.101903 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-93c43498-ad83-44ba-837a-064dffa4e922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:03.104147 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1159/2327] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:04:02 2022] DELETE /identity/v3/projects/268d118b8ac749cc9d6a3a085eacbbbb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:04:03.155835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d48ee-a33e-45d5-b0a3-a847a540feb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:03.156752 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d48ee-a33e-45d5-b0a3-a847a540feb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:03.157042 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d48ee-a33e-45d5-b0a3-a847a540feb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:03.157322 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d48ee-a33e-45d5-b0a3-a847a540feb1 admin admin] PATH_INFO: `/v3/users/2e431a21effd40c1930ec6a1155717dd` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:03.158605 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d48ee-a33e-45d5-b0a3-a847a540feb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e431a21effd40c1930ec6a1155717dd)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:03.160770 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d48ee-a33e-45d5-b0a3-a847a540feb1 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:03.247678 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d92d48ee-a33e-45d5-b0a3-a847a540feb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e431a21effd40c1930ec6a1155717dd'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:03.248533 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d92d48ee-a33e-45d5-b0a3-a847a540feb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e431a21effd40c1930ec6a1155717dd'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:03.264359 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d92d48ee-a33e-45d5-b0a3-a847a540feb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e431a21effd40c1930ec6a1155717dd'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:03.282642 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d92d48ee-a33e-45d5-b0a3-a847a540feb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e431a21effd40c1930ec6a1155717dd'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:03.292852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d92d48ee-a33e-45d5-b0a3-a847a540feb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e431a21effd40c1930ec6a1155717dd'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:03.301188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1169/2328] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:04:02 2022] DELETE /identity/v3/users/2e431a21effd40c1930ec6a1155717dd => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:04:03.643437 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c43498-ad83-44ba-837a-064dffa4e922 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:03.643857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-93c43498-ad83-44ba-837a-064dffa4e922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:03.675400 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c43498-ad83-44ba-837a-064dffa4e922 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:03.772213 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1fad48-79e1-4420-bf30-18eb46286ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:03.773697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fad48-79e1-4420-bf30-18eb46286ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:03.774131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fad48-79e1-4420-bf30-18eb46286ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:03.774538 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fad48-79e1-4420-bf30-18eb46286ffd admin admin] PATH_INFO: `/v3/projects/f54cd10ff0f1412ab507ee4b7ca67eab` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:03.775999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1fad48-79e1-4420-bf30-18eb46286ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f54cd10ff0f1412ab507ee4b7ca67eab)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:03.778063 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1fad48-79e1-4420-bf30-18eb46286ffd admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:03.849892 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9f1fad48-79e1-4420-bf30-18eb46286ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f54cd10ff0f1412ab507ee4b7ca67eab', 'request_id': 'req-9f1fad48-79e1-4420-bf30-18eb46286ffd'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:03.857149 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9f1fad48-79e1-4420-bf30-18eb46286ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f54cd10ff0f1412ab507ee4b7ca67eab', 'request_id': 'req-9f1fad48-79e1-4420-bf30-18eb46286ffd'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:03.864773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9f1fad48-79e1-4420-bf30-18eb46286ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f54cd10ff0f1412ab507ee4b7ca67eab', 'request_id': 'req-9f1fad48-79e1-4420-bf30-18eb46286ffd'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:03.891802 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9f1fad48-79e1-4420-bf30-18eb46286ffd admin admin] The token cache is being invalidate because project f54cd10ff0f1412ab507ee4b7ca67eab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:04:03.892458 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9f1fad48-79e1-4420-bf30-18eb46286ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:03.893171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9f1fad48-79e1-4420-bf30-18eb46286ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:03.908383 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1160/2329] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:04:03 2022] DELETE /identity/v3/projects/f54cd10ff0f1412ab507ee4b7ca67eab => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:03.913574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a07a8-f531-4176-9993-310a5228cc7d None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:03.914657 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a07a8-f531-4176-9993-310a5228cc7d None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:03.915107 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a07a8-f531-4176-9993-310a5228cc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:03.943070 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-675a07a8-f531-4176-9993-310a5228cc7d None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:03.944681 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-675a07a8-f531-4176-9993-310a5228cc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:04.019117 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1170/2330] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:04.026953 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef21e7f-190d-4c5e-9b68-421f200ba286 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:04.027449 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef21e7f-190d-4c5e-9b68-421f200ba286 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:04.027563 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef21e7f-190d-4c5e-9b68-421f200ba286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:04.045774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-8ef21e7f-190d-4c5e-9b68-421f200ba286 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:04.047003 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-8ef21e7f-190d-4c5e-9b68-421f200ba286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:04.055671 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1161/2331] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:04.064768 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a07a8-f531-4176-9993-310a5228cc7d None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:04.069866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a07a8-f531-4176-9993-310a5228cc7d None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:04.075648 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421720a-ec6b-4813-a9b3-bec72d89304d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:04.076336 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421720a-ec6b-4813-a9b3-bec72d89304d admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:04.076616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421720a-ec6b-4813-a9b3-bec72d89304d admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:04.076886 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421720a-ec6b-4813-a9b3-bec72d89304d admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:04.077621 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421720a-ec6b-4813-a9b3-bec72d89304d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:04:04.078026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421720a-ec6b-4813-a9b3-bec72d89304d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:04.079796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421720a-ec6b-4813-a9b3-bec72d89304d admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:04.091424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1171/2332] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:04:04.095768 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef21e7f-190d-4c5e-9b68-421f200ba286 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:04.105318 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef21e7f-190d-4c5e-9b68-421f200ba286 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:04.110018 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179024b-5eb1-44a5-b5fb-d9e28cee0021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:04.110696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179024b-5eb1-44a5-b5fb-d9e28cee0021 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:04.110973 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179024b-5eb1-44a5-b5fb-d9e28cee0021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:04.111240 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179024b-5eb1-44a5-b5fb-d9e28cee0021 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:04.111921 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179024b-5eb1-44a5-b5fb-d9e28cee0021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:04.113841 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179024b-5eb1-44a5-b5fb-d9e28cee0021 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:04.142238 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1162/2333] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:04:04 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:04:04.144498 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421720a-ec6b-4813-a9b3-bec72d89304d admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:04.155088 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421720a-ec6b-4813-a9b3-bec72d89304d admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:04.223486 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecd314-b483-42b6-bfee-5ab526094695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:04.224181 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecd314-b483-42b6-bfee-5ab526094695 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:04.224465 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecd314-b483-42b6-bfee-5ab526094695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:04.224743 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecd314-b483-42b6-bfee-5ab526094695 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:04.225557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ecd314-b483-42b6-bfee-5ab526094695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:04.227505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ecd314-b483-42b6-bfee-5ab526094695 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:04.249365 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1172/2334] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:04:04 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:04:04.253844 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179024b-5eb1-44a5-b5fb-d9e28cee0021 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:04.265159 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179024b-5eb1-44a5-b5fb-d9e28cee0021 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:04.269975 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb2ab4-64f0-48b4-b24a-8c3233e86727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:04.270693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2ab4-64f0-48b4-b24a-8c3233e86727 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:04.270973 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2ab4-64f0-48b4-b24a-8c3233e86727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:04.271244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2ab4-64f0-48b4-b24a-8c3233e86727 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:04.271985 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb2ab4-64f0-48b4-b24a-8c3233e86727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:04.273912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb2ab4-64f0-48b4-b24a-8c3233e86727 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:04.285409 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1163/2335] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:04:04.290148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecd314-b483-42b6-bfee-5ab526094695 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:04.300539 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecd314-b483-42b6-bfee-5ab526094695 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:04.306712 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f61f5-90b8-438c-8e92-8673bc6be26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:04.307484 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f61f5-90b8-438c-8e92-8673bc6be26b admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:04.307837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f61f5-90b8-438c-8e92-8673bc6be26b admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:04.308179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f61f5-90b8-438c-8e92-8673bc6be26b admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:04.310072 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f61f5-90b8-438c-8e92-8673bc6be26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:04.310753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f61f5-90b8-438c-8e92-8673bc6be26b admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:04.323245 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1173/2336] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:04:04.327485 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb2ab4-64f0-48b4-b24a-8c3233e86727 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:04.339497 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb2ab4-64f0-48b4-b24a-8c3233e86727 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:04.344876 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f5b84-8af1-40e4-9db5-150382d2b526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:04.345847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f5b84-8af1-40e4-9db5-150382d2b526 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:04.346267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f5b84-8af1-40e4-9db5-150382d2b526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:04.346565 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f5b84-8af1-40e4-9db5-150382d2b526 admin admin] PATH_INFO: `/v3/projects/4d1ec5b2695d45eaa2d1efed5811454e/users/d983466891d9427fad8d7eddaca07e01/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:04.366072 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f5b84-8af1-40e4-9db5-150382d2b526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d1ec5b2695d45eaa2d1efed5811454e, user_id=d983466891d9427fad8d7eddaca07e01, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:04.374605 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f5b84-8af1-40e4-9db5-150382d2b526 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:04.389090 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1164/2337] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:04:04 2022] PUT /identity/v3/projects/4d1ec5b2695d45eaa2d1efed5811454e/users/d983466891d9427fad8d7eddaca07e01/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:04.400522 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0148f9-b390-4781-add9-2e87bdbbac66 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:04.400882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0148f9-b390-4781-add9-2e87bdbbac66 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:04.401226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0148f9-b390-4781-add9-2e87bdbbac66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:04.440440 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-2b0148f9-b390-4781-add9-2e87bdbbac66 None None] MFA Rules not processed for user `d983466891d9427fad8d7eddaca07e01`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:04.441705 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-2b0148f9-b390-4781-add9-2e87bdbbac66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:04.531906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1174/2338] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:04:04.533040 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f5b84-8af1-40e4-9db5-150382d2b526 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:04.607862 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f5b84-8af1-40e4-9db5-150382d2b526 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:04.612533 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6646bf-a2e7-42f6-9886-ce304999503c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:04.613191 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6646bf-a2e7-42f6-9886-ce304999503c admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:04.613473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6646bf-a2e7-42f6-9886-ce304999503c admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:04.613749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6646bf-a2e7-42f6-9886-ce304999503c admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:04.614518 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6646bf-a2e7-42f6-9886-ce304999503c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:04.616472 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6646bf-a2e7-42f6-9886-ce304999503c admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:04.645015 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1165/2339] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:04:04 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:04:04.649998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0148f9-b390-4781-add9-2e87bdbbac66 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:04.660438 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0148f9-b390-4781-add9-2e87bdbbac66 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:04.716927 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93c5ed-0b96-4598-8938-f7e6618a87c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:04.717533 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93c5ed-0b96-4598-8938-f7e6618a87c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:04.717812 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93c5ed-0b96-4598-8938-f7e6618a87c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:04.718082 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93c5ed-0b96-4598-8938-f7e6618a87c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:04.718808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93c5ed-0b96-4598-8938-f7e6618a87c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:04.720711 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93c5ed-0b96-4598-8938-f7e6618a87c3 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:04.746764 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1175/2340] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:04:04 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:04:04.750915 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6646bf-a2e7-42f6-9886-ce304999503c admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:04.764990 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6646bf-a2e7-42f6-9886-ce304999503c admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:04.769756 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd2500-753c-420f-b300-b807cf276d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:04.770456 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd2500-753c-420f-b300-b807cf276d6f admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:04.770722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd2500-753c-420f-b300-b807cf276d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:04.770993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd2500-753c-420f-b300-b807cf276d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:04.771743 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd2500-753c-420f-b300-b807cf276d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:04.773496 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd2500-753c-420f-b300-b807cf276d6f admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:04.784358 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1166/2341] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:04:04.788445 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93c5ed-0b96-4598-8938-f7e6618a87c3 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:04.798689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93c5ed-0b96-4598-8938-f7e6618a87c3 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:04.803323 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043b984-8b37-40f7-ae23-2bf360b6cc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:04.803979 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043b984-8b37-40f7-ae23-2bf360b6cc8e admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:04.804265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043b984-8b37-40f7-ae23-2bf360b6cc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:04.805072 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043b984-8b37-40f7-ae23-2bf360b6cc8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:04.805948 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043b984-8b37-40f7-ae23-2bf360b6cc8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:04.807640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043b984-8b37-40f7-ae23-2bf360b6cc8e admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:04.817774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1176/2342] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:04:04.822901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd2500-753c-420f-b300-b807cf276d6f admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:04.834733 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd2500-753c-420f-b300-b807cf276d6f admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:04.841771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a324a-06c1-4ec0-891c-6d5c52233d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:04.842761 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a324a-06c1-4ec0-891c-6d5c52233d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:04.843106 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a324a-06c1-4ec0-891c-6d5c52233d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:04.843305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a324a-06c1-4ec0-891c-6d5c52233d6e admin admin] PATH_INFO: `/v3/projects/6c67429c56284aa09fea76a2fa7c00b4/users/5d7255ecee174701952786599d495554/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:04.858900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a324a-06c1-4ec0-891c-6d5c52233d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c67429c56284aa09fea76a2fa7c00b4, user_id=5d7255ecee174701952786599d495554, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:04.861562 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a324a-06c1-4ec0-891c-6d5c52233d6e admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:04.875702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1167/2343] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:04:04 2022] PUT /identity/v3/projects/6c67429c56284aa09fea76a2fa7c00b4/users/5d7255ecee174701952786599d495554/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:04.887214 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068af7b-0ccc-4e10-8112-71565bd0ad0e None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:04.887506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068af7b-0ccc-4e10-8112-71565bd0ad0e None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:04.887785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068af7b-0ccc-4e10-8112-71565bd0ad0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:04.919281 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-6068af7b-0ccc-4e10-8112-71565bd0ad0e None None] MFA Rules not processed for user `5d7255ecee174701952786599d495554`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:04.931315 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-6068af7b-0ccc-4e10-8112-71565bd0ad0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:05.028370 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1177/2344] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:05.029794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a324a-06c1-4ec0-891c-6d5c52233d6e admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:05.133574 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a324a-06c1-4ec0-891c-6d5c52233d6e admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:05.140627 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9530aff-b632-46ce-9b7a-d83f956b7a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:05.142246 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9530aff-b632-46ce-9b7a-d83f956b7a74 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:05.142819 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9530aff-b632-46ce-9b7a-d83f956b7a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:05.143129 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9530aff-b632-46ce-9b7a-d83f956b7a74 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:05.143938 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9530aff-b632-46ce-9b7a-d83f956b7a74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:05.146049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9530aff-b632-46ce-9b7a-d83f956b7a74 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:05.181579 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1168/2345] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:04:05 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:04:05.182989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068af7b-0ccc-4e10-8112-71565bd0ad0e None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:05.195662 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068af7b-0ccc-4e10-8112-71565bd0ad0e None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:05.256979 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec0a8f-e280-4f24-bf97-376d15e0b9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:05.258540 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec0a8f-e280-4f24-bf97-376d15e0b9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:05.258916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec0a8f-e280-4f24-bf97-376d15e0b9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:05.259262 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec0a8f-e280-4f24-bf97-376d15e0b9e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:05.260023 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec0a8f-e280-4f24-bf97-376d15e0b9e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:05.262082 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec0a8f-e280-4f24-bf97-376d15e0b9e9 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:05.283667 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1178/2346] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:04:05 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:04:05.287788 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9530aff-b632-46ce-9b7a-d83f956b7a74 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:05.299312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9530aff-b632-46ce-9b7a-d83f956b7a74 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:05.304040 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e699eae-2377-4543-bbed-f91a19538a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:05.304936 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e699eae-2377-4543-bbed-f91a19538a66 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:05.305479 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e699eae-2377-4543-bbed-f91a19538a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:05.305936 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e699eae-2377-4543-bbed-f91a19538a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:05.306965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e699eae-2377-4543-bbed-f91a19538a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:05.308738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e699eae-2377-4543-bbed-f91a19538a66 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:05.321127 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1169/2347] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:04:05.325732 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec0a8f-e280-4f24-bf97-376d15e0b9e9 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:05.336652 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec0a8f-e280-4f24-bf97-376d15e0b9e9 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:05.341778 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcc4cf-a1e7-4a1e-9ec3-e4750bdcb1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:05.342966 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcc4cf-a1e7-4a1e-9ec3-e4750bdcb1f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:05.343351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcc4cf-a1e7-4a1e-9ec3-e4750bdcb1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:05.343703 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcc4cf-a1e7-4a1e-9ec3-e4750bdcb1f8 admin admin] PATH_INFO: `/v3/projects/ab03b666bb1d4152a9dac75fbc2c7649/users/3934239701844c8da75609aa50cd8ae5/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:05.360870 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcc4cf-a1e7-4a1e-9ec3-e4750bdcb1f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab03b666bb1d4152a9dac75fbc2c7649, user_id=3934239701844c8da75609aa50cd8ae5, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:05.363771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcc4cf-a1e7-4a1e-9ec3-e4750bdcb1f8 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:05.379794 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1179/2348] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:04:05 2022] PUT /identity/v3/projects/ab03b666bb1d4152a9dac75fbc2c7649/users/3934239701844c8da75609aa50cd8ae5/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:05.391104 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e699eae-2377-4543-bbed-f91a19538a66 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:05.404864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e699eae-2377-4543-bbed-f91a19538a66 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:05.485543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f10550-4e3e-40e8-8e8f-8d9f99cf683f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:05.485543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f10550-4e3e-40e8-8e8f-8d9f99cf683f admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:05.485543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f10550-4e3e-40e8-8e8f-8d9f99cf683f admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:05.485543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f10550-4e3e-40e8-8e8f-8d9f99cf683f admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:05.486636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f10550-4e3e-40e8-8e8f-8d9f99cf683f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:05.488672 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f10550-4e3e-40e8-8e8f-8d9f99cf683f admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:05.500961 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1170/2349] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:04:05.505092 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcc4cf-a1e7-4a1e-9ec3-e4750bdcb1f8 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:05.516890 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcc4cf-a1e7-4a1e-9ec3-e4750bdcb1f8 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:05.521949 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25430e33-70ea-4c26-ab97-e70090b0bb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:05.523123 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25430e33-70ea-4c26-ab97-e70090b0bb2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:05.523510 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25430e33-70ea-4c26-ab97-e70090b0bb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:05.523824 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25430e33-70ea-4c26-ab97-e70090b0bb2d admin admin] PATH_INFO: `/v3/projects/ab03b666bb1d4152a9dac75fbc2c7649/users/3934239701844c8da75609aa50cd8ae5/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:05.526046 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25430e33-70ea-4c26-ab97-e70090b0bb2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab03b666bb1d4152a9dac75fbc2c7649, user_id=3934239701844c8da75609aa50cd8ae5, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:05.534118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25430e33-70ea-4c26-ab97-e70090b0bb2d admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:05.548266 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1180/2350] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:04:05 2022] PUT /identity/v3/projects/ab03b666bb1d4152a9dac75fbc2c7649/users/3934239701844c8da75609aa50cd8ae5/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:05.559702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd2c13-756d-4dde-a1f1-a6b44417cd86 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:05.560091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd2c13-756d-4dde-a1f1-a6b44417cd86 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:05.560407 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd2c13-756d-4dde-a1f1-a6b44417cd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:05.594989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-b7cd2c13-756d-4dde-a1f1-a6b44417cd86 None None] MFA Rules not processed for user `3934239701844c8da75609aa50cd8ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:05.596294 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b7cd2c13-756d-4dde-a1f1-a6b44417cd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:05.662594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1171/2351] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:05.674139 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25430e33-70ea-4c26-ab97-e70090b0bb2d admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:05.675880 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-25430e33-70ea-4c26-ab97-e70090b0bb2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:05.763328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25430e33-70ea-4c26-ab97-e70090b0bb2d admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:05.767331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05aff1-2dd2-48b0-a1d0-99b2ba078d1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:05.767997 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05aff1-2dd2-48b0-a1d0-99b2ba078d1f service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:05.768278 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05aff1-2dd2-48b0-a1d0-99b2ba078d1f service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:05.768549 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05aff1-2dd2-48b0-a1d0-99b2ba078d1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:05.828239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05aff1-2dd2-48b0-a1d0-99b2ba078d1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:05.829783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05aff1-2dd2-48b0-a1d0-99b2ba078d1f service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:05.839480 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1181/2352] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:04:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:04:07.343969 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd2c13-756d-4dde-a1f1-a6b44417cd86 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:07.345386 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b7cd2c13-756d-4dde-a1f1-a6b44417cd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:07.359503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd2c13-756d-4dde-a1f1-a6b44417cd86 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:07.364033 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af05cfa-fd1b-4b17-a36d-2f438fe5a697 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:07.364874 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af05cfa-fd1b-4b17-a36d-2f438fe5a697 service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:07.365154 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af05cfa-fd1b-4b17-a36d-2f438fe5a697 service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:07.365421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af05cfa-fd1b-4b17-a36d-2f438fe5a697 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:07.430884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af05cfa-fd1b-4b17-a36d-2f438fe5a697 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:07.432635 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af05cfa-fd1b-4b17-a36d-2f438fe5a697 service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:07.442364 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1172/2353] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:04:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:04:07.987478 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05aff1-2dd2-48b0-a1d0-99b2ba078d1f service cinder] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:07.991472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-1a05aff1-2dd2-48b0-a1d0-99b2ba078d1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:08.088815 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05aff1-2dd2-48b0-a1d0-99b2ba078d1f service cinder] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:08.093910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bf512-701a-4ab4-be35-7e038ad2e83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:08.094886 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bf512-701a-4ab4-be35-7e038ad2e83e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:08.095324 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bf512-701a-4ab4-be35-7e038ad2e83e admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:08.095677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bf512-701a-4ab4-be35-7e038ad2e83e admin admin] PATH_INFO: `/v3/users/5bac7a7f945341aeabe47c54960ae203` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:08.097034 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11bf512-701a-4ab4-be35-7e038ad2e83e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bac7a7f945341aeabe47c54960ae203)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:08.099471 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11bf512-701a-4ab4-be35-7e038ad2e83e admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:08.149816 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f11bf512-701a-4ab4-be35-7e038ad2e83e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bac7a7f945341aeabe47c54960ae203'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:08.150483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f11bf512-701a-4ab4-be35-7e038ad2e83e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bac7a7f945341aeabe47c54960ae203'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:08.162031 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f11bf512-701a-4ab4-be35-7e038ad2e83e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bac7a7f945341aeabe47c54960ae203'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:08.170319 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f11bf512-701a-4ab4-be35-7e038ad2e83e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bac7a7f945341aeabe47c54960ae203'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:08.177198 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f11bf512-701a-4ab4-be35-7e038ad2e83e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bac7a7f945341aeabe47c54960ae203'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:08.183939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1182/2354] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:04:07 2022] DELETE /identity/v3/users/5bac7a7f945341aeabe47c54960ae203 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:08.195979 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af05cfa-fd1b-4b17-a36d-2f438fe5a697 service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:08.204356 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af05cfa-fd1b-4b17-a36d-2f438fe5a697 service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:08.253775 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e6c7c-79d4-4157-9ad6-015d1dd9f0df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:08.254447 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e6c7c-79d4-4157-9ad6-015d1dd9f0df service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:08.254725 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e6c7c-79d4-4157-9ad6-015d1dd9f0df service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:08.254993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e6c7c-79d4-4157-9ad6-015d1dd9f0df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:08.256838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-4a9e6c7c-79d4-4157-9ad6-015d1dd9f0df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:08.318580 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e6c7c-79d4-4157-9ad6-015d1dd9f0df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:08.321208 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e6c7c-79d4-4157-9ad6-015d1dd9f0df service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:08.331301 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1173/2355] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:04:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:04:08.356650 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bf512-701a-4ab4-be35-7e038ad2e83e admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:08.358125 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f11bf512-701a-4ab4-be35-7e038ad2e83e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:08.454069 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bf512-701a-4ab4-be35-7e038ad2e83e admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:08.458928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b6300-0a1d-4418-a884-af60fb4347cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:08.459799 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b6300-0a1d-4418-a884-af60fb4347cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:08.460341 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b6300-0a1d-4418-a884-af60fb4347cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:08.460341 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b6300-0a1d-4418-a884-af60fb4347cf admin admin] PATH_INFO: `/v3/projects/a68724f8dee24cd4bcf86653168a16fc` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:08.463648 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b6300-0a1d-4418-a884-af60fb4347cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a68724f8dee24cd4bcf86653168a16fc)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:08.465643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b6300-0a1d-4418-a884-af60fb4347cf admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:08.515254 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-ea8b6300-0a1d-4418-a884-af60fb4347cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a68724f8dee24cd4bcf86653168a16fc', 'request_id': 'req-ea8b6300-0a1d-4418-a884-af60fb4347cf'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:08.521051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-ea8b6300-0a1d-4418-a884-af60fb4347cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a68724f8dee24cd4bcf86653168a16fc', 'request_id': 'req-ea8b6300-0a1d-4418-a884-af60fb4347cf'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:08.527713 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-ea8b6300-0a1d-4418-a884-af60fb4347cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a68724f8dee24cd4bcf86653168a16fc', 'request_id': 'req-ea8b6300-0a1d-4418-a884-af60fb4347cf'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:08.540560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-ea8b6300-0a1d-4418-a884-af60fb4347cf admin admin] The token cache is being invalidate because project a68724f8dee24cd4bcf86653168a16fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:04:08.540849 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-ea8b6300-0a1d-4418-a884-af60fb4347cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:08.541475 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-ea8b6300-0a1d-4418-a884-af60fb4347cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:08.543045 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1183/2356] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:04:08 2022] DELETE /identity/v3/projects/a68724f8dee24cd4bcf86653168a16fc => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:08.547143 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e6c7c-79d4-4157-9ad6-015d1dd9f0df service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:08.558772 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e6c7c-79d4-4157-9ad6-015d1dd9f0df service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:08.618641 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de372930-7ab4-459a-af0e-6c13240e0e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:08.619743 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de372930-7ab4-459a-af0e-6c13240e0e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:08.620279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de372930-7ab4-459a-af0e-6c13240e0e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:08.620629 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de372930-7ab4-459a-af0e-6c13240e0e6f admin admin] PATH_INFO: `/v3/users/f98ac190ae8e4821b6946df324585941` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:08.622026 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de372930-7ab4-459a-af0e-6c13240e0e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f98ac190ae8e4821b6946df324585941)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:08.624107 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de372930-7ab4-459a-af0e-6c13240e0e6f admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:08.676462 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-de372930-7ab4-459a-af0e-6c13240e0e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f98ac190ae8e4821b6946df324585941'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:08.685226 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-de372930-7ab4-459a-af0e-6c13240e0e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f98ac190ae8e4821b6946df324585941'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:08.708139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-de372930-7ab4-459a-af0e-6c13240e0e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f98ac190ae8e4821b6946df324585941'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:08.709153 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-de372930-7ab4-459a-af0e-6c13240e0e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f98ac190ae8e4821b6946df324585941'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:08.709904 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-de372930-7ab4-459a-af0e-6c13240e0e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f98ac190ae8e4821b6946df324585941'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:08.725604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1174/2357] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:04:08 2022] DELETE /identity/v3/users/f98ac190ae8e4821b6946df324585941 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:08.901622 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b6300-0a1d-4418-a884-af60fb4347cf admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:08.903061 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-ea8b6300-0a1d-4418-a884-af60fb4347cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:08.916884 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b6300-0a1d-4418-a884-af60fb4347cf admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:08.953034 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de372930-7ab4-459a-af0e-6c13240e0e6f admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:08.954887 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-de372930-7ab4-459a-af0e-6c13240e0e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:08.974614 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bafd9-8844-48c3-b337-f90f1ed056dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:08.975476 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bafd9-8844-48c3-b337-f90f1ed056dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:08.975756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bafd9-8844-48c3-b337-f90f1ed056dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:08.977083 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bafd9-8844-48c3-b337-f90f1ed056dc admin admin] PATH_INFO: `/v3/projects/28d99142a4fc4b1bba4238e62b5c48dd` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:08.978353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bafd9-8844-48c3-b337-f90f1ed056dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=28d99142a4fc4b1bba4238e62b5c48dd)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:08.980259 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bafd9-8844-48c3-b337-f90f1ed056dc admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:09.022527 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de372930-7ab4-459a-af0e-6c13240e0e6f admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:09.025957 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-313bafd9-8844-48c3-b337-f90f1ed056dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28d99142a4fc4b1bba4238e62b5c48dd', 'request_id': 'req-313bafd9-8844-48c3-b337-f90f1ed056dc'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:09.031307 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-313bafd9-8844-48c3-b337-f90f1ed056dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28d99142a4fc4b1bba4238e62b5c48dd', 'request_id': 'req-313bafd9-8844-48c3-b337-f90f1ed056dc'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:09.037309 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-313bafd9-8844-48c3-b337-f90f1ed056dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28d99142a4fc4b1bba4238e62b5c48dd', 'request_id': 'req-313bafd9-8844-48c3-b337-f90f1ed056dc'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:09.049963 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-313bafd9-8844-48c3-b337-f90f1ed056dc admin admin] The token cache is being invalidate because project 28d99142a4fc4b1bba4238e62b5c48dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:04:09.050504 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-313bafd9-8844-48c3-b337-f90f1ed056dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:09.051135 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-313bafd9-8844-48c3-b337-f90f1ed056dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:09.052730 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1184/2358] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:04:08 2022] DELETE /identity/v3/projects/28d99142a4fc4b1bba4238e62b5c48dd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:09.058496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d30924-0704-4982-90d8-d97fcb0c8b2c None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:09.058784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d30924-0704-4982-90d8-d97fcb0c8b2c None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:09.059064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d30924-0704-4982-90d8-d97fcb0c8b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:09.076939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-11d30924-0704-4982-90d8-d97fcb0c8b2c None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:09.078144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-11d30924-0704-4982-90d8-d97fcb0c8b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:09.078924 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab2ab7-bc87-420e-8de7-35e9615686d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:09.079800 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab2ab7-bc87-420e-8de7-35e9615686d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:09.080135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab2ab7-bc87-420e-8de7-35e9615686d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:09.080445 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab2ab7-bc87-420e-8de7-35e9615686d8 admin admin] PATH_INFO: `/v3/users/3dd1e8dc01b3416e8e78a50372b316e9` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:09.081695 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab2ab7-bc87-420e-8de7-35e9615686d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd1e8dc01b3416e8e78a50372b316e9)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:09.083648 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab2ab7-bc87-420e-8de7-35e9615686d8 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:09.092766 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1185/2359] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:04:09.094315 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa127281-c3e7-4af9-ab47-677d660b0a68 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:09.094602 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa127281-c3e7-4af9-ab47-677d660b0a68 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:09.094877 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa127281-c3e7-4af9-ab47-677d660b0a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:09.113205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-fa127281-c3e7-4af9-ab47-677d660b0a68 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:09.114437 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-fa127281-c3e7-4af9-ab47-677d660b0a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:09.123888 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1186/2360] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:09.127909 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa127281-c3e7-4af9-ab47-677d660b0a68 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:09.135363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0aab2ab7-bc87-420e-8de7-35e9615686d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd1e8dc01b3416e8e78a50372b316e9'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:09.137125 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa127281-c3e7-4af9-ab47-677d660b0a68 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:09.141970 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c63174-9569-48a9-bcf8-5154097ebe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:09.142686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c63174-9569-48a9-bcf8-5154097ebe28 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:09.142997 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c63174-9569-48a9-bcf8-5154097ebe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:09.143271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c63174-9569-48a9-bcf8-5154097ebe28 admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:09.144002 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c63174-9569-48a9-bcf8-5154097ebe28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:04:09.144147 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0aab2ab7-bc87-420e-8de7-35e9615686d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd1e8dc01b3416e8e78a50372b316e9'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:09.144372 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c63174-9569-48a9-bcf8-5154097ebe28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:09.145929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c63174-9569-48a9-bcf8-5154097ebe28 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:09.156973 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0aab2ab7-bc87-420e-8de7-35e9615686d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd1e8dc01b3416e8e78a50372b316e9'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:09.157639 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0aab2ab7-bc87-420e-8de7-35e9615686d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd1e8dc01b3416e8e78a50372b316e9'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:09.161407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1187/2361] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:04:09.161556 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0aab2ab7-bc87-420e-8de7-35e9615686d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd1e8dc01b3416e8e78a50372b316e9'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:09.162687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c63174-9569-48a9-bcf8-5154097ebe28 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:09.164923 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-b8c63174-9569-48a9-bcf8-5154097ebe28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:09.171405 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1175/2362] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:04:08 2022] DELETE /identity/v3/users/3dd1e8dc01b3416e8e78a50372b316e9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:04:09.175665 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21203a12-9ca0-4b02-8974-d3faffba2570 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:09.176011 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21203a12-9ca0-4b02-8974-d3faffba2570 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:09.176287 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21203a12-9ca0-4b02-8974-d3faffba2570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:09.177382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c63174-9569-48a9-bcf8-5154097ebe28 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:09.192824 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-21203a12-9ca0-4b02-8974-d3faffba2570 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:09.194041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-21203a12-9ca0-4b02-8974-d3faffba2570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:09.234150 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962018fb-f30f-4b02-82e8-3d3486b16fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:09.234979 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962018fb-f30f-4b02-82e8-3d3486b16fae admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:09.235264 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962018fb-f30f-4b02-82e8-3d3486b16fae admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:09.235543 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962018fb-f30f-4b02-82e8-3d3486b16fae admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:09.236234 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962018fb-f30f-4b02-82e8-3d3486b16fae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:09.238129 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962018fb-f30f-4b02-82e8-3d3486b16fae admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:09.252899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1176/2363] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:09.262974 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21203a12-9ca0-4b02-8974-d3faffba2570 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:09.264393 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1188/2364] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:04:09 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:04:09.264524 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-21203a12-9ca0-4b02-8974-d3faffba2570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:09.268175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962018fb-f30f-4b02-82e8-3d3486b16fae admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:09.320825 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21203a12-9ca0-4b02-8974-d3faffba2570 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:09.327398 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962018fb-f30f-4b02-82e8-3d3486b16fae admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:09.332060 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f771b65-e6ca-4eef-8331-97c4e1257c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:09.332732 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f771b65-e6ca-4eef-8331-97c4e1257c8a admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:09.333015 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f771b65-e6ca-4eef-8331-97c4e1257c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:09.333291 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f771b65-e6ca-4eef-8331-97c4e1257c8a admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:09.333975 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f771b65-e6ca-4eef-8331-97c4e1257c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:09.336562 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f771b65-e6ca-4eef-8331-97c4e1257c8a admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:09.357762 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1189/2365] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:04:09 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:04:09.361748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f771b65-e6ca-4eef-8331-97c4e1257c8a admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:09.371435 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f771b65-e6ca-4eef-8331-97c4e1257c8a admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:09.373719 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c8f5c-eb0b-4cd6-8532-3d2b20051705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:09.374407 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c8f5c-eb0b-4cd6-8532-3d2b20051705 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:09.374694 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c8f5c-eb0b-4cd6-8532-3d2b20051705 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:09.374968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c8f5c-eb0b-4cd6-8532-3d2b20051705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:09.376127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b305d1-3d08-4814-a221-db1d82afcda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:09.376774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b305d1-3d08-4814-a221-db1d82afcda3 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:09.377061 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b305d1-3d08-4814-a221-db1d82afcda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:09.377336 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b305d1-3d08-4814-a221-db1d82afcda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:09.378057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b305d1-3d08-4814-a221-db1d82afcda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:09.379698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b305d1-3d08-4814-a221-db1d82afcda3 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:09.384874 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c8f5c-eb0b-4cd6-8532-3d2b20051705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:09.386328 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c8f5c-eb0b-4cd6-8532-3d2b20051705 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:09.389866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1190/2366] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:04:09.393670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b305d1-3d08-4814-a221-db1d82afcda3 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:09.399394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1177/2367] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:04:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:04:09.407257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b305d1-3d08-4814-a221-db1d82afcda3 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:09.415006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47281d01-5beb-4e8f-b369-8391e2584056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:09.415983 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47281d01-5beb-4e8f-b369-8391e2584056 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:09.416388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47281d01-5beb-4e8f-b369-8391e2584056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:09.416909 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47281d01-5beb-4e8f-b369-8391e2584056 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:09.417672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47281d01-5beb-4e8f-b369-8391e2584056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:09.419519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47281d01-5beb-4e8f-b369-8391e2584056 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:09.431098 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1191/2368] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:04:09.435056 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c8f5c-eb0b-4cd6-8532-3d2b20051705 service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:09.445288 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c8f5c-eb0b-4cd6-8532-3d2b20051705 service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:09.450209 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57ec7d-3807-4a52-861d-872b3f66258c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:09.451124 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57ec7d-3807-4a52-861d-872b3f66258c admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:09.451404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57ec7d-3807-4a52-861d-872b3f66258c admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:09.451678 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57ec7d-3807-4a52-861d-872b3f66258c admin admin] PATH_INFO: `/v3/projects/a9cb94e930984858b30744fc14ca334e/users/56462e4305424b099473d1e42adab9a9/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:09.467405 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57ec7d-3807-4a52-861d-872b3f66258c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9cb94e930984858b30744fc14ca334e, user_id=56462e4305424b099473d1e42adab9a9, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:09.470106 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57ec7d-3807-4a52-861d-872b3f66258c admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:09.484204 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1178/2369] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:04:09 2022] PUT /identity/v3/projects/a9cb94e930984858b30744fc14ca334e/users/56462e4305424b099473d1e42adab9a9/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:09.489263 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd5e6a-9ed9-42cc-8507-dbc5a003dc82 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:09.489562 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd5e6a-9ed9-42cc-8507-dbc5a003dc82 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:09.490055 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd5e6a-9ed9-42cc-8507-dbc5a003dc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:09.511361 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-8dbd5e6a-9ed9-42cc-8507-dbc5a003dc82 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:09.512590 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-8dbd5e6a-9ed9-42cc-8507-dbc5a003dc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:09.585059 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1192/2370] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:09.595370 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57ec7d-3807-4a52-861d-872b3f66258c admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:09.657212 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57ec7d-3807-4a52-861d-872b3f66258c admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:09.661241 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbb674-85d4-48f4-8e71-f934ad42f342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:09.662375 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbb674-85d4-48f4-8e71-f934ad42f342 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:09.662662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbb674-85d4-48f4-8e71-f934ad42f342 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:09.662943 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbb674-85d4-48f4-8e71-f934ad42f342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:09.674984 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbb674-85d4-48f4-8e71-f934ad42f342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:09.676502 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbb674-85d4-48f4-8e71-f934ad42f342 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:09.690970 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1179/2371] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:04:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:04:09.803388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd5e6a-9ed9-42cc-8507-dbc5a003dc82 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:09.805085 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-8dbd5e6a-9ed9-42cc-8507-dbc5a003dc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:09.821011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd5e6a-9ed9-42cc-8507-dbc5a003dc82 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:09.830312 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723a4f7-f6b0-4432-aa47-b0db750d6c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:09.830312 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723a4f7-f6b0-4432-aa47-b0db750d6c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:09.830312 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723a4f7-f6b0-4432-aa47-b0db750d6c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:09.830646 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723a4f7-f6b0-4432-aa47-b0db750d6c35 admin admin] PATH_INFO: `/v3/projects/44ce7f2d40cc444091bd73777443a0b0` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:09.837472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723a4f7-f6b0-4432-aa47-b0db750d6c35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44ce7f2d40cc444091bd73777443a0b0)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:09.837472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723a4f7-f6b0-4432-aa47-b0db750d6c35 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:09.892684 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1723a4f7-f6b0-4432-aa47-b0db750d6c35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44ce7f2d40cc444091bd73777443a0b0', 'request_id': 'req-1723a4f7-f6b0-4432-aa47-b0db750d6c35'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:09.898162 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1723a4f7-f6b0-4432-aa47-b0db750d6c35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44ce7f2d40cc444091bd73777443a0b0', 'request_id': 'req-1723a4f7-f6b0-4432-aa47-b0db750d6c35'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:09.905153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1723a4f7-f6b0-4432-aa47-b0db750d6c35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44ce7f2d40cc444091bd73777443a0b0', 'request_id': 'req-1723a4f7-f6b0-4432-aa47-b0db750d6c35'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:09.917093 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1723a4f7-f6b0-4432-aa47-b0db750d6c35 admin admin] The token cache is being invalidate because project 44ce7f2d40cc444091bd73777443a0b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:04:09.917414 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1723a4f7-f6b0-4432-aa47-b0db750d6c35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:09.918057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1723a4f7-f6b0-4432-aa47-b0db750d6c35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:09.919642 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1193/2372] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:04:09 2022] DELETE /identity/v3/projects/44ce7f2d40cc444091bd73777443a0b0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:09.924577 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c7027-6817-4d49-a416-7ba5a75de0b8 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:09.924882 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c7027-6817-4d49-a416-7ba5a75de0b8 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:09.925163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c7027-6817-4d49-a416-7ba5a75de0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:09.945705 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-d52c7027-6817-4d49-a416-7ba5a75de0b8 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:09.947173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-d52c7027-6817-4d49-a416-7ba5a75de0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:10.011336 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1180/2373] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:04:10.019512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad437f7-6568-410c-b00f-a0f2af69fc95 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:10.019805 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad437f7-6568-410c-b00f-a0f2af69fc95 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:10.020086 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad437f7-6568-410c-b00f-a0f2af69fc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:10.038705 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-aad437f7-6568-410c-b00f-a0f2af69fc95 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:10.040979 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-aad437f7-6568-410c-b00f-a0f2af69fc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:10.050081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1194/2374] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:10.055736 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c7027-6817-4d49-a416-7ba5a75de0b8 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:10.065319 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c7027-6817-4d49-a416-7ba5a75de0b8 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:10.082090 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945f6f6-c85b-4beb-9512-54c239eb0b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:10.082811 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945f6f6-c85b-4beb-9512-54c239eb0b33 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:10.083098 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945f6f6-c85b-4beb-9512-54c239eb0b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:10.083371 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945f6f6-c85b-4beb-9512-54c239eb0b33 admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:10.084112 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945f6f6-c85b-4beb-9512-54c239eb0b33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:04:10.085037 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945f6f6-c85b-4beb-9512-54c239eb0b33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:10.087462 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945f6f6-c85b-4beb-9512-54c239eb0b33 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:10.101315 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1181/2375] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:04:10.106344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad437f7-6568-410c-b00f-a0f2af69fc95 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:10.116429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad437f7-6568-410c-b00f-a0f2af69fc95 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:10.122417 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b94b1-7994-44ee-9b8b-8cf53df6bcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:10.123242 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b94b1-7994-44ee-9b8b-8cf53df6bcb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:10.123616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b94b1-7994-44ee-9b8b-8cf53df6bcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:10.123999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b94b1-7994-44ee-9b8b-8cf53df6bcb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:10.126007 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b94b1-7994-44ee-9b8b-8cf53df6bcb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:10.128019 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b94b1-7994-44ee-9b8b-8cf53df6bcb3 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:10.184182 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1195/2376] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:04:10 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:04:10.188925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945f6f6-c85b-4beb-9512-54c239eb0b33 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:10.206905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945f6f6-c85b-4beb-9512-54c239eb0b33 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:10.281021 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014820e-02d0-467b-b0b0-e68ff696dc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:10.282108 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014820e-02d0-467b-b0b0-e68ff696dc5c admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:10.282108 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014820e-02d0-467b-b0b0-e68ff696dc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:10.282555 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014820e-02d0-467b-b0b0-e68ff696dc5c admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:10.283426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014820e-02d0-467b-b0b0-e68ff696dc5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:10.285563 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014820e-02d0-467b-b0b0-e68ff696dc5c admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:10.310258 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1182/2377] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:04:10 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:04:10.315210 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b94b1-7994-44ee-9b8b-8cf53df6bcb3 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:10.326737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b94b1-7994-44ee-9b8b-8cf53df6bcb3 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:10.331644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44006e-acec-4dfa-9390-6d1db704e1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:10.332708 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44006e-acec-4dfa-9390-6d1db704e1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:10.332708 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44006e-acec-4dfa-9390-6d1db704e1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:10.333156 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44006e-acec-4dfa-9390-6d1db704e1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:10.333853 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44006e-acec-4dfa-9390-6d1db704e1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:10.336196 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44006e-acec-4dfa-9390-6d1db704e1e2 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:10.351025 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1196/2378] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:04:10.356249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014820e-02d0-467b-b0b0-e68ff696dc5c admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:10.365927 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014820e-02d0-467b-b0b0-e68ff696dc5c admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:10.371750 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35e5f6-71f8-4aac-93fb-60fa952c478c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:10.372412 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35e5f6-71f8-4aac-93fb-60fa952c478c admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:10.372691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35e5f6-71f8-4aac-93fb-60fa952c478c admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:10.372968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35e5f6-71f8-4aac-93fb-60fa952c478c admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:10.373703 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35e5f6-71f8-4aac-93fb-60fa952c478c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:10.375752 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35e5f6-71f8-4aac-93fb-60fa952c478c admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:10.394069 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1183/2379] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:04:10.398260 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44006e-acec-4dfa-9390-6d1db704e1e2 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:10.409213 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44006e-acec-4dfa-9390-6d1db704e1e2 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:10.419373 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef843c-146e-4fd9-bf68-8c5d47ebc09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:10.420290 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef843c-146e-4fd9-bf68-8c5d47ebc09d admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:10.420688 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef843c-146e-4fd9-bf68-8c5d47ebc09d admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:10.421254 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef843c-146e-4fd9-bf68-8c5d47ebc09d admin admin] PATH_INFO: `/v3/projects/0305a36033ca4831b0bcba8a9b3c5a27/users/acdd7d7f383f4399ae863e65b10c4586/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:10.440539 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef843c-146e-4fd9-bf68-8c5d47ebc09d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0305a36033ca4831b0bcba8a9b3c5a27, user_id=acdd7d7f383f4399ae863e65b10c4586, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:10.443200 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef843c-146e-4fd9-bf68-8c5d47ebc09d admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:10.459009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1197/2380] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:04:10 2022] PUT /identity/v3/projects/0305a36033ca4831b0bcba8a9b3c5a27/users/acdd7d7f383f4399ae863e65b10c4586/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:04:10.467523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c9864-6638-4adf-9d19-228765ced053 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:10.467810 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c9864-6638-4adf-9d19-228765ced053 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:10.468096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c9864-6638-4adf-9d19-228765ced053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:10.493704 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-5d9c9864-6638-4adf-9d19-228765ced053 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:10.495022 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-5d9c9864-6638-4adf-9d19-228765ced053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:10.565716 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1184/2381] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:10.597912 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef843c-146e-4fd9-bf68-8c5d47ebc09d admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:10.599937 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-a3ef843c-146e-4fd9-bf68-8c5d47ebc09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:10.663398 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef843c-146e-4fd9-bf68-8c5d47ebc09d admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:10.667939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283add73-7c22-4ae9-b5b2-2f069f96aab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:10.668782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283add73-7c22-4ae9-b5b2-2f069f96aab5 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:10.669340 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283add73-7c22-4ae9-b5b2-2f069f96aab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:10.669864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283add73-7c22-4ae9-b5b2-2f069f96aab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:10.682612 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283add73-7c22-4ae9-b5b2-2f069f96aab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:10.684315 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283add73-7c22-4ae9-b5b2-2f069f96aab5 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:10.695865 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1198/2382] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:04:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:04:11.995954 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d60783-b460-4e5a-b22a-7715f5c10038 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:11.996446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d60783-b460-4e5a-b22a-7715f5c10038 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:11.996547 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d60783-b460-4e5a-b22a-7715f5c10038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:12.032227 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-14d60783-b460-4e5a-b22a-7715f5c10038 None None] MFA Rules not processed for user `acdd7d7f383f4399ae863e65b10c4586`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:12.035358 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-14d60783-b460-4e5a-b22a-7715f5c10038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:12.117461 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1185/2383] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:12.129242 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283add73-7c22-4ae9-b5b2-2f069f96aab5 service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:12.130720 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-283add73-7c22-4ae9-b5b2-2f069f96aab5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:12.261506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283add73-7c22-4ae9-b5b2-2f069f96aab5 service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:12.266248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d225f6d-9560-49dd-97e3-06bedb0f88de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:12.267095 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d225f6d-9560-49dd-97e3-06bedb0f88de service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:12.267646 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d225f6d-9560-49dd-97e3-06bedb0f88de service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:12.268077 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d225f6d-9560-49dd-97e3-06bedb0f88de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:12.282406 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d225f6d-9560-49dd-97e3-06bedb0f88de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:12.284138 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d225f6d-9560-49dd-97e3-06bedb0f88de service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:12.300421 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1199/2384] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:04:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:04:12.472535 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d60783-b460-4e5a-b22a-7715f5c10038 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:12.474181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-14d60783-b460-4e5a-b22a-7715f5c10038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:12.490643 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d60783-b460-4e5a-b22a-7715f5c10038 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:12.495909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982912f-2a52-4f8f-86c9-9a395256a0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:12.497514 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982912f-2a52-4f8f-86c9-9a395256a0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:12.498076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982912f-2a52-4f8f-86c9-9a395256a0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:12.498483 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982912f-2a52-4f8f-86c9-9a395256a0e8 admin admin] PATH_INFO: `/v3/users/d983466891d9427fad8d7eddaca07e01` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:12.499858 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982912f-2a52-4f8f-86c9-9a395256a0e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d983466891d9427fad8d7eddaca07e01)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:12.502141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982912f-2a52-4f8f-86c9-9a395256a0e8 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:12.568144 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-c982912f-2a52-4f8f-86c9-9a395256a0e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd983466891d9427fad8d7eddaca07e01'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:12.580876 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-c982912f-2a52-4f8f-86c9-9a395256a0e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd983466891d9427fad8d7eddaca07e01'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:12.597888 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-c982912f-2a52-4f8f-86c9-9a395256a0e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd983466891d9427fad8d7eddaca07e01'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:12.598857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-c982912f-2a52-4f8f-86c9-9a395256a0e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd983466891d9427fad8d7eddaca07e01'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:12.599620 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-c982912f-2a52-4f8f-86c9-9a395256a0e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd983466891d9427fad8d7eddaca07e01'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:12.615486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1186/2385] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:04:12 2022] DELETE /identity/v3/users/d983466891d9427fad8d7eddaca07e01 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:12.621660 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72296b33-d95c-45fd-b0b4-a96aab48abb5 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:12.622026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72296b33-d95c-45fd-b0b4-a96aab48abb5 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:12.623073 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72296b33-d95c-45fd-b0b4-a96aab48abb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:12.675789 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-72296b33-d95c-45fd-b0b4-a96aab48abb5 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:12.677045 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-72296b33-d95c-45fd-b0b4-a96aab48abb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:12.798952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1200/2386] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:12.810877 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982912f-2a52-4f8f-86c9-9a395256a0e8 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:12.812315 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-c982912f-2a52-4f8f-86c9-9a395256a0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:12.890887 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982912f-2a52-4f8f-86c9-9a395256a0e8 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:12.905779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf18ca-c76c-42c0-856f-f3529d9a6cd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:12.906573 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf18ca-c76c-42c0-856f-f3529d9a6cd4 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:12.907011 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf18ca-c76c-42c0-856f-f3529d9a6cd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:12.907342 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf18ca-c76c-42c0-856f-f3529d9a6cd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:12.924454 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf18ca-c76c-42c0-856f-f3529d9a6cd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:12.926430 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf18ca-c76c-42c0-856f-f3529d9a6cd4 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:12.940085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1187/2387] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:04:13.850397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28d913-7112-4eb6-b1b8-dfe07c014c99 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:13.851804 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28d913-7112-4eb6-b1b8-dfe07c014c99 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:13.852820 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28d913-7112-4eb6-b1b8-dfe07c014c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:13.900705 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-7b28d913-7112-4eb6-b1b8-dfe07c014c99 None None] MFA Rules not processed for user `acdd7d7f383f4399ae863e65b10c4586`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:13.904869 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-7b28d913-7112-4eb6-b1b8-dfe07c014c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:14.064285 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1201/2388] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:14.078260 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf18ca-c76c-42c0-856f-f3529d9a6cd4 service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:14.079755 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-3ecf18ca-c76c-42c0-856f-f3529d9a6cd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:14.111573 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf18ca-c76c-42c0-856f-f3529d9a6cd4 service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:14.145354 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca7c97-ec43-48ac-8578-ed70047fef38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:14.146314 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca7c97-ec43-48ac-8578-ed70047fef38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:14.146592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca7c97-ec43-48ac-8578-ed70047fef38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:14.146870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca7c97-ec43-48ac-8578-ed70047fef38 admin admin] PATH_INFO: `/v3/projects/4d1ec5b2695d45eaa2d1efed5811454e` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:14.155664 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca7c97-ec43-48ac-8578-ed70047fef38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d1ec5b2695d45eaa2d1efed5811454e)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:14.162907 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca7c97-ec43-48ac-8578-ed70047fef38 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:14.292981 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-25ca7c97-ec43-48ac-8578-ed70047fef38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d1ec5b2695d45eaa2d1efed5811454e', 'request_id': 'req-25ca7c97-ec43-48ac-8578-ed70047fef38'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:14.314528 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-25ca7c97-ec43-48ac-8578-ed70047fef38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d1ec5b2695d45eaa2d1efed5811454e', 'request_id': 'req-25ca7c97-ec43-48ac-8578-ed70047fef38'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:14.329295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-25ca7c97-ec43-48ac-8578-ed70047fef38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d1ec5b2695d45eaa2d1efed5811454e', 'request_id': 'req-25ca7c97-ec43-48ac-8578-ed70047fef38'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:14.343937 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-25ca7c97-ec43-48ac-8578-ed70047fef38 admin admin] The token cache is being invalidate because project 4d1ec5b2695d45eaa2d1efed5811454e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:04:14.344234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-25ca7c97-ec43-48ac-8578-ed70047fef38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:14.346139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-25ca7c97-ec43-48ac-8578-ed70047fef38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:14.349033 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1188/2389] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:04:14 2022] DELETE /identity/v3/projects/4d1ec5b2695d45eaa2d1efed5811454e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:14.354554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28d913-7112-4eb6-b1b8-dfe07c014c99 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:14.373450 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28d913-7112-4eb6-b1b8-dfe07c014c99 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:14.537703 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10fcbd-13a2-420a-929f-c19e8c3a2f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:14.538478 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10fcbd-13a2-420a-929f-c19e8c3a2f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:14.540464 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10fcbd-13a2-420a-929f-c19e8c3a2f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:14.540815 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10fcbd-13a2-420a-929f-c19e8c3a2f94 admin admin] PATH_INFO: `/v3/users/5d7255ecee174701952786599d495554` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:14.543202 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10fcbd-13a2-420a-929f-c19e8c3a2f94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d7255ecee174701952786599d495554)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:14.546219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10fcbd-13a2-420a-929f-c19e8c3a2f94 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:14.629590 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6d10fcbd-13a2-420a-929f-c19e8c3a2f94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d7255ecee174701952786599d495554'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:14.634704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6d10fcbd-13a2-420a-929f-c19e8c3a2f94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d7255ecee174701952786599d495554'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:14.660440 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6d10fcbd-13a2-420a-929f-c19e8c3a2f94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d7255ecee174701952786599d495554'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:14.671512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6d10fcbd-13a2-420a-929f-c19e8c3a2f94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d7255ecee174701952786599d495554'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:14.685546 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6d10fcbd-13a2-420a-929f-c19e8c3a2f94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d7255ecee174701952786599d495554'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:14.699440 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1202/2390] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:04:14 2022] DELETE /identity/v3/users/5d7255ecee174701952786599d495554 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:15.250103 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca7c97-ec43-48ac-8578-ed70047fef38 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:15.251669 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-25ca7c97-ec43-48ac-8578-ed70047fef38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:15.276768 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca7c97-ec43-48ac-8578-ed70047fef38 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:15.379704 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78952f9-d658-423d-97e3-d4f0c4bd52c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:15.379704 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78952f9-d658-423d-97e3-d4f0c4bd52c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:15.379704 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78952f9-d658-423d-97e3-d4f0c4bd52c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:15.379704 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78952f9-d658-423d-97e3-d4f0c4bd52c7 admin admin] PATH_INFO: `/v3/projects/6c67429c56284aa09fea76a2fa7c00b4` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:15.380800 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78952f9-d658-423d-97e3-d4f0c4bd52c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c67429c56284aa09fea76a2fa7c00b4)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:15.381437 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78952f9-d658-423d-97e3-d4f0c4bd52c7 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:15.479877 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b78952f9-d658-423d-97e3-d4f0c4bd52c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c67429c56284aa09fea76a2fa7c00b4', 'request_id': 'req-b78952f9-d658-423d-97e3-d4f0c4bd52c7'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:15.488307 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b78952f9-d658-423d-97e3-d4f0c4bd52c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c67429c56284aa09fea76a2fa7c00b4', 'request_id': 'req-b78952f9-d658-423d-97e3-d4f0c4bd52c7'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:15.498187 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b78952f9-d658-423d-97e3-d4f0c4bd52c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c67429c56284aa09fea76a2fa7c00b4', 'request_id': 'req-b78952f9-d658-423d-97e3-d4f0c4bd52c7'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:15.524642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b78952f9-d658-423d-97e3-d4f0c4bd52c7 admin admin] The token cache is being invalidate because project 6c67429c56284aa09fea76a2fa7c00b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:04:15.525306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b78952f9-d658-423d-97e3-d4f0c4bd52c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:15.526362 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b78952f9-d658-423d-97e3-d4f0c4bd52c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:15.527995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1189/2391] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:04:15 2022] DELETE /identity/v3/projects/6c67429c56284aa09fea76a2fa7c00b4 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:15.532051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10fcbd-13a2-420a-929f-c19e8c3a2f94 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:15.534708 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-6d10fcbd-13a2-420a-929f-c19e8c3a2f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:15.548932 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529556a1-abd0-4578-841a-96bda88bdbb5 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:15.551570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529556a1-abd0-4578-841a-96bda88bdbb5 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:15.551706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10fcbd-13a2-420a-929f-c19e8c3a2f94 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:15.552115 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529556a1-abd0-4578-841a-96bda88bdbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:15.597547 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-529556a1-abd0-4578-841a-96bda88bdbb5 None None] MFA Rules not processed for user `686c869be43c40a9b63b3647bf689c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:15.599209 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-529556a1-abd0-4578-841a-96bda88bdbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:15.695538 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a49178-016e-49ed-9af9-6d9d17b8c684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:15.696747 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a49178-016e-49ed-9af9-6d9d17b8c684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:15.697176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a49178-016e-49ed-9af9-6d9d17b8c684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:15.697606 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a49178-016e-49ed-9af9-6d9d17b8c684 admin admin] PATH_INFO: `/v3/users/3934239701844c8da75609aa50cd8ae5` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:15.699125 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1190/2392] 10.222.0.32 () {58 vars in 1009 bytes} [Tue May 10 14:04:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:15.700308 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a49178-016e-49ed-9af9-6d9d17b8c684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3934239701844c8da75609aa50cd8ae5)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:15.702546 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a49178-016e-49ed-9af9-6d9d17b8c684 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:15.777404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529556a1-abd0-4578-841a-96bda88bdbb5 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:15.779347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-529556a1-abd0-4578-841a-96bda88bdbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:15.829382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-39a49178-016e-49ed-9af9-6d9d17b8c684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3934239701844c8da75609aa50cd8ae5'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:15.830260 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-39a49178-016e-49ed-9af9-6d9d17b8c684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3934239701844c8da75609aa50cd8ae5'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:15.870442 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-39a49178-016e-49ed-9af9-6d9d17b8c684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3934239701844c8da75609aa50cd8ae5'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:15.880488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-39a49178-016e-49ed-9af9-6d9d17b8c684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3934239701844c8da75609aa50cd8ae5'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:15.890021 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-39a49178-016e-49ed-9af9-6d9d17b8c684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3934239701844c8da75609aa50cd8ae5'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:15.896883 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1203/2393] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:04:15 2022] DELETE /identity/v3/users/3934239701844c8da75609aa50cd8ae5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:15.930506 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529556a1-abd0-4578-841a-96bda88bdbb5 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:16.098144 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39ce53-aed9-4de0-9aca-6983cad2440c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bbad5318b6417087d7ce6906f8281f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:16.099310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39ce53-aed9-4de0-9aca-6983cad2440c service swift] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:16.099830 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39ce53-aed9-4de0-9aca-6983cad2440c service swift] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:16.100310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39ce53-aed9-4de0-9aca-6983cad2440c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:16.104446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-0c39ce53-aed9-4de0-9aca-6983cad2440c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:16.239434 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39ce53-aed9-4de0-9aca-6983cad2440c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:16.241769 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39ce53-aed9-4de0-9aca-6983cad2440c service swift] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:16.288386 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1191/2394] 10.222.0.32 () {60 vars in 1384 bytes} [Tue May 10 14:04:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 14:04:16.362347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c224a8-888d-44c1-9282-fcd80e3dc082 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:16.362640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c224a8-888d-44c1-9282-fcd80e3dc082 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:16.362919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c224a8-888d-44c1-9282-fcd80e3dc082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:16.420205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-46c224a8-888d-44c1-9282-fcd80e3dc082 None None] MFA Rules not processed for user `56462e4305424b099473d1e42adab9a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:16.424576 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-46c224a8-888d-44c1-9282-fcd80e3dc082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:16.526632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39ce53-aed9-4de0-9aca-6983cad2440c service swift] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:16.529921 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-0c39ce53-aed9-4de0-9aca-6983cad2440c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:16.552987 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1204/2395] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:16.557792 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c224a8-888d-44c1-9282-fcd80e3dc082 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:16.559703 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-46c224a8-888d-44c1-9282-fcd80e3dc082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:16.651565 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c224a8-888d-44c1-9282-fcd80e3dc082 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:16.658518 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dfa0f-a249-40e6-8755-1043210c51cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:16.659486 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dfa0f-a249-40e6-8755-1043210c51cf admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:16.660090 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dfa0f-a249-40e6-8755-1043210c51cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:16.660727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dfa0f-a249-40e6-8755-1043210c51cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:16.664355 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48dfa0f-a249-40e6-8755-1043210c51cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:16.667887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48dfa0f-a249-40e6-8755-1043210c51cf admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:16.732807 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39ce53-aed9-4de0-9aca-6983cad2440c service swift] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:16.739250 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1205/2396] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:04:16 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:04:16.742986 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dfa0f-a249-40e6-8755-1043210c51cf admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:16.745630 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1f9aa-233a-4d22-ae8a-e71ecf3499a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:16.750093 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1f9aa-233a-4d22-ae8a-e71ecf3499a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:16.751244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1f9aa-233a-4d22-ae8a-e71ecf3499a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:16.751610 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1f9aa-233a-4d22-ae8a-e71ecf3499a6 admin admin] PATH_INFO: `/v3/projects/ab03b666bb1d4152a9dac75fbc2c7649` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:16.754633 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1f9aa-233a-4d22-ae8a-e71ecf3499a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab03b666bb1d4152a9dac75fbc2c7649)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:16.759464 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1f9aa-233a-4d22-ae8a-e71ecf3499a6 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:16.871103 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-67b1f9aa-233a-4d22-ae8a-e71ecf3499a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab03b666bb1d4152a9dac75fbc2c7649', 'request_id': 'req-67b1f9aa-233a-4d22-ae8a-e71ecf3499a6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:16.881899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-67b1f9aa-233a-4d22-ae8a-e71ecf3499a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab03b666bb1d4152a9dac75fbc2c7649', 'request_id': 'req-67b1f9aa-233a-4d22-ae8a-e71ecf3499a6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:16.892497 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-67b1f9aa-233a-4d22-ae8a-e71ecf3499a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab03b666bb1d4152a9dac75fbc2c7649', 'request_id': 'req-67b1f9aa-233a-4d22-ae8a-e71ecf3499a6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:16.903945 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dfa0f-a249-40e6-8755-1043210c51cf admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:16.908796 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-67b1f9aa-233a-4d22-ae8a-e71ecf3499a6 admin admin] The token cache is being invalidate because project ab03b666bb1d4152a9dac75fbc2c7649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:04:16.909138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-67b1f9aa-233a-4d22-ae8a-e71ecf3499a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:16.911639 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-67b1f9aa-233a-4d22-ae8a-e71ecf3499a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:16.913289 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1192/2397] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:04:16 2022] DELETE /identity/v3/projects/ab03b666bb1d4152a9dac75fbc2c7649 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:17.029317 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15163471-a6e6-420f-8002-73401280a2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:17.030414 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15163471-a6e6-420f-8002-73401280a2be admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:17.030707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15163471-a6e6-420f-8002-73401280a2be admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:17.030989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15163471-a6e6-420f-8002-73401280a2be admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:17.031706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15163471-a6e6-420f-8002-73401280a2be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:17.036908 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15163471-a6e6-420f-8002-73401280a2be admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:17.073306 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1206/2398] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:04:16 2022] POST /identity/v3/users => generated 293 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:04:17.077136 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1f9aa-233a-4d22-ae8a-e71ecf3499a6 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:17.079979 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-67b1f9aa-233a-4d22-ae8a-e71ecf3499a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:17.109164 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1f9aa-233a-4d22-ae8a-e71ecf3499a6 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:17.121524 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fec539-b836-4e12-8cc0-d67293fe3210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:17.122422 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fec539-b836-4e12-8cc0-d67293fe3210 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:17.122777 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fec539-b836-4e12-8cc0-d67293fe3210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:17.122988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fec539-b836-4e12-8cc0-d67293fe3210 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:17.123740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fec539-b836-4e12-8cc0-d67293fe3210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:17.125635 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fec539-b836-4e12-8cc0-d67293fe3210 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:17.142356 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1193/2399] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:04:17.146110 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15163471-a6e6-420f-8002-73401280a2be admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:17.157820 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15163471-a6e6-420f-8002-73401280a2be admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:17.164233 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71afed77-9d4e-48eb-8771-3b38c7571e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:17.165291 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afed77-9d4e-48eb-8771-3b38c7571e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:17.165662 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afed77-9d4e-48eb-8771-3b38c7571e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:17.166011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afed77-9d4e-48eb-8771-3b38c7571e5f admin admin] PATH_INFO: `/v3/projects/de140ca886ac4b7295154e2dcb211894/users/39fb9668f1da460b9dc11cb8ffd94c25/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:17.185396 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71afed77-9d4e-48eb-8771-3b38c7571e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=de140ca886ac4b7295154e2dcb211894, user_id=39fb9668f1da460b9dc11cb8ffd94c25, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:17.190579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71afed77-9d4e-48eb-8771-3b38c7571e5f admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:17.216189 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1207/2400] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:04:17 2022] PUT /identity/v3/projects/de140ca886ac4b7295154e2dcb211894/users/39fb9668f1da460b9dc11cb8ffd94c25/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:04:17.220730 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fec539-b836-4e12-8cc0-d67293fe3210 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:17.236500 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fec539-b836-4e12-8cc0-d67293fe3210 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:17.327280 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b0bc9-1804-47e9-9c8a-55d84170f239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:17.328656 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b0bc9-1804-47e9-9c8a-55d84170f239 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:17.329098 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b0bc9-1804-47e9-9c8a-55d84170f239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:17.329682 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b0bc9-1804-47e9-9c8a-55d84170f239 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:17.330830 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b0bc9-1804-47e9-9c8a-55d84170f239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:17.333019 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b0bc9-1804-47e9-9c8a-55d84170f239 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:17.348782 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1194/2401] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:04:17.354645 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71afed77-9d4e-48eb-8771-3b38c7571e5f admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:17.366390 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71afed77-9d4e-48eb-8771-3b38c7571e5f admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:17.370644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d70aa7-3810-4e84-9251-e0285c35000c None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:17.370870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d70aa7-3810-4e84-9251-e0285c35000c None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:17.371141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d70aa7-3810-4e84-9251-e0285c35000c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:17.380867 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094de2a-8aa7-490e-b79e-76805b4bb6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:17.381771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094de2a-8aa7-490e-b79e-76805b4bb6b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:17.385628 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094de2a-8aa7-490e-b79e-76805b4bb6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:17.385957 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094de2a-8aa7-490e-b79e-76805b4bb6b3 admin admin] PATH_INFO: `/v3/projects/de140ca886ac4b7295154e2dcb211894/users/39fb9668f1da460b9dc11cb8ffd94c25/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:17.388375 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094de2a-8aa7-490e-b79e-76805b4bb6b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de140ca886ac4b7295154e2dcb211894, user_id=39fb9668f1da460b9dc11cb8ffd94c25, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:17.402500 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-e0d70aa7-3810-4e84-9251-e0285c35000c None None] MFA Rules not processed for user `686c869be43c40a9b63b3647bf689c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:17.404920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-e0d70aa7-3810-4e84-9251-e0285c35000c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:17.405544 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094de2a-8aa7-490e-b79e-76805b4bb6b3 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:17.437308 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1208/2402] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:04:17 2022] PUT /identity/v3/projects/de140ca886ac4b7295154e2dcb211894/users/39fb9668f1da460b9dc11cb8ffd94c25/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:17.507074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1195/2403] 10.222.0.32 () {58 vars in 967 bytes} [Tue May 10 14:04:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:17.521282 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094de2a-8aa7-490e-b79e-76805b4bb6b3 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:17.524130 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-d094de2a-8aa7-490e-b79e-76805b4bb6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:17.611131 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094de2a-8aa7-490e-b79e-76805b4bb6b3 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:17.619889 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf6776-fde9-4474-85d2-e6f0495731b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bbad5318b6417087d7ce6906f8281f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:17.621000 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf6776-fde9-4474-85d2-e6f0495731b2 service swift] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:17.621535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf6776-fde9-4474-85d2-e6f0495731b2 service swift] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:17.622019 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf6776-fde9-4474-85d2-e6f0495731b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:17.702952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf6776-fde9-4474-85d2-e6f0495731b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:17.704753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf6776-fde9-4474-85d2-e6f0495731b2 service swift] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:17.717759 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1209/2404] 10.222.0.32 () {60 vars in 1384 bytes} [Tue May 10 14:04:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:04:18.108334 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedbf19-1016-4c36-8712-219f3e9c2249 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:18.108702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedbf19-1016-4c36-8712-219f3e9c2249 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:18.109411 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedbf19-1016-4c36-8712-219f3e9c2249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:18.145311 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-4aedbf19-1016-4c36-8712-219f3e9c2249 None None] MFA Rules not processed for user `686c869be43c40a9b63b3647bf689c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:18.147616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-4aedbf19-1016-4c36-8712-219f3e9c2249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:18.171917 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1196/2405] 10.222.0.32 () {58 vars in 1009 bytes} [Tue May 10 14:04:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:18.193767 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf6776-fde9-4474-85d2-e6f0495731b2 service swift] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:18.207478 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf6776-fde9-4474-85d2-e6f0495731b2 service swift] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:18.214788 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564cdc5-6c68-4bac-91bf-4eb7807c4435 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bbad5318b6417087d7ce6906f8281f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:18.215752 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564cdc5-6c68-4bac-91bf-4eb7807c4435 service swift] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:18.216068 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564cdc5-6c68-4bac-91bf-4eb7807c4435 service swift] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:18.216401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564cdc5-6c68-4bac-91bf-4eb7807c4435 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:18.228911 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564cdc5-6c68-4bac-91bf-4eb7807c4435 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:18.230822 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564cdc5-6c68-4bac-91bf-4eb7807c4435 service swift] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:18.240333 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1210/2406] 10.222.0.32 () {60 vars in 1384 bytes} [Tue May 10 14:04:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:04:18.890489 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6a76-35b2-425e-bfa2-e5a50e846840 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:18.892570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6a76-35b2-425e-bfa2-e5a50e846840 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:18.893049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6a76-35b2-425e-bfa2-e5a50e846840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:18.948168 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-bf0d6a76-35b2-425e-bfa2-e5a50e846840 None None] MFA Rules not processed for user `686c869be43c40a9b63b3647bf689c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:18.949973 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-bf0d6a76-35b2-425e-bfa2-e5a50e846840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:18.971819 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1197/2407] 10.222.0.32 () {58 vars in 967 bytes} [Tue May 10 14:04:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:18.978749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564cdc5-6c68-4bac-91bf-4eb7807c4435 service swift] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:18.994479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564cdc5-6c68-4bac-91bf-4eb7807c4435 service swift] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:19.023546 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672dcd1f-3409-47e4-9a32-b8c7cdc38619 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bbad5318b6417087d7ce6906f8281f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:19.024321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672dcd1f-3409-47e4-9a32-b8c7cdc38619 service swift] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:19.024681 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672dcd1f-3409-47e4-9a32-b8c7cdc38619 service swift] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:19.025024 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672dcd1f-3409-47e4-9a32-b8c7cdc38619 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:19.043521 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672dcd1f-3409-47e4-9a32-b8c7cdc38619 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:19.045547 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672dcd1f-3409-47e4-9a32-b8c7cdc38619 service swift] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:19.057195 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1211/2408] 10.222.0.32 () {60 vars in 1384 bytes} [Tue May 10 14:04:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:04:19.100067 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ba4c0-d7e1-4fd5-b64c-249136a7fd8f None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:19.101014 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ba4c0-d7e1-4fd5-b64c-249136a7fd8f None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:19.102176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ba4c0-d7e1-4fd5-b64c-249136a7fd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:19.142272 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-bd3ba4c0-d7e1-4fd5-b64c-249136a7fd8f None None] MFA Rules not processed for user `1897b88622664ceca4deac5a22079726`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:19.145377 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-bd3ba4c0-d7e1-4fd5-b64c-249136a7fd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:19.263924 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1198/2409] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:21.749383 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672dcd1f-3409-47e4-9a32-b8c7cdc38619 service swift] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:21.752192 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-672dcd1f-3409-47e4-9a32-b8c7cdc38619 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:21.861429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672dcd1f-3409-47e4-9a32-b8c7cdc38619 service swift] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:21.871783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14c7ea-615d-49ef-bb84-750e7296dabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:21.873955 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14c7ea-615d-49ef-bb84-750e7296dabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:21.874735 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14c7ea-615d-49ef-bb84-750e7296dabc admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:21.876748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14c7ea-615d-49ef-bb84-750e7296dabc admin admin] PATH_INFO: `/v3/users/be7c03d9578b4f0780299706f5405532` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:21.879173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14c7ea-615d-49ef-bb84-750e7296dabc admin admin] RBAC: Authorizing `identity:delete_user(user_id=be7c03d9578b4f0780299706f5405532)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:21.881153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14c7ea-615d-49ef-bb84-750e7296dabc admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:21.981418 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0f14c7ea-615d-49ef-bb84-750e7296dabc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be7c03d9578b4f0780299706f5405532'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:21.994758 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0f14c7ea-615d-49ef-bb84-750e7296dabc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be7c03d9578b4f0780299706f5405532'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:22.009643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0f14c7ea-615d-49ef-bb84-750e7296dabc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be7c03d9578b4f0780299706f5405532'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:22.022093 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0f14c7ea-615d-49ef-bb84-750e7296dabc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be7c03d9578b4f0780299706f5405532'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:22.041180 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0f14c7ea-615d-49ef-bb84-750e7296dabc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be7c03d9578b4f0780299706f5405532'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:22.050870 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1212/2410] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:04:21 2022] DELETE /identity/v3/users/be7c03d9578b4f0780299706f5405532 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:22.054636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038d392-f268-4fff-aff8-42686ef32add None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:22.055060 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038d392-f268-4fff-aff8-42686ef32add None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:22.055186 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038d392-f268-4fff-aff8-42686ef32add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:22.081974 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-8038d392-f268-4fff-aff8-42686ef32add None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:22.083413 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-8038d392-f268-4fff-aff8-42686ef32add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:22.210242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1199/2411] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:22.220444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14c7ea-615d-49ef-bb84-750e7296dabc admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:22.222286 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-0f14c7ea-615d-49ef-bb84-750e7296dabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:22.306059 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14c7ea-615d-49ef-bb84-750e7296dabc admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:22.310596 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a0c68-8082-4123-8659-01bd5d75b196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:22.312666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a0c68-8082-4123-8659-01bd5d75b196 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:22.312953 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a0c68-8082-4123-8659-01bd5d75b196 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:22.313369 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a0c68-8082-4123-8659-01bd5d75b196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:22.327497 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a0c68-8082-4123-8659-01bd5d75b196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:22.329112 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a0c68-8082-4123-8659-01bd5d75b196 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:22.349966 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1213/2412] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:04:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:04:22.590088 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038d392-f268-4fff-aff8-42686ef32add None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:22.594094 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-8038d392-f268-4fff-aff8-42686ef32add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:22.614015 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038d392-f268-4fff-aff8-42686ef32add None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:22.620325 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca577b-759b-47aa-90bf-bd01bf3f483b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:22.627588 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca577b-759b-47aa-90bf-bd01bf3f483b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:22.627913 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca577b-759b-47aa-90bf-bd01bf3f483b admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:22.628190 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca577b-759b-47aa-90bf-bd01bf3f483b admin admin] PATH_INFO: `/v3/projects/f7151edbac0840dd801f21d540b05126` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:22.633911 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca577b-759b-47aa-90bf-bd01bf3f483b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7151edbac0840dd801f21d540b05126)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:22.636166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca577b-759b-47aa-90bf-bd01bf3f483b admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:22.722943 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-fcca577b-759b-47aa-90bf-bd01bf3f483b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7151edbac0840dd801f21d540b05126', 'request_id': 'req-fcca577b-759b-47aa-90bf-bd01bf3f483b'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:22.739096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-fcca577b-759b-47aa-90bf-bd01bf3f483b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7151edbac0840dd801f21d540b05126', 'request_id': 'req-fcca577b-759b-47aa-90bf-bd01bf3f483b'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:22.754416 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-fcca577b-759b-47aa-90bf-bd01bf3f483b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7151edbac0840dd801f21d540b05126', 'request_id': 'req-fcca577b-759b-47aa-90bf-bd01bf3f483b'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:22.774818 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-fcca577b-759b-47aa-90bf-bd01bf3f483b admin admin] The token cache is being invalidate because project f7151edbac0840dd801f21d540b05126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:04:22.775352 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-fcca577b-759b-47aa-90bf-bd01bf3f483b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:22.776307 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-fcca577b-759b-47aa-90bf-bd01bf3f483b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:22.779402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1200/2413] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:04:22 2022] DELETE /identity/v3/projects/f7151edbac0840dd801f21d540b05126 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:22.783295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f061aea-d9c3-4d58-8c6f-b365732a24f9 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:22.783811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f061aea-d9c3-4d58-8c6f-b365732a24f9 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:22.783895 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f061aea-d9c3-4d58-8c6f-b365732a24f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:22.816178 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-9f061aea-d9c3-4d58-8c6f-b365732a24f9 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:22.822853 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-9f061aea-d9c3-4d58-8c6f-b365732a24f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:22.979152 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1214/2414] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:04:22.986574 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb2ce0-0ca4-4344-ba28-1e7719ab49f1 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:22.987318 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb2ce0-0ca4-4344-ba28-1e7719ab49f1 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:22.987318 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb2ce0-0ca4-4344-ba28-1e7719ab49f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:23.014478 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-49cb2ce0-0ca4-4344-ba28-1e7719ab49f1 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:23.015719 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-49cb2ce0-0ca4-4344-ba28-1e7719ab49f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:23.037437 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1201/2415] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:04:23.039455 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f061aea-d9c3-4d58-8c6f-b365732a24f9 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:23.051175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f061aea-d9c3-4d58-8c6f-b365732a24f9 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:23.060241 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eec60-d4ef-41a7-8e6e-47a67e972048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:23.061560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eec60-d4ef-41a7-8e6e-47a67e972048 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:23.061560 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eec60-d4ef-41a7-8e6e-47a67e972048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:23.061795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eec60-d4ef-41a7-8e6e-47a67e972048 admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:23.063101 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934eec60-d4ef-41a7-8e6e-47a67e972048 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:04:23.063486 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934eec60-d4ef-41a7-8e6e-47a67e972048 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:23.067149 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934eec60-d4ef-41a7-8e6e-47a67e972048 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:23.086429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1215/2416] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:04:23.090362 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb2ce0-0ca4-4344-ba28-1e7719ab49f1 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:23.104112 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb2ce0-0ca4-4344-ba28-1e7719ab49f1 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:23.109646 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8503d-f610-422a-b418-513a815035b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:23.111266 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8503d-f610-422a-b418-513a815035b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:23.111720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8503d-f610-422a-b418-513a815035b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:23.112311 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8503d-f610-422a-b418-513a815035b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:23.113177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8503d-f610-422a-b418-513a815035b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:23.115288 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8503d-f610-422a-b418-513a815035b3 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:23.148854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1202/2417] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:04:23 2022] POST /identity/v3/projects => generated 391 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:04:23.153362 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eec60-d4ef-41a7-8e6e-47a67e972048 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:23.166700 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eec60-d4ef-41a7-8e6e-47a67e972048 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:23.245630 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ae705-1d93-498a-be24-8a765e06d399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:23.246812 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ae705-1d93-498a-be24-8a765e06d399 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:23.246812 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ae705-1d93-498a-be24-8a765e06d399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:23.250478 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ae705-1d93-498a-be24-8a765e06d399 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:23.252028 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ae705-1d93-498a-be24-8a765e06d399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:23.254062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ae705-1d93-498a-be24-8a765e06d399 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:23.278679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1216/2418] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:04:23 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:04:23.282702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8503d-f610-422a-b418-513a815035b3 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:23.293726 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8503d-f610-422a-b418-513a815035b3 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:23.299401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247e2fb-6818-4ac0-875e-7f53a7a60e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:23.299654 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247e2fb-6818-4ac0-875e-7f53a7a60e52 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:23.299955 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247e2fb-6818-4ac0-875e-7f53a7a60e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:23.300225 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247e2fb-6818-4ac0-875e-7f53a7a60e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:23.301011 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247e2fb-6818-4ac0-875e-7f53a7a60e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:23.302578 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247e2fb-6818-4ac0-875e-7f53a7a60e52 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:23.317830 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1203/2419] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:04:23.319028 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ae705-1d93-498a-be24-8a765e06d399 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:23.330239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ae705-1d93-498a-be24-8a765e06d399 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:23.336454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1d1b5-5e94-4c04-9d92-ee730aed2ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:23.337433 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1d1b5-5e94-4c04-9d92-ee730aed2ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:23.337830 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1d1b5-5e94-4c04-9d92-ee730aed2ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:23.338228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1d1b5-5e94-4c04-9d92-ee730aed2ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:23.339175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1d1b5-5e94-4c04-9d92-ee730aed2ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:23.340893 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1d1b5-5e94-4c04-9d92-ee730aed2ef8 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:23.357050 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1217/2420] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:04:23.362132 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247e2fb-6818-4ac0-875e-7f53a7a60e52 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:23.375729 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247e2fb-6818-4ac0-875e-7f53a7a60e52 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:23.383167 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a927a1c-2c21-4167-a45a-5a950d50a5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:23.384443 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a927a1c-2c21-4167-a45a-5a950d50a5f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:23.384830 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a927a1c-2c21-4167-a45a-5a950d50a5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:23.385205 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a927a1c-2c21-4167-a45a-5a950d50a5f4 admin admin] PATH_INFO: `/v3/projects/7a71e8149c544516a7983d6a1fafbf49/users/64c3e4a5dfb342a784ab54f71462753a/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:23.409111 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a927a1c-2c21-4167-a45a-5a950d50a5f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a71e8149c544516a7983d6a1fafbf49, user_id=64c3e4a5dfb342a784ab54f71462753a, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:23.413038 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a927a1c-2c21-4167-a45a-5a950d50a5f4 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:23.434313 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1204/2421] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:04:23 2022] PUT /identity/v3/projects/7a71e8149c544516a7983d6a1fafbf49/users/64c3e4a5dfb342a784ab54f71462753a/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:23.446398 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad90109-2359-42b7-8fe2-f1b8ed0d64b9 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:23.446850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad90109-2359-42b7-8fe2-f1b8ed0d64b9 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:23.447255 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad90109-2359-42b7-8fe2-f1b8ed0d64b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:23.484073 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-3ad90109-2359-42b7-8fe2-f1b8ed0d64b9 None None] MFA Rules not processed for user `64c3e4a5dfb342a784ab54f71462753a`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:23.486049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-3ad90109-2359-42b7-8fe2-f1b8ed0d64b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:23.645559 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1218/2422] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:23.659425 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a927a1c-2c21-4167-a45a-5a950d50a5f4 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:23.661224 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-5a927a1c-2c21-4167-a45a-5a950d50a5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:23.766334 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a927a1c-2c21-4167-a45a-5a950d50a5f4 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:23.770189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0538c-6d5c-4464-bff4-b590569003aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:23.770919 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0538c-6d5c-4464-bff4-b590569003aa service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:23.771195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0538c-6d5c-4464-bff4-b590569003aa service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:23.771468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0538c-6d5c-4464-bff4-b590569003aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:23.783936 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0538c-6d5c-4464-bff4-b590569003aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:23.786322 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0538c-6d5c-4464-bff4-b590569003aa service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:23.801483 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1205/2423] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:04:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:04:24.689462 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d23cf-d0fb-4756-8901-d5cc6654b8a2 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:24.690449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d23cf-d0fb-4756-8901-d5cc6654b8a2 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:24.691049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d23cf-d0fb-4756-8901-d5cc6654b8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:24.723574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-ab5d23cf-d0fb-4756-8901-d5cc6654b8a2 None None] MFA Rules not processed for user `39fb9668f1da460b9dc11cb8ffd94c25`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:24.725149 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-ab5d23cf-d0fb-4756-8901-d5cc6654b8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:24.812090 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1219/2424] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:24.825795 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0538c-6d5c-4464-bff4-b590569003aa service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:24.827367 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-eba0538c-6d5c-4464-bff4-b590569003aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:24.924435 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0538c-6d5c-4464-bff4-b590569003aa service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:24.932330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d56358-3693-4035-b70d-4b55ecea4fa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:24.933215 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d56358-3693-4035-b70d-4b55ecea4fa7 service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:24.933630 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d56358-3693-4035-b70d-4b55ecea4fa7 service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:24.933905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d56358-3693-4035-b70d-4b55ecea4fa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:24.935747 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-97d56358-3693-4035-b70d-4b55ecea4fa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:24.998675 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d56358-3693-4035-b70d-4b55ecea4fa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:25.000312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d56358-3693-4035-b70d-4b55ecea4fa7 service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:25.011942 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1206/2425] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:04:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:04:26.543303 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3358370-03dd-40af-8d5f-ba098ed58ccd None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:26.543990 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3358370-03dd-40af-8d5f-ba098ed58ccd None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:26.543990 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3358370-03dd-40af-8d5f-ba098ed58ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:26.562783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-a3358370-03dd-40af-8d5f-ba098ed58ccd None None] MFA Rules not processed for user `56462e4305424b099473d1e42adab9a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:26.563996 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-a3358370-03dd-40af-8d5f-ba098ed58ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:26.571955 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1220/2426] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:04:49.075554 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d56358-3693-4035-b70d-4b55ecea4fa7 service nova] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:49.077017 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-97d56358-3693-4035-b70d-4b55ecea4fa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:49.175626 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d56358-3693-4035-b70d-4b55ecea4fa7 service nova] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:49.184588 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9e12a-bee1-43b0-947c-16a4a072b329 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4859a69a988a4b10b67187553d829b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:49.185331 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9e12a-bee1-43b0-947c-16a4a072b329 service placement] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:49.185708 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9e12a-bee1-43b0-947c-16a4a072b329 service placement] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:49.186051 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9e12a-bee1-43b0-947c-16a4a072b329 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:49.188243 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-51f9e12a-bee1-43b0-947c-16a4a072b329 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:49.201486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9e12a-bee1-43b0-947c-16a4a072b329 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:49.203345 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9e12a-bee1-43b0-947c-16a4a072b329 service placement] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:49.221768 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1207/2427] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:04:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:04:51.541593 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3358370-03dd-40af-8d5f-ba098ed58ccd None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:51.607864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3358370-03dd-40af-8d5f-ba098ed58ccd None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:51.614239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68970544-f3c9-445c-abc8-5adc9e349c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:51.615120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68970544-f3c9-445c-abc8-5adc9e349c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:51.615391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68970544-f3c9-445c-abc8-5adc9e349c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:51.615664 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68970544-f3c9-445c-abc8-5adc9e349c66 admin admin] PATH_INFO: `/v3/users/64c3e4a5dfb342a784ab54f71462753a` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:51.616872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68970544-f3c9-445c-abc8-5adc9e349c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64c3e4a5dfb342a784ab54f71462753a)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:51.619366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68970544-f3c9-445c-abc8-5adc9e349c66 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:51.666402 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-68970544-f3c9-445c-abc8-5adc9e349c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64c3e4a5dfb342a784ab54f71462753a'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:51.667055 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-68970544-f3c9-445c-abc8-5adc9e349c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64c3e4a5dfb342a784ab54f71462753a'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:51.679484 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-68970544-f3c9-445c-abc8-5adc9e349c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64c3e4a5dfb342a784ab54f71462753a'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:51.688025 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-68970544-f3c9-445c-abc8-5adc9e349c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64c3e4a5dfb342a784ab54f71462753a'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:51.694625 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-68970544-f3c9-445c-abc8-5adc9e349c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64c3e4a5dfb342a784ab54f71462753a'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:51.701122 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1221/2428] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:04:51 2022] DELETE /identity/v3/users/64c3e4a5dfb342a784ab54f71462753a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:51.705608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d62c4-aa71-4664-8cd5-d20381b4bad1 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:51.706093 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d62c4-aa71-4664-8cd5-d20381b4bad1 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:51.706290 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d62c4-aa71-4664-8cd5-d20381b4bad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:51.724909 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-ac3d62c4-aa71-4664-8cd5-d20381b4bad1 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:51.726090 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-ac3d62c4-aa71-4664-8cd5-d20381b4bad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:51.784297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1208/2429] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:51.793915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68970544-f3c9-445c-abc8-5adc9e349c66 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:51.795352 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-68970544-f3c9-445c-abc8-5adc9e349c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:51.852035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68970544-f3c9-445c-abc8-5adc9e349c66 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:51.855972 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9f078-99a0-422e-8ee2-3f8f09537420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:51.856719 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9f078-99a0-422e-8ee2-3f8f09537420 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:51.857004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9f078-99a0-422e-8ee2-3f8f09537420 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:51.857279 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9f078-99a0-422e-8ee2-3f8f09537420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:51.870286 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9f078-99a0-422e-8ee2-3f8f09537420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:51.871814 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9f078-99a0-422e-8ee2-3f8f09537420 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:51.881878 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1222/2430] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:04:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:04:52.148041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d62c4-aa71-4664-8cd5-d20381b4bad1 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:52.149798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-ac3d62c4-aa71-4664-8cd5-d20381b4bad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:52.162341 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d62c4-aa71-4664-8cd5-d20381b4bad1 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:52.175483 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606121d-6522-445d-a3b1-b8592499c623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:52.176755 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606121d-6522-445d-a3b1-b8592499c623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:52.177041 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606121d-6522-445d-a3b1-b8592499c623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:52.177342 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606121d-6522-445d-a3b1-b8592499c623 admin admin] PATH_INFO: `/v3/projects/7a71e8149c544516a7983d6a1fafbf49` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:52.178587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606121d-6522-445d-a3b1-b8592499c623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a71e8149c544516a7983d6a1fafbf49)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:52.181245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606121d-6522-445d-a3b1-b8592499c623 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:52.227980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2606121d-6522-445d-a3b1-b8592499c623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a71e8149c544516a7983d6a1fafbf49', 'request_id': 'req-2606121d-6522-445d-a3b1-b8592499c623'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:52.234293 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2606121d-6522-445d-a3b1-b8592499c623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a71e8149c544516a7983d6a1fafbf49', 'request_id': 'req-2606121d-6522-445d-a3b1-b8592499c623'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:52.240551 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2606121d-6522-445d-a3b1-b8592499c623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a71e8149c544516a7983d6a1fafbf49', 'request_id': 'req-2606121d-6522-445d-a3b1-b8592499c623'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:52.253487 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2606121d-6522-445d-a3b1-b8592499c623 admin admin] The token cache is being invalidate because project 7a71e8149c544516a7983d6a1fafbf49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:04:52.253776 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2606121d-6522-445d-a3b1-b8592499c623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:52.254423 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2606121d-6522-445d-a3b1-b8592499c623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:52.256090 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1209/2431] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:04:52 2022] DELETE /identity/v3/projects/7a71e8149c544516a7983d6a1fafbf49 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:17.317901 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9f078-99a0-422e-8ee2-3f8f09537420 service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:17.319349 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-b2f9f078-99a0-422e-8ee2-3f8f09537420 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:17.331061 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9f078-99a0-422e-8ee2-3f8f09537420 service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:17.379078 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4229b5f-5c0c-40ae-a8a7-9c660e7a8dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:17.379732 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4229b5f-5c0c-40ae-a8a7-9c660e7a8dba service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:17.380111 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4229b5f-5c0c-40ae-a8a7-9c660e7a8dba service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:17.380276 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4229b5f-5c0c-40ae-a8a7-9c660e7a8dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:17.382088 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-b4229b5f-5c0c-40ae-a8a7-9c660e7a8dba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:17.444032 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4229b5f-5c0c-40ae-a8a7-9c660e7a8dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:17.445484 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4229b5f-5c0c-40ae-a8a7-9c660e7a8dba service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:17.455769 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1223/2432] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:05:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:05:20.549857 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894e03c-9954-4ab1-acb8-070284ba4b0d None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:20.550418 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894e03c-9954-4ab1-acb8-070284ba4b0d None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:20.550418 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894e03c-9954-4ab1-acb8-070284ba4b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:20.567901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-4894e03c-9954-4ab1-acb8-070284ba4b0d None None] MFA Rules not processed for user `c98a5fc7863942c5b389aa9766d31129`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:20.569093 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-4894e03c-9954-4ab1-acb8-070284ba4b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:20.622554 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1210/2433] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:05:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:03.761168 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fc0d0-6a1b-4d6c-9cb2-6985fefee145 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:03.761666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fc0d0-6a1b-4d6c-9cb2-6985fefee145 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:03.761766 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fc0d0-6a1b-4d6c-9cb2-6985fefee145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:03.778916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-303fc0d0-6a1b-4d6c-9cb2-6985fefee145 None None] MFA Rules not processed for user `acdd7d7f383f4399ae863e65b10c4586`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:03.780104 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-303fc0d0-6a1b-4d6c-9cb2-6985fefee145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:03.833370 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1224/2434] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:06:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:40.157025 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894e03c-9954-4ab1-acb8-070284ba4b0d None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:40.158448 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-4894e03c-9954-4ab1-acb8-070284ba4b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:40.217967 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894e03c-9954-4ab1-acb8-070284ba4b0d None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:40.221692 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6006ad-ead3-4ecd-a96f-08de10ee5fbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:40.222384 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6006ad-ead3-4ecd-a96f-08de10ee5fbb service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:40.222659 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6006ad-ead3-4ecd-a96f-08de10ee5fbb service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:40.222929 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6006ad-ead3-4ecd-a96f-08de10ee5fbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:40.224693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-5d6006ad-ead3-4ecd-a96f-08de10ee5fbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:40.301246 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6006ad-ead3-4ecd-a96f-08de10ee5fbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:40.302732 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6006ad-ead3-4ecd-a96f-08de10ee5fbb service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:40.315098 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1211/2435] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:06:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:06:45.094340 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fc0d0-6a1b-4d6c-9cb2-6985fefee145 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:45.095769 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-303fc0d0-6a1b-4d6c-9cb2-6985fefee145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:45.108013 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fc0d0-6a1b-4d6c-9cb2-6985fefee145 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:45.111561 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875418d-c249-4ac6-9e20-6945ffdf6cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:45.112199 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875418d-c249-4ac6-9e20-6945ffdf6cae service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:45.112502 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875418d-c249-4ac6-9e20-6945ffdf6cae service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:45.112776 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875418d-c249-4ac6-9e20-6945ffdf6cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:45.114522 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c875418d-c249-4ac6-9e20-6945ffdf6cae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:45.127932 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875418d-c249-4ac6-9e20-6945ffdf6cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:45.129342 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875418d-c249-4ac6-9e20-6945ffdf6cae service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:45.140004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1225/2436] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:06:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:07:03.142266 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6006ad-ead3-4ecd-a96f-08de10ee5fbb service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:03.143748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-5d6006ad-ead3-4ecd-a96f-08de10ee5fbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:03.156677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6006ad-ead3-4ecd-a96f-08de10ee5fbb service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:03.160305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15920c11-559c-4c8f-93aa-e8cdd1a85b33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:03.160951 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15920c11-559c-4c8f-93aa-e8cdd1a85b33 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:03.161233 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15920c11-559c-4c8f-93aa-e8cdd1a85b33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:03.161512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15920c11-559c-4c8f-93aa-e8cdd1a85b33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:03.163297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-15920c11-559c-4c8f-93aa-e8cdd1a85b33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:03.172795 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15920c11-559c-4c8f-93aa-e8cdd1a85b33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:03.174241 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15920c11-559c-4c8f-93aa-e8cdd1a85b33 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:03.182448 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1212/2437] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:07:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:07:14.182380 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875418d-c249-4ac6-9e20-6945ffdf6cae service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:14.184042 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c875418d-c249-4ac6-9e20-6945ffdf6cae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:14.250898 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875418d-c249-4ac6-9e20-6945ffdf6cae service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:14.255386 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6eb43-929c-490f-a951-a270b300ba1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:14.256243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6eb43-929c-490f-a951-a270b300ba1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:14.256521 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6eb43-929c-490f-a951-a270b300ba1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:14.256791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6eb43-929c-490f-a951-a270b300ba1a admin admin] PATH_INFO: `/v3/users/acdd7d7f383f4399ae863e65b10c4586` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:14.257955 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6eb43-929c-490f-a951-a270b300ba1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=acdd7d7f383f4399ae863e65b10c4586)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:14.259894 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6eb43-929c-490f-a951-a270b300ba1a admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:14.304773 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f5c6eb43-929c-490f-a951-a270b300ba1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acdd7d7f383f4399ae863e65b10c4586'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.305412 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f5c6eb43-929c-490f-a951-a270b300ba1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acdd7d7f383f4399ae863e65b10c4586'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.317332 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f5c6eb43-929c-490f-a951-a270b300ba1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acdd7d7f383f4399ae863e65b10c4586'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.323962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f5c6eb43-929c-490f-a951-a270b300ba1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acdd7d7f383f4399ae863e65b10c4586'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.330996 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f5c6eb43-929c-490f-a951-a270b300ba1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acdd7d7f383f4399ae863e65b10c4586'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.336736 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1226/2438] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:07:14 2022] DELETE /identity/v3/users/acdd7d7f383f4399ae863e65b10c4586 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:14.504153 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15920c11-559c-4c8f-93aa-e8cdd1a85b33 service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:14.516337 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15920c11-559c-4c8f-93aa-e8cdd1a85b33 service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:14.573889 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67b3ee-d63c-4ac2-9ea3-e56fb80513cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:14.574767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67b3ee-d63c-4ac2-9ea3-e56fb80513cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:14.575039 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67b3ee-d63c-4ac2-9ea3-e56fb80513cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:14.575303 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67b3ee-d63c-4ac2-9ea3-e56fb80513cc admin admin] PATH_INFO: `/v3/projects/0305a36033ca4831b0bcba8a9b3c5a27` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:14.576459 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67b3ee-d63c-4ac2-9ea3-e56fb80513cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0305a36033ca4831b0bcba8a9b3c5a27)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:14.578396 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67b3ee-d63c-4ac2-9ea3-e56fb80513cc admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:14.622340 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-af67b3ee-d63c-4ac2-9ea3-e56fb80513cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0305a36033ca4831b0bcba8a9b3c5a27', 'request_id': 'req-af67b3ee-d63c-4ac2-9ea3-e56fb80513cc'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.627530 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-af67b3ee-d63c-4ac2-9ea3-e56fb80513cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0305a36033ca4831b0bcba8a9b3c5a27', 'request_id': 'req-af67b3ee-d63c-4ac2-9ea3-e56fb80513cc'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.633506 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-af67b3ee-d63c-4ac2-9ea3-e56fb80513cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0305a36033ca4831b0bcba8a9b3c5a27', 'request_id': 'req-af67b3ee-d63c-4ac2-9ea3-e56fb80513cc'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.645520 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-af67b3ee-d63c-4ac2-9ea3-e56fb80513cc admin admin] The token cache is being invalidate because project 0305a36033ca4831b0bcba8a9b3c5a27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:07:14.645814 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-af67b3ee-d63c-4ac2-9ea3-e56fb80513cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.646458 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-af67b3ee-d63c-4ac2-9ea3-e56fb80513cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.648005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1213/2439] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:07:14 2022] DELETE /identity/v3/projects/0305a36033ca4831b0bcba8a9b3c5a27 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:26.072011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6eb43-929c-490f-a951-a270b300ba1a admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:26.073531 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f5c6eb43-929c-490f-a951-a270b300ba1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:26.145977 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6eb43-929c-490f-a951-a270b300ba1a admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:26.205784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea8deb-dfcc-40f3-9d21-6e538b591fe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:26.206471 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea8deb-dfcc-40f3-9d21-6e538b591fe2 service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:26.206773 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea8deb-dfcc-40f3-9d21-6e538b591fe2 service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:26.207046 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea8deb-dfcc-40f3-9d21-6e538b591fe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:26.208797 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-2dea8deb-dfcc-40f3-9d21-6e538b591fe2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:26.271309 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea8deb-dfcc-40f3-9d21-6e538b591fe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:26.273820 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea8deb-dfcc-40f3-9d21-6e538b591fe2 service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:26.286928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1227/2440] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:07:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:07:45.523918 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67b3ee-d63c-4ac2-9ea3-e56fb80513cc admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:45.525411 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-af67b3ee-d63c-4ac2-9ea3-e56fb80513cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:45.541036 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67b3ee-d63c-4ac2-9ea3-e56fb80513cc admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:45.546582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122b16d-4ef6-4a8e-a60a-3ab7b57c50e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:45.547245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122b16d-4ef6-4a8e-a60a-3ab7b57c50e9 service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:45.547523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122b16d-4ef6-4a8e-a60a-3ab7b57c50e9 service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:45.547793 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122b16d-4ef6-4a8e-a60a-3ab7b57c50e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:45.549502 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-2122b16d-4ef6-4a8e-a60a-3ab7b57c50e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:45.605949 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122b16d-4ef6-4a8e-a60a-3ab7b57c50e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:45.607563 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122b16d-4ef6-4a8e-a60a-3ab7b57c50e9 service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:45.617028 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1214/2441] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:07:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:07:48.576089 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea8deb-dfcc-40f3-9d21-6e538b591fe2 service nova] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:48.579597 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-2dea8deb-dfcc-40f3-9d21-6e538b591fe2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:48.613515 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea8deb-dfcc-40f3-9d21-6e538b591fe2 service nova] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:48.620617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c03dc-6a74-462b-940a-47124c220ef9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:48.622006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c03dc-6a74-462b-940a-47124c220ef9 service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:48.622516 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c03dc-6a74-462b-940a-47124c220ef9 service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:48.622980 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c03dc-6a74-462b-940a-47124c220ef9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:48.625710 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-939c03dc-6a74-462b-940a-47124c220ef9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:48.642432 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c03dc-6a74-462b-940a-47124c220ef9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:48.644977 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c03dc-6a74-462b-940a-47124c220ef9 service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:48.658585 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1228/2442] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:07:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:07:55.602013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca922c0a-985e-40af-bd89-24131425bdd0 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:55.602561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca922c0a-985e-40af-bd89-24131425bdd0 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:55.602746 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca922c0a-985e-40af-bd89-24131425bdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:55.619868 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-ca922c0a-985e-40af-bd89-24131425bdd0 None None] MFA Rules not processed for user `1897b88622664ceca4deac5a22079726`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:55.621359 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-ca922c0a-985e-40af-bd89-24131425bdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:55.629235 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1215/2443] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:07:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:59.207611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db46f2-6936-4f5b-bfcc-3d0e02492cf0 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:59.208104 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db46f2-6936-4f5b-bfcc-3d0e02492cf0 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:59.208227 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db46f2-6936-4f5b-bfcc-3d0e02492cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:59.225787 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-14db46f2-6936-4f5b-bfcc-3d0e02492cf0 None None] MFA Rules not processed for user `c98a5fc7863942c5b389aa9766d31129`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:59.227013 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-14db46f2-6936-4f5b-bfcc-3d0e02492cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:59.233944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1229/2444] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:07:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:59.543995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca922c0a-985e-40af-bd89-24131425bdd0 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:59.545502 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-ca922c0a-985e-40af-bd89-24131425bdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:59.603177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca922c0a-985e-40af-bd89-24131425bdd0 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:59.606767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce13c4-dfba-425b-8e47-2958f0efd11b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:59.607526 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce13c4-dfba-425b-8e47-2958f0efd11b service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:59.607809 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce13c4-dfba-425b-8e47-2958f0efd11b service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:59.608079 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce13c4-dfba-425b-8e47-2958f0efd11b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:59.610492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-2fce13c4-dfba-425b-8e47-2958f0efd11b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:59.619930 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce13c4-dfba-425b-8e47-2958f0efd11b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:59.621583 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce13c4-dfba-425b-8e47-2958f0efd11b service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:59.630018 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1216/2445] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:07:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:08:00.821568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db46f2-6936-4f5b-bfcc-3d0e02492cf0 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:00.837004 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db46f2-6936-4f5b-bfcc-3d0e02492cf0 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:00.842778 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030841c5-a29c-4eb8-bb9e-bc93b871acbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:00.844172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030841c5-a29c-4eb8-bb9e-bc93b871acbb service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:00.844485 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030841c5-a29c-4eb8-bb9e-bc93b871acbb service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:00.844855 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030841c5-a29c-4eb8-bb9e-bc93b871acbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:00.846744 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-030841c5-a29c-4eb8-bb9e-bc93b871acbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:00.859795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030841c5-a29c-4eb8-bb9e-bc93b871acbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:00.861477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030841c5-a29c-4eb8-bb9e-bc93b871acbb service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:00.872527 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1230/2446] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:08:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:08:01.958751 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce13c4-dfba-425b-8e47-2958f0efd11b service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:01.960136 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-2fce13c4-dfba-425b-8e47-2958f0efd11b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:02.029843 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce13c4-dfba-425b-8e47-2958f0efd11b service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:02.035616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bce8de-8f58-45f4-b81b-25ba720dffbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4859a69a988a4b10b67187553d829b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:02.036273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bce8de-8f58-45f4-b81b-25ba720dffbf service placement] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:02.036553 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bce8de-8f58-45f4-b81b-25ba720dffbf service placement] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:02.036828 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bce8de-8f58-45f4-b81b-25ba720dffbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:02.038674 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-61bce8de-8f58-45f4-b81b-25ba720dffbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:02.051245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bce8de-8f58-45f4-b81b-25ba720dffbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:02.052855 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bce8de-8f58-45f4-b81b-25ba720dffbf service placement] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:02.063666 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1217/2447] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:08:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:08:12.539859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030841c5-a29c-4eb8-bb9e-bc93b871acbb service nova] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:12.553539 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030841c5-a29c-4eb8-bb9e-bc93b871acbb service nova] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:12.559769 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4d9c1-6169-4fce-a16a-e2657d7edd4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:12.560499 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4d9c1-6169-4fce-a16a-e2657d7edd4d service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:12.560884 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4d9c1-6169-4fce-a16a-e2657d7edd4d service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:12.561239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4d9c1-6169-4fce-a16a-e2657d7edd4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:12.563913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-88b4d9c1-6169-4fce-a16a-e2657d7edd4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:12.577012 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4d9c1-6169-4fce-a16a-e2657d7edd4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:12.579408 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4d9c1-6169-4fce-a16a-e2657d7edd4d service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:12.597257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1231/2448] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:08:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:08:41.423722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bce8de-8f58-45f4-b81b-25ba720dffbf service placement] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:41.425224 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-61bce8de-8f58-45f4-b81b-25ba720dffbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:41.436437 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bce8de-8f58-45f4-b81b-25ba720dffbf service placement] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:41.440469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656d6dc-cf43-45fe-adac-61cef46e0f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:41.441092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656d6dc-cf43-45fe-adac-61cef46e0f99 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:41.441366 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656d6dc-cf43-45fe-adac-61cef46e0f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:41.441634 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656d6dc-cf43-45fe-adac-61cef46e0f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:41.443319 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-7656d6dc-cf43-45fe-adac-61cef46e0f99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:41.452254 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656d6dc-cf43-45fe-adac-61cef46e0f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:41.453660 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656d6dc-cf43-45fe-adac-61cef46e0f99 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:41.461961 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1218/2449] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:08:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:08:41.566027 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c73625-4d23-43e2-a3c7-11e0a3f46f29 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:41.566661 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c73625-4d23-43e2-a3c7-11e0a3f46f29 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:41.566761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c73625-4d23-43e2-a3c7-11e0a3f46f29 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:41.568208 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1232/2450] 10.222.0.32 () {54 vars in 921 bytes} [Tue May 10 14:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:08:41.574054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740a751-41a1-4bd4-b320-71b28cbc3ca5 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:41.574380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740a751-41a1-4bd4-b320-71b28cbc3ca5 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:41.574679 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740a751-41a1-4bd4-b320-71b28cbc3ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:41.594244 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-4740a751-41a1-4bd4-b320-71b28cbc3ca5 None None] MFA Rules not processed for user `12eb1c001b5e44d8b5b5bc658ed464f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:08:41.596099 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-4740a751-41a1-4bd4-b320-71b28cbc3ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:41.602612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1219/2451] 10.222.0.32 () {58 vars in 1018 bytes} [Tue May 10 14:08:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:08:41.614399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c73625-4d23-43e2-a3c7-11e0a3f46f29 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:41.625345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c73625-4d23-43e2-a3c7-11e0a3f46f29 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:41.629536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ed02e-8dbf-4042-a755-47a06c006f5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:41.630226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ed02e-8dbf-4042-a755-47a06c006f5f service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:41.630517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ed02e-8dbf-4042-a755-47a06c006f5f service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:41.630806 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ed02e-8dbf-4042-a755-47a06c006f5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:41.638299 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ed02e-8dbf-4042-a755-47a06c006f5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:41.639867 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ed02e-8dbf-4042-a755-47a06c006f5f service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:41.648653 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1233/2452] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:08:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:08:41.730967 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da420a3-b179-4c6c-bc66-9357b776f0f0 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:41.731254 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da420a3-b179-4c6c-bc66-9357b776f0f0 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:41.731523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da420a3-b179-4c6c-bc66-9357b776f0f0 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:41.732890 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1220/2453] 10.222.0.32 () {54 vars in 921 bytes} [Tue May 10 14:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:08:41.739601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aef97-a011-4658-bca4-4947024e0dcb None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:41.739888 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aef97-a011-4658-bca4-4947024e0dcb None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:41.740172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aef97-a011-4658-bca4-4947024e0dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:41.775369 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-7f4aef97-a011-4658-bca4-4947024e0dcb None None] MFA Rules not processed for user `e5d4fd26c21f4170a6790369344f8334`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:08:41.776579 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-7f4aef97-a011-4658-bca4-4947024e0dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:41.786661 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1234/2454] 10.222.0.32 () {58 vars in 1018 bytes} [Tue May 10 14:08:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:08:41.797022 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da420a3-b179-4c6c-bc66-9357b776f0f0 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:41.809111 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da420a3-b179-4c6c-bc66-9357b776f0f0 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:41.812687 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfacb6-9574-4cb9-8d75-06fe9acb4308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:41.813317 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfacb6-9574-4cb9-8d75-06fe9acb4308 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:41.813619 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfacb6-9574-4cb9-8d75-06fe9acb4308 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:41.813943 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfacb6-9574-4cb9-8d75-06fe9acb4308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:41.824011 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfacb6-9574-4cb9-8d75-06fe9acb4308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:41.825445 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfacb6-9574-4cb9-8d75-06fe9acb4308 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:41.836427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1221/2455] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:08:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:09:19.371568 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aef97-a011-4658-bca4-4947024e0dcb None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:19.382119 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aef97-a011-4658-bca4-4947024e0dcb None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:19.385669 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f75199-7fa6-4770-9d89-a81ea82274d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:19.386348 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f75199-7fa6-4770-9d89-a81ea82274d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:19.386636 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f75199-7fa6-4770-9d89-a81ea82274d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:19.386914 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f75199-7fa6-4770-9d89-a81ea82274d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:19.388672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-24f75199-7fa6-4770-9d89-a81ea82274d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:09:19.453174 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f75199-7fa6-4770-9d89-a81ea82274d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:19.454689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f75199-7fa6-4770-9d89-a81ea82274d6 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:19.464905 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1235/2456] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:09:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:09:22.963775 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfacb6-9574-4cb9-8d75-06fe9acb4308 service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:22.965265 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-accfacb6-9574-4cb9-8d75-06fe9acb4308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:09:22.978976 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfacb6-9574-4cb9-8d75-06fe9acb4308 service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:22.983667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2acea-2058-46c2-87b5-88a4d83b8174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:22.984529 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2acea-2058-46c2-87b5-88a4d83b8174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:22.984810 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2acea-2058-46c2-87b5-88a4d83b8174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:22.985085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2acea-2058-46c2-87b5-88a4d83b8174 admin admin] PATH_INFO: `/v3/users/1897b88622664ceca4deac5a22079726` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:22.986291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2acea-2058-46c2-87b5-88a4d83b8174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1897b88622664ceca4deac5a22079726)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:22.988829 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2acea-2058-46c2-87b5-88a4d83b8174 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:23.033706 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-25d2acea-2058-46c2-87b5-88a4d83b8174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1897b88622664ceca4deac5a22079726'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:09:23.040210 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-25d2acea-2058-46c2-87b5-88a4d83b8174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1897b88622664ceca4deac5a22079726'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:09:23.052262 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-25d2acea-2058-46c2-87b5-88a4d83b8174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1897b88622664ceca4deac5a22079726'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:09:23.052921 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-25d2acea-2058-46c2-87b5-88a4d83b8174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1897b88622664ceca4deac5a22079726'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:09:23.053582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-25d2acea-2058-46c2-87b5-88a4d83b8174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1897b88622664ceca4deac5a22079726'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:09:23.065993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1222/2457] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:09:22 2022] DELETE /identity/v3/users/1897b88622664ceca4deac5a22079726 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:09:23.235984 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f75199-7fa6-4770-9d89-a81ea82274d6 service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:23.248005 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f75199-7fa6-4770-9d89-a81ea82274d6 service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:23.305566 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77302e-ee08-4bc8-bc43-a6dfd6db3123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:23.306473 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77302e-ee08-4bc8-bc43-a6dfd6db3123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:23.306773 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77302e-ee08-4bc8-bc43-a6dfd6db3123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:23.307033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77302e-ee08-4bc8-bc43-a6dfd6db3123 admin admin] PATH_INFO: `/v3/projects/523029c9401f49c399be46bfe308b5e6` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:23.308218 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77302e-ee08-4bc8-bc43-a6dfd6db3123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=523029c9401f49c399be46bfe308b5e6)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:23.310114 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77302e-ee08-4bc8-bc43-a6dfd6db3123 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:23.355786 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-be77302e-ee08-4bc8-bc43-a6dfd6db3123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '523029c9401f49c399be46bfe308b5e6', 'request_id': 'req-be77302e-ee08-4bc8-bc43-a6dfd6db3123'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:09:23.361008 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-be77302e-ee08-4bc8-bc43-a6dfd6db3123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '523029c9401f49c399be46bfe308b5e6', 'request_id': 'req-be77302e-ee08-4bc8-bc43-a6dfd6db3123'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:09:23.368144 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-be77302e-ee08-4bc8-bc43-a6dfd6db3123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '523029c9401f49c399be46bfe308b5e6', 'request_id': 'req-be77302e-ee08-4bc8-bc43-a6dfd6db3123'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:09:23.380769 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-be77302e-ee08-4bc8-bc43-a6dfd6db3123 admin admin] The token cache is being invalidate because project 523029c9401f49c399be46bfe308b5e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:09:23.381058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-be77302e-ee08-4bc8-bc43-a6dfd6db3123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:09:23.381749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-be77302e-ee08-4bc8-bc43-a6dfd6db3123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:09:23.383452 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1236/2458] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:09:23 2022] DELETE /identity/v3/projects/523029c9401f49c399be46bfe308b5e6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:09:23.388372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c0ec7-d29c-4f01-8942-c5c189da3d17 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:23.388662 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c0ec7-d29c-4f01-8942-c5c189da3d17 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:23.388944 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c0ec7-d29c-4f01-8942-c5c189da3d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:23.407835 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-917c0ec7-d29c-4f01-8942-c5c189da3d17 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:09:23.410022 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-917c0ec7-d29c-4f01-8942-c5c189da3d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:09:23.470452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1223/2459] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:09:23.479156 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01fda2-5c78-4ef1-9655-045a6a4d6546 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:23.479456 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01fda2-5c78-4ef1-9655-045a6a4d6546 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:23.479768 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01fda2-5c78-4ef1-9655-045a6a4d6546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:23.498438 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-ac01fda2-5c78-4ef1-9655-045a6a4d6546 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:09:23.499569 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-ac01fda2-5c78-4ef1-9655-045a6a4d6546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:09:23.507508 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1237/2460] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:09:23.511545 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c0ec7-d29c-4f01-8942-c5c189da3d17 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:23.521486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c0ec7-d29c-4f01-8942-c5c189da3d17 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:23.525986 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f4297-9ea4-4c29-b0c2-4a6ba0bcc893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:23.526664 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f4297-9ea4-4c29-b0c2-4a6ba0bcc893 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:23.526947 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f4297-9ea4-4c29-b0c2-4a6ba0bcc893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:23.527219 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f4297-9ea4-4c29-b0c2-4a6ba0bcc893 admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:23.527940 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f4297-9ea4-4c29-b0c2-4a6ba0bcc893 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:09:23.528243 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f4297-9ea4-4c29-b0c2-4a6ba0bcc893 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:23.529825 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f4297-9ea4-4c29-b0c2-4a6ba0bcc893 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:23.541779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1224/2461] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:09:23.545917 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01fda2-5c78-4ef1-9655-045a6a4d6546 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:23.555348 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01fda2-5c78-4ef1-9655-045a6a4d6546 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:23.559985 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311868d6-ee72-4ffc-bcff-9565cd05ff17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:23.560631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311868d6-ee72-4ffc-bcff-9565cd05ff17 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:23.560926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311868d6-ee72-4ffc-bcff-9565cd05ff17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:23.561192 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311868d6-ee72-4ffc-bcff-9565cd05ff17 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:23.561887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311868d6-ee72-4ffc-bcff-9565cd05ff17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:23.563813 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311868d6-ee72-4ffc-bcff-9565cd05ff17 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:23.599819 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1238/2462] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:09:23 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:09:23.603819 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f4297-9ea4-4c29-b0c2-4a6ba0bcc893 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:23.613762 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f4297-9ea4-4c29-b0c2-4a6ba0bcc893 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:23.668066 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1623ea-e9c3-4c1e-8b51-a6f5e2bf3bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:23.668720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1623ea-e9c3-4c1e-8b51-a6f5e2bf3bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:23.668999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1623ea-e9c3-4c1e-8b51-a6f5e2bf3bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:23.669270 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1623ea-e9c3-4c1e-8b51-a6f5e2bf3bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:23.669953 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1623ea-e9c3-4c1e-8b51-a6f5e2bf3bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:23.671878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1623ea-e9c3-4c1e-8b51-a6f5e2bf3bc6 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:23.690460 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1225/2463] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:09:23 2022] POST /identity/v3/users => generated 294 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:09:23.694687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311868d6-ee72-4ffc-bcff-9565cd05ff17 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:23.704755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311868d6-ee72-4ffc-bcff-9565cd05ff17 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:23.710112 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de92b79-c18b-4232-bfe9-46158a9a9ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:23.710823 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de92b79-c18b-4232-bfe9-46158a9a9ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:23.711113 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de92b79-c18b-4232-bfe9-46158a9a9ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:23.711422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de92b79-c18b-4232-bfe9-46158a9a9ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:23.712151 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de92b79-c18b-4232-bfe9-46158a9a9ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:23.713774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de92b79-c18b-4232-bfe9-46158a9a9ed4 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:23.723790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1239/2464] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:09:23.727830 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1623ea-e9c3-4c1e-8b51-a6f5e2bf3bc6 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:23.738074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1623ea-e9c3-4c1e-8b51-a6f5e2bf3bc6 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:23.742617 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93eb210-83d8-4e13-9a5a-841c24b436bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:23.743274 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93eb210-83d8-4e13-9a5a-841c24b436bc admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:23.743555 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93eb210-83d8-4e13-9a5a-841c24b436bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:23.743826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93eb210-83d8-4e13-9a5a-841c24b436bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:23.744543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93eb210-83d8-4e13-9a5a-841c24b436bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:23.746116 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93eb210-83d8-4e13-9a5a-841c24b436bc admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:23.757541 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1226/2465] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:09:23.761537 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de92b79-c18b-4232-bfe9-46158a9a9ed4 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:23.771564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de92b79-c18b-4232-bfe9-46158a9a9ed4 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:23.776145 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b290133-3daa-4b3f-8b09-c7f8eaa30ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:23.777013 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b290133-3daa-4b3f-8b09-c7f8eaa30ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:23.777296 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b290133-3daa-4b3f-8b09-c7f8eaa30ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:23.777572 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b290133-3daa-4b3f-8b09-c7f8eaa30ca4 admin admin] PATH_INFO: `/v3/projects/c251b9c401c6455da95be74c9119b8d2/users/3069e17bfc5d4e34ab7f5c61f48d9f11/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:23.791999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b290133-3daa-4b3f-8b09-c7f8eaa30ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c251b9c401c6455da95be74c9119b8d2, user_id=3069e17bfc5d4e34ab7f5c61f48d9f11, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:23.794689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b290133-3daa-4b3f-8b09-c7f8eaa30ca4 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:23.808194 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1240/2466] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:09:23 2022] PUT /identity/v3/projects/c251b9c401c6455da95be74c9119b8d2/users/3069e17bfc5d4e34ab7f5c61f48d9f11/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:09:23.813413 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cba3fa-4891-4e67-bc92-ee149f3dbcc1 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:23.813699 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cba3fa-4891-4e67-bc92-ee149f3dbcc1 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:23.813970 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cba3fa-4891-4e67-bc92-ee149f3dbcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:23.834304 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-10cba3fa-4891-4e67-bc92-ee149f3dbcc1 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:09:23.834304 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-10cba3fa-4891-4e67-bc92-ee149f3dbcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:09:23.890569 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1227/2467] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:09:23.900050 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b290133-3daa-4b3f-8b09-c7f8eaa30ca4 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:23.901824 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-5b290133-3daa-4b3f-8b09-c7f8eaa30ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:09:23.958249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b290133-3daa-4b3f-8b09-c7f8eaa30ca4 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:23.961910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8040e-6953-4a8d-bc5c-e7a0bb508e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:23.962809 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8040e-6953-4a8d-bc5c-e7a0bb508e15 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:23.962926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8040e-6953-4a8d-bc5c-e7a0bb508e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:23.963203 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8040e-6953-4a8d-bc5c-e7a0bb508e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:23.973138 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8040e-6953-4a8d-bc5c-e7a0bb508e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:23.974697 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8040e-6953-4a8d-bc5c-e7a0bb508e15 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:23.984549 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1241/2468] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:09:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:09:24.239207 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cba3fa-4891-4e67-bc92-ee149f3dbcc1 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:24.240719 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-10cba3fa-4891-4e67-bc92-ee149f3dbcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:09:24.302121 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cba3fa-4891-4e67-bc92-ee149f3dbcc1 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:24.305988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c69040-92fc-45ec-a4be-10c9005349e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:24.306957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c69040-92fc-45ec-a4be-10c9005349e5 service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:24.307419 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c69040-92fc-45ec-a4be-10c9005349e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:24.307906 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c69040-92fc-45ec-a4be-10c9005349e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:24.310629 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-85c69040-92fc-45ec-a4be-10c9005349e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:09:24.375587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c69040-92fc-45ec-a4be-10c9005349e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:24.378407 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c69040-92fc-45ec-a4be-10c9005349e5 service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:24.387768 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1228/2469] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:09:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:09:28.864064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6d28c-d485-4525-915f-930998a6c5be None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:28.864509 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6d28c-d485-4525-915f-930998a6c5be None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:28.864930 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6d28c-d485-4525-915f-930998a6c5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:28.920123 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-3cb6d28c-d485-4525-915f-930998a6c5be None None] MFA Rules not processed for user `3069e17bfc5d4e34ab7f5c61f48d9f11`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:09:28.922267 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-3cb6d28c-d485-4525-915f-930998a6c5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:09:29.004794 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1242/2470] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:09:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:09:29.018771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c69040-92fc-45ec-a4be-10c9005349e5 service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:29.020902 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-85c69040-92fc-45ec-a4be-10c9005349e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:09:29.101812 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c69040-92fc-45ec-a4be-10c9005349e5 service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:29.107501 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f33d4-c06d-4b7b-9adc-c5cf3fd05ea1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:29.108177 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f33d4-c06d-4b7b-9adc-c5cf3fd05ea1 service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:29.108460 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f33d4-c06d-4b7b-9adc-c5cf3fd05ea1 service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:29.108737 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f33d4-c06d-4b7b-9adc-c5cf3fd05ea1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:29.121579 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f33d4-c06d-4b7b-9adc-c5cf3fd05ea1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:29.123493 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f33d4-c06d-4b7b-9adc-c5cf3fd05ea1 service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:29.134915 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1229/2471] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:09:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:09:31.160060 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49192608-8e43-4ea8-bcdc-e3e293c54c4a None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:31.161183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49192608-8e43-4ea8-bcdc-e3e293c54c4a None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:31.162125 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49192608-8e43-4ea8-bcdc-e3e293c54c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:31.183528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-49192608-8e43-4ea8-bcdc-e3e293c54c4a None None] MFA Rules not processed for user `3069e17bfc5d4e34ab7f5c61f48d9f11`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:09:31.184901 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-49192608-8e43-4ea8-bcdc-e3e293c54c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:09:31.210741 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1243/2472] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:09:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:09:31.416344 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000433a-bdd2-4374-b9e4-e27d548b293a None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:31.416819 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000433a-bdd2-4374-b9e4-e27d548b293a None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:31.416899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000433a-bdd2-4374-b9e4-e27d548b293a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:31.441718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-c000433a-bdd2-4374-b9e4-e27d548b293a None None] MFA Rules not processed for user `fb76fce14cf84b2bb4094fa2691777fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:09:31.442980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-c000433a-bdd2-4374-b9e4-e27d548b293a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:09:31.452920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1230/2473] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:09:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:09:53.100445 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49192608-8e43-4ea8-bcdc-e3e293c54c4a None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:53.102048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-49192608-8e43-4ea8-bcdc-e3e293c54c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:09:53.179395 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49192608-8e43-4ea8-bcdc-e3e293c54c4a None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:53.184851 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f81e3-e295-483e-b0f9-a01adc66c710 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4859a69a988a4b10b67187553d829b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:53.185601 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f81e3-e295-483e-b0f9-a01adc66c710 service placement] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:53.185948 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f81e3-e295-483e-b0f9-a01adc66c710 service placement] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:53.186323 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f81e3-e295-483e-b0f9-a01adc66c710 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:53.188150 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-374f81e3-e295-483e-b0f9-a01adc66c710 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:09:53.200176 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f81e3-e295-483e-b0f9-a01adc66c710 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:53.201750 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f81e3-e295-483e-b0f9-a01adc66c710 service placement] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:53.212333 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1244/2474] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:09:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:09:56.324192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4029cd-8cae-4e99-bf9f-8ed676073d68 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:56.324750 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4029cd-8cae-4e99-bf9f-8ed676073d68 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:56.324750 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4029cd-8cae-4e99-bf9f-8ed676073d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:56.344135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-4f4029cd-8cae-4e99-bf9f-8ed676073d68 None None] MFA Rules not processed for user `c98a5fc7863942c5b389aa9766d31129`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:09:56.345356 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-4f4029cd-8cae-4e99-bf9f-8ed676073d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:09:56.401145 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1231/2475] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:09:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:10:40.386257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f81e3-e295-483e-b0f9-a01adc66c710 service placement] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:10:40.387695 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-374f81e3-e295-483e-b0f9-a01adc66c710 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:10:40.399537 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f81e3-e295-483e-b0f9-a01adc66c710 service placement] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:10:40.403242 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6339bb4-de71-48a3-8bd8-91ebc997ea46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:10:40.403886 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6339bb4-de71-48a3-8bd8-91ebc997ea46 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:10:40.404296 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6339bb4-de71-48a3-8bd8-91ebc997ea46 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:10:40.404575 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6339bb4-de71-48a3-8bd8-91ebc997ea46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:10:40.406379 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-a6339bb4-de71-48a3-8bd8-91ebc997ea46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:10:40.465942 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6339bb4-de71-48a3-8bd8-91ebc997ea46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:10:40.467419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6339bb4-de71-48a3-8bd8-91ebc997ea46 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:10:40.476154 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1245/2476] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:10:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:10:45.448959 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4029cd-8cae-4e99-bf9f-8ed676073d68 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:10:45.458731 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4029cd-8cae-4e99-bf9f-8ed676073d68 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:10:45.464524 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070803d-7d42-410b-a9e0-ad8ac2b5d68e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:10:45.465604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070803d-7d42-410b-a9e0-ad8ac2b5d68e service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:10:45.465895 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070803d-7d42-410b-a9e0-ad8ac2b5d68e service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:10:45.466175 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070803d-7d42-410b-a9e0-ad8ac2b5d68e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:10:45.467995 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b070803d-7d42-410b-a9e0-ad8ac2b5d68e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:10:45.480377 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070803d-7d42-410b-a9e0-ad8ac2b5d68e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:10:45.481846 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070803d-7d42-410b-a9e0-ad8ac2b5d68e service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:10:45.492149 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1232/2477] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:10:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:10:51.989477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6339bb4-de71-48a3-8bd8-91ebc997ea46 service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:10:51.991166 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-a6339bb4-de71-48a3-8bd8-91ebc997ea46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:10:52.005110 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6339bb4-de71-48a3-8bd8-91ebc997ea46 service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:10:52.009790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45445212-9be6-4553-ae01-cf8fcd833cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:10:52.010677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45445212-9be6-4553-ae01-cf8fcd833cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:10:52.010958 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45445212-9be6-4553-ae01-cf8fcd833cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:10:52.011230 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45445212-9be6-4553-ae01-cf8fcd833cb7 admin admin] PATH_INFO: `/v3/users/56462e4305424b099473d1e42adab9a9` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:10:52.012400 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45445212-9be6-4553-ae01-cf8fcd833cb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56462e4305424b099473d1e42adab9a9)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:10:52.014724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45445212-9be6-4553-ae01-cf8fcd833cb7 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:10:52.064146 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-45445212-9be6-4553-ae01-cf8fcd833cb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56462e4305424b099473d1e42adab9a9'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:52.065016 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-45445212-9be6-4553-ae01-cf8fcd833cb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56462e4305424b099473d1e42adab9a9'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:52.076864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-45445212-9be6-4553-ae01-cf8fcd833cb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56462e4305424b099473d1e42adab9a9'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:52.084492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-45445212-9be6-4553-ae01-cf8fcd833cb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56462e4305424b099473d1e42adab9a9'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:52.091971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-45445212-9be6-4553-ae01-cf8fcd833cb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56462e4305424b099473d1e42adab9a9'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:52.097784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1246/2478] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:10:51 2022] DELETE /identity/v3/users/56462e4305424b099473d1e42adab9a9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:10:52.274980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070803d-7d42-410b-a9e0-ad8ac2b5d68e service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:10:52.289036 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070803d-7d42-410b-a9e0-ad8ac2b5d68e service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:10:52.349415 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ff84e-1fd4-4424-9307-579169434229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:10:52.350346 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ff84e-1fd4-4424-9307-579169434229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:10:52.350625 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ff84e-1fd4-4424-9307-579169434229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:10:52.350895 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ff84e-1fd4-4424-9307-579169434229 admin admin] PATH_INFO: `/v3/projects/a9cb94e930984858b30744fc14ca334e` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:10:52.352065 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ff84e-1fd4-4424-9307-579169434229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9cb94e930984858b30744fc14ca334e)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:10:52.353962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ff84e-1fd4-4424-9307-579169434229 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:10:52.397819 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2f4ff84e-1fd4-4424-9307-579169434229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9cb94e930984858b30744fc14ca334e', 'request_id': 'req-2f4ff84e-1fd4-4424-9307-579169434229'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:52.403046 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2f4ff84e-1fd4-4424-9307-579169434229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9cb94e930984858b30744fc14ca334e', 'request_id': 'req-2f4ff84e-1fd4-4424-9307-579169434229'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:52.409074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2f4ff84e-1fd4-4424-9307-579169434229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9cb94e930984858b30744fc14ca334e', 'request_id': 'req-2f4ff84e-1fd4-4424-9307-579169434229'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:52.421965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2f4ff84e-1fd4-4424-9307-579169434229 admin admin] The token cache is being invalidate because project a9cb94e930984858b30744fc14ca334e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:10:52.422275 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2f4ff84e-1fd4-4424-9307-579169434229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:52.423020 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2f4ff84e-1fd4-4424-9307-579169434229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:52.424567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1233/2479] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:10:52 2022] DELETE /identity/v3/projects/a9cb94e930984858b30744fc14ca334e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:10:52.428647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45445212-9be6-4553-ae01-cf8fcd833cb7 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:10:52.430120 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-45445212-9be6-4553-ae01-cf8fcd833cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:10:52.442712 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45445212-9be6-4553-ae01-cf8fcd833cb7 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:10:52.496997 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec45c6a-878b-408e-8eed-0b6a58f24c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:10:52.497785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec45c6a-878b-408e-8eed-0b6a58f24c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:10:52.498346 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec45c6a-878b-408e-8eed-0b6a58f24c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:10:52.498621 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec45c6a-878b-408e-8eed-0b6a58f24c07 admin admin] PATH_INFO: `/v3/users/39fb9668f1da460b9dc11cb8ffd94c25` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:10:52.499788 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec45c6a-878b-408e-8eed-0b6a58f24c07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39fb9668f1da460b9dc11cb8ffd94c25)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:10:52.501680 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec45c6a-878b-408e-8eed-0b6a58f24c07 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:10:52.545860 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-5ec45c6a-878b-408e-8eed-0b6a58f24c07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39fb9668f1da460b9dc11cb8ffd94c25'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:52.546548 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-5ec45c6a-878b-408e-8eed-0b6a58f24c07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39fb9668f1da460b9dc11cb8ffd94c25'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:52.557661 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-5ec45c6a-878b-408e-8eed-0b6a58f24c07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39fb9668f1da460b9dc11cb8ffd94c25'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:52.564809 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-5ec45c6a-878b-408e-8eed-0b6a58f24c07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39fb9668f1da460b9dc11cb8ffd94c25'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:52.571992 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-5ec45c6a-878b-408e-8eed-0b6a58f24c07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39fb9668f1da460b9dc11cb8ffd94c25'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:52.577711 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1247/2480] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:10:52 2022] DELETE /identity/v3/users/39fb9668f1da460b9dc11cb8ffd94c25 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:10:52.743541 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ff84e-1fd4-4424-9307-579169434229 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:10:52.744987 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-2f4ff84e-1fd4-4424-9307-579169434229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:10:52.758310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ff84e-1fd4-4424-9307-579169434229 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:10:52.812746 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e598456-b992-4d60-835e-56bf420045d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:10:52.813603 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e598456-b992-4d60-835e-56bf420045d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:10:52.813882 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e598456-b992-4d60-835e-56bf420045d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:10:52.814154 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e598456-b992-4d60-835e-56bf420045d0 admin admin] PATH_INFO: `/v3/projects/de140ca886ac4b7295154e2dcb211894` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:10:52.815349 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e598456-b992-4d60-835e-56bf420045d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de140ca886ac4b7295154e2dcb211894)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:10:52.817248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e598456-b992-4d60-835e-56bf420045d0 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:10:52.862076 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2e598456-b992-4d60-835e-56bf420045d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de140ca886ac4b7295154e2dcb211894', 'request_id': 'req-2e598456-b992-4d60-835e-56bf420045d0'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:52.867771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2e598456-b992-4d60-835e-56bf420045d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de140ca886ac4b7295154e2dcb211894', 'request_id': 'req-2e598456-b992-4d60-835e-56bf420045d0'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:52.873912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2e598456-b992-4d60-835e-56bf420045d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de140ca886ac4b7295154e2dcb211894', 'request_id': 'req-2e598456-b992-4d60-835e-56bf420045d0'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:52.886372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2e598456-b992-4d60-835e-56bf420045d0 admin admin] The token cache is being invalidate because project de140ca886ac4b7295154e2dcb211894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:10:52.886665 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2e598456-b992-4d60-835e-56bf420045d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:52.887275 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2e598456-b992-4d60-835e-56bf420045d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:52.888848 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1234/2481] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:10:52 2022] DELETE /identity/v3/projects/de140ca886ac4b7295154e2dcb211894 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:11:27.287649 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be145df-3208-45e6-9089-07c88ef0435d None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:27.289524 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be145df-3208-45e6-9089-07c88ef0435d None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:27.289524 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be145df-3208-45e6-9089-07c88ef0435d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:27.346413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-0be145df-3208-45e6-9089-07c88ef0435d None None] MFA Rules not processed for user `686c869be43c40a9b63b3647bf689c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:11:27.347653 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-0be145df-3208-45e6-9089-07c88ef0435d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:27.431226 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1248/2482] 10.222.0.32 () {58 vars in 1009 bytes} [Tue May 10 14:11:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:11:27.491572 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e598456-b992-4d60-835e-56bf420045d0 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:27.492999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-2e598456-b992-4d60-835e-56bf420045d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:27.609788 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e598456-b992-4d60-835e-56bf420045d0 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:27.614784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f131c-5ff9-4267-94a1-5ecc7eaab449 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bbad5318b6417087d7ce6906f8281f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:27.615756 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f131c-5ff9-4267-94a1-5ecc7eaab449 service swift] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:27.616180 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f131c-5ff9-4267-94a1-5ecc7eaab449 service swift] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:27.616573 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f131c-5ff9-4267-94a1-5ecc7eaab449 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:27.627718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f131c-5ff9-4267-94a1-5ecc7eaab449 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:27.629566 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f131c-5ff9-4267-94a1-5ecc7eaab449 service swift] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:27.644416 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1235/2483] 10.222.0.32 () {60 vars in 1384 bytes} [Tue May 10 14:11:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 14:11:36.598945 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be145df-3208-45e6-9089-07c88ef0435d None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:36.601071 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-0be145df-3208-45e6-9089-07c88ef0435d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:36.666698 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be145df-3208-45e6-9089-07c88ef0435d None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:36.670712 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216b267-9ad7-4ae1-8ee5-81b35a5715cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:36.671265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216b267-9ad7-4ae1-8ee5-81b35a5715cf service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:36.671543 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216b267-9ad7-4ae1-8ee5-81b35a5715cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:36.671814 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216b267-9ad7-4ae1-8ee5-81b35a5715cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:36.673582 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-5216b267-9ad7-4ae1-8ee5-81b35a5715cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:36.744200 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216b267-9ad7-4ae1-8ee5-81b35a5715cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:36.746511 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216b267-9ad7-4ae1-8ee5-81b35a5715cf service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:36.758177 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1249/2484] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:11:40.256521 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f131c-5ff9-4267-94a1-5ecc7eaab449 service swift] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:40.268460 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f131c-5ff9-4267-94a1-5ecc7eaab449 service swift] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:40.275165 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185d979-798d-4c16-8025-eea5a8d344ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:40.276128 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185d979-798d-4c16-8025-eea5a8d344ec service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:40.276593 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185d979-798d-4c16-8025-eea5a8d344ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:40.277014 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185d979-798d-4c16-8025-eea5a8d344ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:40.279979 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-7185d979-798d-4c16-8025-eea5a8d344ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:40.503900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185d979-798d-4c16-8025-eea5a8d344ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:40.506737 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185d979-798d-4c16-8025-eea5a8d344ec service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:40.550381 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1236/2485] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:11:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:11:42.326909 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216b267-9ad7-4ae1-8ee5-81b35a5715cf service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:42.330362 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-5216b267-9ad7-4ae1-8ee5-81b35a5715cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:42.348277 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216b267-9ad7-4ae1-8ee5-81b35a5715cf service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:42.355228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e77968-1b0a-4f9c-aad4-7861f12ffd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:42.356247 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e77968-1b0a-4f9c-aad4-7861f12ffd0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:42.356609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e77968-1b0a-4f9c-aad4-7861f12ffd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:42.356961 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e77968-1b0a-4f9c-aad4-7861f12ffd0b admin admin] PATH_INFO: `/v3/users/fb76fce14cf84b2bb4094fa2691777fe` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:42.359038 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e77968-1b0a-4f9c-aad4-7861f12ffd0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb76fce14cf84b2bb4094fa2691777fe)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:42.361096 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e77968-1b0a-4f9c-aad4-7861f12ffd0b admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:42.426024 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f5e77968-1b0a-4f9c-aad4-7861f12ffd0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb76fce14cf84b2bb4094fa2691777fe'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:42.426982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f5e77968-1b0a-4f9c-aad4-7861f12ffd0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb76fce14cf84b2bb4094fa2691777fe'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:42.467113 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f5e77968-1b0a-4f9c-aad4-7861f12ffd0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb76fce14cf84b2bb4094fa2691777fe'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:42.478322 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f5e77968-1b0a-4f9c-aad4-7861f12ffd0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb76fce14cf84b2bb4094fa2691777fe'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:42.487203 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f5e77968-1b0a-4f9c-aad4-7861f12ffd0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb76fce14cf84b2bb4094fa2691777fe'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:42.494785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1250/2486] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:11:42 2022] DELETE /identity/v3/users/fb76fce14cf84b2bb4094fa2691777fe => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:11:42.717062 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185d979-798d-4c16-8025-eea5a8d344ec service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:42.729774 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185d979-798d-4c16-8025-eea5a8d344ec service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:42.825291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5769d85-4ac1-4b76-a236-bebaf5fb3d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:42.826418 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5769d85-4ac1-4b76-a236-bebaf5fb3d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:42.826709 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5769d85-4ac1-4b76-a236-bebaf5fb3d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:42.826988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5769d85-4ac1-4b76-a236-bebaf5fb3d18 admin admin] PATH_INFO: `/v3/projects/3327601a4d59466dbe9fb4ad689616f2` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:42.828246 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5769d85-4ac1-4b76-a236-bebaf5fb3d18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3327601a4d59466dbe9fb4ad689616f2)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:42.830254 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5769d85-4ac1-4b76-a236-bebaf5fb3d18 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:42.906322 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e5769d85-4ac1-4b76-a236-bebaf5fb3d18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3327601a4d59466dbe9fb4ad689616f2', 'request_id': 'req-e5769d85-4ac1-4b76-a236-bebaf5fb3d18'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:42.915875 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e5769d85-4ac1-4b76-a236-bebaf5fb3d18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3327601a4d59466dbe9fb4ad689616f2', 'request_id': 'req-e5769d85-4ac1-4b76-a236-bebaf5fb3d18'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:42.928332 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e5769d85-4ac1-4b76-a236-bebaf5fb3d18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3327601a4d59466dbe9fb4ad689616f2', 'request_id': 'req-e5769d85-4ac1-4b76-a236-bebaf5fb3d18'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:42.950509 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e5769d85-4ac1-4b76-a236-bebaf5fb3d18 admin admin] The token cache is being invalidate because project 3327601a4d59466dbe9fb4ad689616f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:11:42.951230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e5769d85-4ac1-4b76-a236-bebaf5fb3d18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:42.952424 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e5769d85-4ac1-4b76-a236-bebaf5fb3d18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:42.955267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1237/2487] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:11:42 2022] DELETE /identity/v3/projects/3327601a4d59466dbe9fb4ad689616f2 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:11:42.960693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dc6ab-9183-464c-8e7e-db3f52073e64 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:42.962239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dc6ab-9183-464c-8e7e-db3f52073e64 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:42.962239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dc6ab-9183-464c-8e7e-db3f52073e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:42.992872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-bd0dc6ab-9183-464c-8e7e-db3f52073e64 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:11:42.994643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-bd0dc6ab-9183-464c-8e7e-db3f52073e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:43.089660 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1251/2488] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:11:43.099285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e06415-3770-4120-9de3-7439dc6f6212 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:43.099745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e06415-3770-4120-9de3-7439dc6f6212 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:43.100025 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e06415-3770-4120-9de3-7439dc6f6212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:43.120461 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-94e06415-3770-4120-9de3-7439dc6f6212 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:11:43.121698 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-94e06415-3770-4120-9de3-7439dc6f6212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:43.131740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1238/2489] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:11:43.135972 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dc6ab-9183-464c-8e7e-db3f52073e64 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:43.146421 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dc6ab-9183-464c-8e7e-db3f52073e64 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:43.151307 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de1a81-787b-4853-aade-dc837a785993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:43.152071 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de1a81-787b-4853-aade-dc837a785993 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:43.152358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de1a81-787b-4853-aade-dc837a785993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:43.153275 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de1a81-787b-4853-aade-dc837a785993 admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:43.154048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de1a81-787b-4853-aade-dc837a785993 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:11:43.154398 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de1a81-787b-4853-aade-dc837a785993 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:43.156099 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de1a81-787b-4853-aade-dc837a785993 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:43.169384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1252/2490] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:11:43.173663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e06415-3770-4120-9de3-7439dc6f6212 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:43.186078 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e06415-3770-4120-9de3-7439dc6f6212 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:43.193256 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574faa44-74ff-4900-a796-feebc6bcefa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:43.194149 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574faa44-74ff-4900-a796-feebc6bcefa8 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:43.195314 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574faa44-74ff-4900-a796-feebc6bcefa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:43.195314 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574faa44-74ff-4900-a796-feebc6bcefa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:43.195772 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574faa44-74ff-4900-a796-feebc6bcefa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:43.198020 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574faa44-74ff-4900-a796-feebc6bcefa8 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:43.233622 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1239/2491] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:11:43 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:11:43.234919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de1a81-787b-4853-aade-dc837a785993 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:43.245310 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de1a81-787b-4853-aade-dc837a785993 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:43.323877 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3082876-250e-48c7-9634-40b21997dfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:43.325021 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3082876-250e-48c7-9634-40b21997dfbe admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:43.325520 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3082876-250e-48c7-9634-40b21997dfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:43.326006 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3082876-250e-48c7-9634-40b21997dfbe admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:43.327179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3082876-250e-48c7-9634-40b21997dfbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:43.330139 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3082876-250e-48c7-9634-40b21997dfbe admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:43.359014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1253/2492] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:11:43 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:11:43.363751 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574faa44-74ff-4900-a796-feebc6bcefa8 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:43.375574 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574faa44-74ff-4900-a796-feebc6bcefa8 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:43.381505 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c8e0c-5f70-420b-90ad-632b7bfac3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:43.382237 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c8e0c-5f70-420b-90ad-632b7bfac3cc admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:43.382521 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c8e0c-5f70-420b-90ad-632b7bfac3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:43.382799 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c8e0c-5f70-420b-90ad-632b7bfac3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:43.383530 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c8e0c-5f70-420b-90ad-632b7bfac3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:43.385355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c8e0c-5f70-420b-90ad-632b7bfac3cc admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:43.397630 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1240/2493] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:11:43.401707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3082876-250e-48c7-9634-40b21997dfbe admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:43.413920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3082876-250e-48c7-9634-40b21997dfbe admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:43.419864 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e176b6-25f3-4f7e-93ac-7b6c7dd9934b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:43.420550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e176b6-25f3-4f7e-93ac-7b6c7dd9934b admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:43.420834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e176b6-25f3-4f7e-93ac-7b6c7dd9934b admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:43.421118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e176b6-25f3-4f7e-93ac-7b6c7dd9934b admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:43.421850 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e176b6-25f3-4f7e-93ac-7b6c7dd9934b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:43.423914 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e176b6-25f3-4f7e-93ac-7b6c7dd9934b admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:43.436955 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1254/2494] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:11:43.445511 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c8e0c-5f70-420b-90ad-632b7bfac3cc admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:43.464722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c8e0c-5f70-420b-90ad-632b7bfac3cc admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:43.473418 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864118a-0f01-4df8-941e-6ff96e1ba44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:43.475401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864118a-0f01-4df8-941e-6ff96e1ba44e admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:43.476273 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864118a-0f01-4df8-941e-6ff96e1ba44e admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:43.476777 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864118a-0f01-4df8-941e-6ff96e1ba44e admin admin] PATH_INFO: `/v3/projects/e20293595c62415a893d2f92e43c65b3/users/1da21ac84a754cdfbc6dc529e8cd8553/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:43.496733 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864118a-0f01-4df8-941e-6ff96e1ba44e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20293595c62415a893d2f92e43c65b3, user_id=1da21ac84a754cdfbc6dc529e8cd8553, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:43.502350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864118a-0f01-4df8-941e-6ff96e1ba44e admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:43.523852 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1241/2495] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:11:43 2022] PUT /identity/v3/projects/e20293595c62415a893d2f92e43c65b3/users/1da21ac84a754cdfbc6dc529e8cd8553/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:11:43.533859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bd4b1-0251-42b6-9f0c-912bb594bfb6 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:43.534148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bd4b1-0251-42b6-9f0c-912bb594bfb6 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:43.534676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bd4b1-0251-42b6-9f0c-912bb594bfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:43.565554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-7a1bd4b1-0251-42b6-9f0c-912bb594bfb6 None None] MFA Rules not processed for user `1da21ac84a754cdfbc6dc529e8cd8553`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:11:43.566832 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-7a1bd4b1-0251-42b6-9f0c-912bb594bfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:43.629539 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1255/2496] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:11:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:11:43.641352 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864118a-0f01-4df8-941e-6ff96e1ba44e admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:43.643150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-8864118a-0f01-4df8-941e-6ff96e1ba44e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:43.717858 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864118a-0f01-4df8-941e-6ff96e1ba44e admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:43.723610 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e68585-6d08-4019-bf0f-b92f67b89ffc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:43.724876 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e68585-6d08-4019-bf0f-b92f67b89ffc service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:43.725148 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e68585-6d08-4019-bf0f-b92f67b89ffc service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:43.725419 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e68585-6d08-4019-bf0f-b92f67b89ffc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:43.733574 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e68585-6d08-4019-bf0f-b92f67b89ffc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:43.735182 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e68585-6d08-4019-bf0f-b92f67b89ffc service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:43.744199 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1242/2497] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:11:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:11:44.141748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bd4b1-0251-42b6-9f0c-912bb594bfb6 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:44.206514 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bd4b1-0251-42b6-9f0c-912bb594bfb6 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:44.212986 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724bde2-6b1d-45a5-885f-46c5a26e9671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:44.214137 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724bde2-6b1d-45a5-885f-46c5a26e9671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:44.214599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724bde2-6b1d-45a5-885f-46c5a26e9671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:44.215103 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724bde2-6b1d-45a5-885f-46c5a26e9671 admin admin] PATH_INFO: `/v3/users/1da21ac84a754cdfbc6dc529e8cd8553` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:44.216480 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724bde2-6b1d-45a5-885f-46c5a26e9671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da21ac84a754cdfbc6dc529e8cd8553)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:44.219090 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724bde2-6b1d-45a5-885f-46c5a26e9671 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:44.282922 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a724bde2-6b1d-45a5-885f-46c5a26e9671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da21ac84a754cdfbc6dc529e8cd8553'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:44.284341 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a724bde2-6b1d-45a5-885f-46c5a26e9671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da21ac84a754cdfbc6dc529e8cd8553'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:44.297327 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a724bde2-6b1d-45a5-885f-46c5a26e9671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da21ac84a754cdfbc6dc529e8cd8553'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:44.311527 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a724bde2-6b1d-45a5-885f-46c5a26e9671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da21ac84a754cdfbc6dc529e8cd8553'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:44.322112 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-a724bde2-6b1d-45a5-885f-46c5a26e9671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da21ac84a754cdfbc6dc529e8cd8553'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:44.329353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1256/2498] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:11:44 2022] DELETE /identity/v3/users/1da21ac84a754cdfbc6dc529e8cd8553 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:11:44.333960 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7fb2c-d234-49f4-afc0-39e140c4d57d None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:44.334286 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7fb2c-d234-49f4-afc0-39e140c4d57d None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:44.334785 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7fb2c-d234-49f4-afc0-39e140c4d57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:44.361462 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-b7d7fb2c-d234-49f4-afc0-39e140c4d57d None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:11:44.363124 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b7d7fb2c-d234-49f4-afc0-39e140c4d57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:44.464280 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1243/2499] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:11:44.474773 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724bde2-6b1d-45a5-885f-46c5a26e9671 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:44.476359 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-a724bde2-6b1d-45a5-885f-46c5a26e9671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:44.543945 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724bde2-6b1d-45a5-885f-46c5a26e9671 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:44.547679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b5509-4b97-41f7-acd6-02a92bf0cff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:44.548348 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b5509-4b97-41f7-acd6-02a92bf0cff2 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:44.548619 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b5509-4b97-41f7-acd6-02a92bf0cff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:44.548895 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b5509-4b97-41f7-acd6-02a92bf0cff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:44.559943 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b5509-4b97-41f7-acd6-02a92bf0cff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:44.561441 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b5509-4b97-41f7-acd6-02a92bf0cff2 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:44.571313 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1257/2500] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:11:44.623442 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8dd15-d675-42c9-a8d7-b18a26c08f33 None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:44.623966 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8dd15-d675-42c9-a8d7-b18a26c08f33 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:44.623966 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8dd15-d675-42c9-a8d7-b18a26c08f33 None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:44.625686 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1244/2501] 10.222.0.32 () {54 vars in 921 bytes} [Tue May 10 14:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:11:44.634127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db5fe4-ccd0-4d05-8bce-9e4c40a91c3e None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:44.634445 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db5fe4-ccd0-4d05-8bce-9e4c40a91c3e None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:44.634719 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db5fe4-ccd0-4d05-8bce-9e4c40a91c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:44.653799 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-72db5fe4-ccd0-4d05-8bce-9e4c40a91c3e None None] MFA Rules not processed for user `e5d4fd26c21f4170a6790369344f8334`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:11:44.655041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-72db5fe4-ccd0-4d05-8bce-9e4c40a91c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:44.754594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1258/2502] 10.222.0.32 () {58 vars in 1018 bytes} [Tue May 10 14:11:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:11:44.781495 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8dd15-d675-42c9-a8d7-b18a26c08f33 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:44.783890 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-01b8dd15-d675-42c9-a8d7-b18a26c08f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:44.892285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8dd15-d675-42c9-a8d7-b18a26c08f33 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:44.897237 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b938e1-84ec-4e4e-9df4-d0aa59014ba5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada4e799ead24839b109377db3c6393b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:44.897922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b938e1-84ec-4e4e-9df4-d0aa59014ba5 service glance] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:44.898216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b938e1-84ec-4e4e-9df4-d0aa59014ba5 service glance] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:44.898514 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b938e1-84ec-4e4e-9df4-d0aa59014ba5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:44.909712 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b938e1-84ec-4e4e-9df4-d0aa59014ba5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:44.911204 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b938e1-84ec-4e4e-9df4-d0aa59014ba5 service glance] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:44.918956 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db5fe4-ccd0-4d05-8bce-9e4c40a91c3e None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:44.920564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-72db5fe4-ccd0-4d05-8bce-9e4c40a91c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:44.926475 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1245/2503] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:11:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:11:44.935774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db5fe4-ccd0-4d05-8bce-9e4c40a91c3e None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:44.942254 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10aca4-ae56-4007-aa19-50582ad0139c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:44.943448 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10aca4-ae56-4007-aa19-50582ad0139c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:44.943924 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10aca4-ae56-4007-aa19-50582ad0139c admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:44.944216 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10aca4-ae56-4007-aa19-50582ad0139c admin admin] PATH_INFO: `/v3/projects/e20293595c62415a893d2f92e43c65b3` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:44.945582 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10aca4-ae56-4007-aa19-50582ad0139c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e20293595c62415a893d2f92e43c65b3)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:44.947670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10aca4-ae56-4007-aa19-50582ad0139c admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:45.002540 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-3c10aca4-ae56-4007-aa19-50582ad0139c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e20293595c62415a893d2f92e43c65b3', 'request_id': 'req-3c10aca4-ae56-4007-aa19-50582ad0139c'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:45.008277 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-3c10aca4-ae56-4007-aa19-50582ad0139c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e20293595c62415a893d2f92e43c65b3', 'request_id': 'req-3c10aca4-ae56-4007-aa19-50582ad0139c'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:45.014708 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-3c10aca4-ae56-4007-aa19-50582ad0139c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e20293595c62415a893d2f92e43c65b3', 'request_id': 'req-3c10aca4-ae56-4007-aa19-50582ad0139c'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:45.027985 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-3c10aca4-ae56-4007-aa19-50582ad0139c admin admin] The token cache is being invalidate because project e20293595c62415a893d2f92e43c65b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:11:45.028265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-3c10aca4-ae56-4007-aa19-50582ad0139c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:45.028916 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-3c10aca4-ae56-4007-aa19-50582ad0139c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:45.030530 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1259/2504] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:11:44 2022] DELETE /identity/v3/projects/e20293595c62415a893d2f92e43c65b3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:11:45.035488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686c199-385c-4360-8818-409e54de3458 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:45.035776 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686c199-385c-4360-8818-409e54de3458 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:45.036269 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686c199-385c-4360-8818-409e54de3458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:45.057210 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-d686c199-385c-4360-8818-409e54de3458 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:11:45.058559 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-d686c199-385c-4360-8818-409e54de3458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:45.119146 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1246/2505] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:11:45.127950 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6554818-b63c-4256-a230-b426f2265d26 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:45.128239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6554818-b63c-4256-a230-b426f2265d26 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:45.128514 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6554818-b63c-4256-a230-b426f2265d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:45.149051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-a6554818-b63c-4256-a230-b426f2265d26 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:11:45.150391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-a6554818-b63c-4256-a230-b426f2265d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:45.158149 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1260/2506] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:11:45.163091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686c199-385c-4360-8818-409e54de3458 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:45.173146 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686c199-385c-4360-8818-409e54de3458 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:45.177808 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976c4ad-1268-4417-8af7-bca3c8d95906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:45.178497 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976c4ad-1268-4417-8af7-bca3c8d95906 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:45.178775 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976c4ad-1268-4417-8af7-bca3c8d95906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:45.179043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976c4ad-1268-4417-8af7-bca3c8d95906 admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:45.179791 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976c4ad-1268-4417-8af7-bca3c8d95906 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:11:45.180090 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976c4ad-1268-4417-8af7-bca3c8d95906 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:45.181660 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976c4ad-1268-4417-8af7-bca3c8d95906 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:45.193204 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1247/2507] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:11:45.197474 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6554818-b63c-4256-a230-b426f2265d26 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:45.206936 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6554818-b63c-4256-a230-b426f2265d26 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:45.212695 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674292c-f035-4126-822f-cf66fc59d4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:45.213351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674292c-f035-4126-822f-cf66fc59d4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:45.213639 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674292c-f035-4126-822f-cf66fc59d4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:45.213939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674292c-f035-4126-822f-cf66fc59d4d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:45.214654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674292c-f035-4126-822f-cf66fc59d4d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:45.216830 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674292c-f035-4126-822f-cf66fc59d4d0 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:45.245700 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1261/2508] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:11:45 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:11:45.250090 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976c4ad-1268-4417-8af7-bca3c8d95906 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:45.260681 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976c4ad-1268-4417-8af7-bca3c8d95906 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:45.320727 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da6bcf-fed7-4500-86ff-d160c6d8a6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:45.321412 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da6bcf-fed7-4500-86ff-d160c6d8a6d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:45.321693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da6bcf-fed7-4500-86ff-d160c6d8a6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:45.321963 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da6bcf-fed7-4500-86ff-d160c6d8a6d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:45.322824 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da6bcf-fed7-4500-86ff-d160c6d8a6d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:45.324955 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da6bcf-fed7-4500-86ff-d160c6d8a6d7 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:45.346049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1248/2509] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:11:45 2022] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:11:45.351446 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674292c-f035-4126-822f-cf66fc59d4d0 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:45.361388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674292c-f035-4126-822f-cf66fc59d4d0 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:45.367023 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497f3c7-f4f2-4da0-8ab5-e8597565b5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:45.367749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497f3c7-f4f2-4da0-8ab5-e8597565b5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:45.368237 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497f3c7-f4f2-4da0-8ab5-e8597565b5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:45.368572 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497f3c7-f4f2-4da0-8ab5-e8597565b5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:45.369385 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497f3c7-f4f2-4da0-8ab5-e8597565b5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:45.371201 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497f3c7-f4f2-4da0-8ab5-e8597565b5c5 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:45.384784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1262/2510] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:11:45.389283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da6bcf-fed7-4500-86ff-d160c6d8a6d7 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:45.403667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da6bcf-fed7-4500-86ff-d160c6d8a6d7 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:45.411051 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ac7a9-d1aa-452e-8112-0abdaa452bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:45.412672 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ac7a9-d1aa-452e-8112-0abdaa452bfc admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:45.413187 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ac7a9-d1aa-452e-8112-0abdaa452bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:45.413635 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ac7a9-d1aa-452e-8112-0abdaa452bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:45.414966 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ac7a9-d1aa-452e-8112-0abdaa452bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:45.417463 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ac7a9-d1aa-452e-8112-0abdaa452bfc admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:45.432908 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1249/2511] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:11:45.437428 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497f3c7-f4f2-4da0-8ab5-e8597565b5c5 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:45.448724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497f3c7-f4f2-4da0-8ab5-e8597565b5c5 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:45.454965 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5939e46-380f-467f-9a7b-e1940c0f7f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:45.456352 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5939e46-380f-467f-9a7b-e1940c0f7f8d admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:45.456800 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5939e46-380f-467f-9a7b-e1940c0f7f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:45.457114 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5939e46-380f-467f-9a7b-e1940c0f7f8d admin admin] PATH_INFO: `/v3/projects/dd51444eba09461c8c67ede624707553/users/bfe4dcec51fe447290785f8cf160f327/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:45.476167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5939e46-380f-467f-9a7b-e1940c0f7f8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd51444eba09461c8c67ede624707553, user_id=bfe4dcec51fe447290785f8cf160f327, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:45.480384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5939e46-380f-467f-9a7b-e1940c0f7f8d admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:45.496342 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1263/2512] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:11:45 2022] PUT /identity/v3/projects/dd51444eba09461c8c67ede624707553/users/bfe4dcec51fe447290785f8cf160f327/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:11:45.510499 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a41a2-3d90-4ab0-aade-e993646cbaa6 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:45.511059 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a41a2-3d90-4ab0-aade-e993646cbaa6 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:45.511356 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a41a2-3d90-4ab0-aade-e993646cbaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:45.541568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-c56a41a2-3d90-4ab0-aade-e993646cbaa6 None None] MFA Rules not processed for user `bfe4dcec51fe447290785f8cf160f327`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:11:45.542923 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-c56a41a2-3d90-4ab0-aade-e993646cbaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:45.637928 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1250/2513] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:11:45 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:11:45.643834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5939e46-380f-467f-9a7b-e1940c0f7f8d admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:45.713811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5939e46-380f-467f-9a7b-e1940c0f7f8d admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:45.722799 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da6a6a-f299-45d5-ae85-a67154db429c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:45.722799 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da6a6a-f299-45d5-ae85-a67154db429c admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:45.722799 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da6a6a-f299-45d5-ae85-a67154db429c admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:45.722799 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da6a6a-f299-45d5-ae85-a67154db429c admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:45.723393 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da6a6a-f299-45d5-ae85-a67154db429c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:45.726020 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da6a6a-f299-45d5-ae85-a67154db429c admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:45.758284 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1264/2514] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:11:45 2022] POST /identity/v3/projects => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:11:45.761719 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a41a2-3d90-4ab0-aade-e993646cbaa6 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:45.774071 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a41a2-3d90-4ab0-aade-e993646cbaa6 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:45.844059 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f5310-4b85-441a-b4b1-2592ac7f464b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:45.844745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f5310-4b85-441a-b4b1-2592ac7f464b admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:45.845030 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f5310-4b85-441a-b4b1-2592ac7f464b admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:45.845305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f5310-4b85-441a-b4b1-2592ac7f464b admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:45.846047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f5310-4b85-441a-b4b1-2592ac7f464b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:45.848007 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f5310-4b85-441a-b4b1-2592ac7f464b admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:45.871964 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1251/2515] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:11:45 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:11:45.876328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da6a6a-f299-45d5-ae85-a67154db429c admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:45.887700 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da6a6a-f299-45d5-ae85-a67154db429c admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:45.892550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa8e04-6106-422a-a76b-24caac1276ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:45.893325 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa8e04-6106-422a-a76b-24caac1276ad admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:45.893599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa8e04-6106-422a-a76b-24caac1276ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:45.893883 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa8e04-6106-422a-a76b-24caac1276ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:45.894369 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f5310-4b85-441a-b4b1-2592ac7f464b admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:45.894657 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa8e04-6106-422a-a76b-24caac1276ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:45.896590 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-fe2f5310-4b85-441a-b4b1-2592ac7f464b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:45.897718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa8e04-6106-422a-a76b-24caac1276ad admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:45.908813 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1265/2516] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:11:45.913649 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa8e04-6106-422a-a76b-24caac1276ad admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:45.923843 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa8e04-6106-422a-a76b-24caac1276ad admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:45.928695 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68a655-454f-468c-a856-ff5312797526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:45.929632 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68a655-454f-468c-a856-ff5312797526 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:45.929954 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68a655-454f-468c-a856-ff5312797526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:45.930251 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68a655-454f-468c-a856-ff5312797526 admin admin] PATH_INFO: `/v3/projects/c77fbd123ea64a698b848531eb1dafd4/users/a9a834e5b887438ca20a8e81bfa1d95c/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:45.945419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68a655-454f-468c-a856-ff5312797526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77fbd123ea64a698b848531eb1dafd4, user_id=a9a834e5b887438ca20a8e81bfa1d95c, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:45.948131 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68a655-454f-468c-a856-ff5312797526 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:45.965634 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1266/2517] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:11:45 2022] PUT /identity/v3/projects/c77fbd123ea64a698b848531eb1dafd4/users/a9a834e5b887438ca20a8e81bfa1d95c/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:11:45.966980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f5310-4b85-441a-b4b1-2592ac7f464b admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:45.971218 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68a655-454f-468c-a856-ff5312797526 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:46.041603 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ff103-7bae-47da-a2ca-f394da2c578d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:46.043226 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ff103-7bae-47da-a2ca-f394da2c578d service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:46.043952 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ff103-7bae-47da-a2ca-f394da2c578d service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:46.044676 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ff103-7bae-47da-a2ca-f394da2c578d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:46.048297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-784ff103-7bae-47da-a2ca-f394da2c578d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:46.070306 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68a655-454f-468c-a856-ff5312797526 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:46.078093 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40415f-ac12-4b12-8ac9-a5becc91d124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:46.079017 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40415f-ac12-4b12-8ac9-a5becc91d124 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:46.079442 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40415f-ac12-4b12-8ac9-a5becc91d124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:46.079845 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40415f-ac12-4b12-8ac9-a5becc91d124 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:46.080967 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40415f-ac12-4b12-8ac9-a5becc91d124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:46.083119 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40415f-ac12-4b12-8ac9-a5becc91d124 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:46.094434 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1267/2518] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:11:46.098428 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40415f-ac12-4b12-8ac9-a5becc91d124 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:46.108915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40415f-ac12-4b12-8ac9-a5becc91d124 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:46.115345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331f7c3-8a42-4257-9759-fb65f18a3491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:46.116505 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331f7c3-8a42-4257-9759-fb65f18a3491 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:46.116944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331f7c3-8a42-4257-9759-fb65f18a3491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:46.117191 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331f7c3-8a42-4257-9759-fb65f18a3491 admin admin] PATH_INFO: `/v3/projects/c77fbd123ea64a698b848531eb1dafd4/users/a9a834e5b887438ca20a8e81bfa1d95c/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:46.119403 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331f7c3-8a42-4257-9759-fb65f18a3491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77fbd123ea64a698b848531eb1dafd4, user_id=a9a834e5b887438ca20a8e81bfa1d95c, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:46.122130 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331f7c3-8a42-4257-9759-fb65f18a3491 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:46.134727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1268/2519] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:11:46 2022] PUT /identity/v3/projects/c77fbd123ea64a698b848531eb1dafd4/users/a9a834e5b887438ca20a8e81bfa1d95c/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:11:46.145407 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f2e41-8c99-4ed1-8968-1fb5f92396e0 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:46.145514 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ff103-7bae-47da-a2ca-f394da2c578d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:46.145724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f2e41-8c99-4ed1-8968-1fb5f92396e0 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:46.145724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f2e41-8c99-4ed1-8968-1fb5f92396e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:46.147280 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ff103-7bae-47da-a2ca-f394da2c578d service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:46.160565 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1252/2520] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:11:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:11:46.177710 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-3e5f2e41-8c99-4ed1-8968-1fb5f92396e0 None None] MFA Rules not processed for user `a9a834e5b887438ca20a8e81bfa1d95c`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:11:46.179057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-3e5f2e41-8c99-4ed1-8968-1fb5f92396e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:46.265545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1269/2521] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:11:46 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:11:46.278504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ff103-7bae-47da-a2ca-f394da2c578d service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:46.280092 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-784ff103-7bae-47da-a2ca-f394da2c578d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:46.342903 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ff103-7bae-47da-a2ca-f394da2c578d service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:46.398733 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5e5a6-9fc3-441e-97fc-933a25f4cc68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:46.399664 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5e5a6-9fc3-441e-97fc-933a25f4cc68 service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:46.399941 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5e5a6-9fc3-441e-97fc-933a25f4cc68 service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:46.400232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5e5a6-9fc3-441e-97fc-933a25f4cc68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:46.410588 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf5e5a6-9fc3-441e-97fc-933a25f4cc68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:46.413158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf5e5a6-9fc3-441e-97fc-933a25f4cc68 service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:46.424607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1253/2522] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:11:46 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:11:46.500846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f2e41-8c99-4ed1-8968-1fb5f92396e0 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:46.510969 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f2e41-8c99-4ed1-8968-1fb5f92396e0 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:46.514923 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7c9b4-babb-405d-bfe4-15d971857f12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:46.515607 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7c9b4-babb-405d-bfe4-15d971857f12 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:46.515904 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7c9b4-babb-405d-bfe4-15d971857f12 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:46.516574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7c9b4-babb-405d-bfe4-15d971857f12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:46.575258 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7c9b4-babb-405d-bfe4-15d971857f12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:46.576723 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7c9b4-babb-405d-bfe4-15d971857f12 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:46.585727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1270/2523] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:11:46 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:11:46.915215 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5e5a6-9fc3-441e-97fc-933a25f4cc68 service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:46.973584 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5e5a6-9fc3-441e-97fc-933a25f4cc68 service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:46.977781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc35462-11d5-4d6c-9fc8-c095001d12ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:46.978457 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc35462-11d5-4d6c-9fc8-c095001d12ca service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:46.978737 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc35462-11d5-4d6c-9fc8-c095001d12ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:46.979008 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc35462-11d5-4d6c-9fc8-c095001d12ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:46.980870 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-7cc35462-11d5-4d6c-9fc8-c095001d12ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:47.049085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc35462-11d5-4d6c-9fc8-c095001d12ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:47.050601 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc35462-11d5-4d6c-9fc8-c095001d12ca service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:47.063148 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1254/2524] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:11:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:11:48.296126 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2961d1a-8cdc-4f20-95ae-6b6df7454b6f None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:48.296708 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2961d1a-8cdc-4f20-95ae-6b6df7454b6f None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:48.296708 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2961d1a-8cdc-4f20-95ae-6b6df7454b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:48.317706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-c2961d1a-8cdc-4f20-95ae-6b6df7454b6f None None] MFA Rules not processed for user `686c869be43c40a9b63b3647bf689c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:11:48.319801 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c2961d1a-8cdc-4f20-95ae-6b6df7454b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:48.387358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1271/2525] 10.222.0.32 () {58 vars in 1009 bytes} [Tue May 10 14:11:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:11:48.399801 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc35462-11d5-4d6c-9fc8-c095001d12ca service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:48.401255 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-7cc35462-11d5-4d6c-9fc8-c095001d12ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:48.476817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc35462-11d5-4d6c-9fc8-c095001d12ca service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:48.481758 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea07e8d-7faa-4c79-8b19-e566d696a180 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bbad5318b6417087d7ce6906f8281f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:48.482442 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea07e8d-7faa-4c79-8b19-e566d696a180 service swift] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:48.482725 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea07e8d-7faa-4c79-8b19-e566d696a180 service swift] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:48.482999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea07e8d-7faa-4c79-8b19-e566d696a180 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:48.491571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea07e8d-7faa-4c79-8b19-e566d696a180 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:48.493163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea07e8d-7faa-4c79-8b19-e566d696a180 service swift] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:48.501515 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1255/2526] 10.222.0.32 () {60 vars in 1384 bytes} [Tue May 10 14:11:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:11:51.460047 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2961d1a-8cdc-4f20-95ae-6b6df7454b6f None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:51.460913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c2961d1a-8cdc-4f20-95ae-6b6df7454b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:51.503730 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2961d1a-8cdc-4f20-95ae-6b6df7454b6f None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:51.508719 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fbe0f-9fb0-4a70-994d-b03b1456465c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:51.509754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fbe0f-9fb0-4a70-994d-b03b1456465c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:51.510031 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fbe0f-9fb0-4a70-994d-b03b1456465c admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:51.510400 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fbe0f-9fb0-4a70-994d-b03b1456465c admin admin] PATH_INFO: `/v3/users/c98a5fc7863942c5b389aa9766d31129` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:51.527679 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fbe0f-9fb0-4a70-994d-b03b1456465c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c98a5fc7863942c5b389aa9766d31129)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:51.529597 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fbe0f-9fb0-4a70-994d-b03b1456465c admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:51.595395 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-973fbe0f-9fb0-4a70-994d-b03b1456465c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c98a5fc7863942c5b389aa9766d31129'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:51.596553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-973fbe0f-9fb0-4a70-994d-b03b1456465c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c98a5fc7863942c5b389aa9766d31129'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:51.615161 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-973fbe0f-9fb0-4a70-994d-b03b1456465c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c98a5fc7863942c5b389aa9766d31129'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:51.628167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-973fbe0f-9fb0-4a70-994d-b03b1456465c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c98a5fc7863942c5b389aa9766d31129'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:51.636574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-973fbe0f-9fb0-4a70-994d-b03b1456465c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c98a5fc7863942c5b389aa9766d31129'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:51.646879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1272/2527] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:11:51 2022] DELETE /identity/v3/users/c98a5fc7863942c5b389aa9766d31129 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:11:51.839816 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea07e8d-7faa-4c79-8b19-e566d696a180 service swift] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:51.857846 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea07e8d-7faa-4c79-8b19-e566d696a180 service swift] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:51.913748 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb5410-0ade-4496-a1ed-97d0a739325d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:51.914681 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb5410-0ade-4496-a1ed-97d0a739325d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:51.914966 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb5410-0ade-4496-a1ed-97d0a739325d admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:51.915240 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb5410-0ade-4496-a1ed-97d0a739325d admin admin] PATH_INFO: `/v3/projects/47d6a9eb6fd3415d9059fe567e2dfa02` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:51.925542 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb5410-0ade-4496-a1ed-97d0a739325d admin admin] RBAC: Authorizing `identity:delete_project(project_id=47d6a9eb6fd3415d9059fe567e2dfa02)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:51.928209 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb5410-0ade-4496-a1ed-97d0a739325d admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:51.972035 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-cffb5410-0ade-4496-a1ed-97d0a739325d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47d6a9eb6fd3415d9059fe567e2dfa02', 'request_id': 'req-cffb5410-0ade-4496-a1ed-97d0a739325d'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:51.977540 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-cffb5410-0ade-4496-a1ed-97d0a739325d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47d6a9eb6fd3415d9059fe567e2dfa02', 'request_id': 'req-cffb5410-0ade-4496-a1ed-97d0a739325d'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:51.985379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-cffb5410-0ade-4496-a1ed-97d0a739325d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47d6a9eb6fd3415d9059fe567e2dfa02', 'request_id': 'req-cffb5410-0ade-4496-a1ed-97d0a739325d'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:51.998533 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-cffb5410-0ade-4496-a1ed-97d0a739325d admin admin] The token cache is being invalidate because project 47d6a9eb6fd3415d9059fe567e2dfa02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:11:51.998921 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-cffb5410-0ade-4496-a1ed-97d0a739325d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:51.999552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-cffb5410-0ade-4496-a1ed-97d0a739325d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:52.001046 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1256/2528] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:11:51 2022] DELETE /identity/v3/projects/47d6a9eb6fd3415d9059fe567e2dfa02 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:11:52.006610 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaf17b-9343-4277-b015-a4908a88a64b None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:52.006903 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaf17b-9343-4277-b015-a4908a88a64b None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:52.007183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaf17b-9343-4277-b015-a4908a88a64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:52.025911 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-59eaf17b-9343-4277-b015-a4908a88a64b None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:11:52.027128 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-59eaf17b-9343-4277-b015-a4908a88a64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:52.087687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1273/2529] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:11:52.095750 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c616d25-e5cc-4aed-a869-adb49cf6fa59 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:52.095750 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c616d25-e5cc-4aed-a869-adb49cf6fa59 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:52.095956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c616d25-e5cc-4aed-a869-adb49cf6fa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:52.113864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-0c616d25-e5cc-4aed-a869-adb49cf6fa59 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:11:52.116103 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-0c616d25-e5cc-4aed-a869-adb49cf6fa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:52.124591 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1257/2530] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:11:52.128774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaf17b-9343-4277-b015-a4908a88a64b None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:52.140125 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaf17b-9343-4277-b015-a4908a88a64b None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:52.145175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f4360-42b8-4db9-bc20-87b2a1dc4bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:52.146353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f4360-42b8-4db9-bc20-87b2a1dc4bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:52.146744 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f4360-42b8-4db9-bc20-87b2a1dc4bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:52.147030 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f4360-42b8-4db9-bc20-87b2a1dc4bd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:52.147774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f4360-42b8-4db9-bc20-87b2a1dc4bd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:11:52.148090 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f4360-42b8-4db9-bc20-87b2a1dc4bd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:52.149686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f4360-42b8-4db9-bc20-87b2a1dc4bd5 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:52.162096 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1274/2531] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:11:52.166623 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c616d25-e5cc-4aed-a869-adb49cf6fa59 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:52.175641 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c616d25-e5cc-4aed-a869-adb49cf6fa59 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:52.180926 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e9492-58f0-4099-ab02-d547a4409670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:52.181569 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e9492-58f0-4099-ab02-d547a4409670 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:52.181850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e9492-58f0-4099-ab02-d547a4409670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:52.182124 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e9492-58f0-4099-ab02-d547a4409670 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:52.182916 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e9492-58f0-4099-ab02-d547a4409670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:52.184792 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e9492-58f0-4099-ab02-d547a4409670 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:52.209385 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1258/2532] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:11:52 2022] POST /identity/v3/projects => generated 405 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:11:52.213837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f4360-42b8-4db9-bc20-87b2a1dc4bd5 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:52.224458 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f4360-42b8-4db9-bc20-87b2a1dc4bd5 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:52.277816 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42db831-08d4-4dc0-9e94-6e74516c45a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:52.278509 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42db831-08d4-4dc0-9e94-6e74516c45a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:52.278790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42db831-08d4-4dc0-9e94-6e74516c45a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:52.279062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42db831-08d4-4dc0-9e94-6e74516c45a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:52.279736 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42db831-08d4-4dc0-9e94-6e74516c45a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:52.281623 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42db831-08d4-4dc0-9e94-6e74516c45a7 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:52.302470 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1275/2533] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:11:52 2022] POST /identity/v3/users => generated 303 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:11:52.306599 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e9492-58f0-4099-ab02-d547a4409670 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:52.316641 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e9492-58f0-4099-ab02-d547a4409670 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:52.321838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2266f9c-efc0-4098-8eff-1ae0944a9732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:52.322583 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2266f9c-efc0-4098-8eff-1ae0944a9732 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:52.322864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2266f9c-efc0-4098-8eff-1ae0944a9732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:52.323143 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2266f9c-efc0-4098-8eff-1ae0944a9732 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:52.324072 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2266f9c-efc0-4098-8eff-1ae0944a9732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:52.325656 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2266f9c-efc0-4098-8eff-1ae0944a9732 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:52.336292 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1259/2534] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:11:52.339995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42db831-08d4-4dc0-9e94-6e74516c45a7 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:52.351098 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42db831-08d4-4dc0-9e94-6e74516c45a7 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:52.355790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cc978-13bd-4382-86fd-5b77c2548fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:52.356438 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cc978-13bd-4382-86fd-5b77c2548fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:52.356723 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cc978-13bd-4382-86fd-5b77c2548fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:52.356999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cc978-13bd-4382-86fd-5b77c2548fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:52.357726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cc978-13bd-4382-86fd-5b77c2548fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:52.359339 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cc978-13bd-4382-86fd-5b77c2548fa7 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:52.373731 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1276/2535] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:11:52.375018 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2266f9c-efc0-4098-8eff-1ae0944a9732 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:52.385133 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2266f9c-efc0-4098-8eff-1ae0944a9732 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:52.389768 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f315e7-affa-4464-9f95-56eca8ad90e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:52.390664 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f315e7-affa-4464-9f95-56eca8ad90e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:52.391059 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f315e7-affa-4464-9f95-56eca8ad90e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:52.391221 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f315e7-affa-4464-9f95-56eca8ad90e8 admin admin] PATH_INFO: `/v3/projects/5b0751990b234861977272bb98a5594b/users/b4d38be4f50d4e5fa25913d9bae6e721/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:52.406073 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f315e7-affa-4464-9f95-56eca8ad90e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0751990b234861977272bb98a5594b, user_id=b4d38be4f50d4e5fa25913d9bae6e721, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:52.408874 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f315e7-affa-4464-9f95-56eca8ad90e8 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:52.422323 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1260/2536] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:11:52 2022] PUT /identity/v3/projects/5b0751990b234861977272bb98a5594b/users/b4d38be4f50d4e5fa25913d9bae6e721/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:11:52.428173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d91e1-8482-4a56-8bd8-42651fd76085 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:52.428453 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d91e1-8482-4a56-8bd8-42651fd76085 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:52.428727 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d91e1-8482-4a56-8bd8-42651fd76085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:52.446286 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-123d91e1-8482-4a56-8bd8-42651fd76085 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:11:52.447480 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-123d91e1-8482-4a56-8bd8-42651fd76085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:52.504783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1277/2537] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:11:52.514701 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f315e7-affa-4464-9f95-56eca8ad90e8 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:52.516364 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-71f315e7-affa-4464-9f95-56eca8ad90e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:52.571024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f315e7-affa-4464-9f95-56eca8ad90e8 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:52.574646 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f232170-a282-4714-a6f0-f21aa23b62dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:52.575279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f232170-a282-4714-a6f0-f21aa23b62dd service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:52.575561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f232170-a282-4714-a6f0-f21aa23b62dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:52.575836 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f232170-a282-4714-a6f0-f21aa23b62dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:52.585146 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f232170-a282-4714-a6f0-f21aa23b62dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:52.586606 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f232170-a282-4714-a6f0-f21aa23b62dd service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:52.595740 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1261/2538] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:11:53.368136 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1412c6-32c2-4b21-83f1-583536cfa594 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:53.368459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1412c6-32c2-4b21-83f1-583536cfa594 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:53.368759 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1412c6-32c2-4b21-83f1-583536cfa594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:53.399151 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-2f1412c6-32c2-4b21-83f1-583536cfa594 None None] MFA Rules not processed for user `b4d38be4f50d4e5fa25913d9bae6e721`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:11:53.400569 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-2f1412c6-32c2-4b21-83f1-583536cfa594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:53.487368 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1278/2539] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:11:53 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:11:53.493023 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f232170-a282-4714-a6f0-f21aa23b62dd service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:53.503314 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f232170-a282-4714-a6f0-f21aa23b62dd service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:53.517437 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572423c-639e-46d7-a4d0-7dcc9e2ea106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:53.518492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572423c-639e-46d7-a4d0-7dcc9e2ea106 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:53.518949 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572423c-639e-46d7-a4d0-7dcc9e2ea106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:53.519408 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572423c-639e-46d7-a4d0-7dcc9e2ea106 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:53.520297 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572423c-639e-46d7-a4d0-7dcc9e2ea106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:53.522812 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572423c-639e-46d7-a4d0-7dcc9e2ea106 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:53.553697 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1262/2540] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:11:53 2022] POST /identity/v3/projects => generated 403 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:11:53.555185 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1412c6-32c2-4b21-83f1-583536cfa594 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:53.568979 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1412c6-32c2-4b21-83f1-583536cfa594 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:53.650156 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec5051-5dc0-4036-a82e-6d909913e44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:53.650866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec5051-5dc0-4036-a82e-6d909913e44f admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:53.651147 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec5051-5dc0-4036-a82e-6d909913e44f admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:53.651422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec5051-5dc0-4036-a82e-6d909913e44f admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:53.652112 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec5051-5dc0-4036-a82e-6d909913e44f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:53.654022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec5051-5dc0-4036-a82e-6d909913e44f admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:53.675106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1279/2541] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:11:53 2022] POST /identity/v3/users => generated 308 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:11:53.679095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572423c-639e-46d7-a4d0-7dcc9e2ea106 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:53.688904 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572423c-639e-46d7-a4d0-7dcc9e2ea106 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:53.693900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd7850-bd66-4811-9f89-d1501785e25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:53.694571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd7850-bd66-4811-9f89-d1501785e25c admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:53.694848 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd7850-bd66-4811-9f89-d1501785e25c admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:53.695121 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd7850-bd66-4811-9f89-d1501785e25c admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:53.695838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd7850-bd66-4811-9f89-d1501785e25c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:53.697432 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd7850-bd66-4811-9f89-d1501785e25c admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:53.707675 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1263/2542] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:11:53.712980 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec5051-5dc0-4036-a82e-6d909913e44f admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:53.723261 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec5051-5dc0-4036-a82e-6d909913e44f admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:53.727989 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8823b1-e1b7-4821-8559-94885eb4523e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:53.728866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8823b1-e1b7-4821-8559-94885eb4523e admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:53.729153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8823b1-e1b7-4821-8559-94885eb4523e admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:53.729419 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8823b1-e1b7-4821-8559-94885eb4523e admin admin] PATH_INFO: `/v3/projects/92161f5dd622436386cbcc7ed16dcb32/users/f19ff658bb5d42428b592fcd079ca28a/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:53.743988 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8823b1-e1b7-4821-8559-94885eb4523e admin admin] RBAC: Authorizing `identity:create_grant(project_id=92161f5dd622436386cbcc7ed16dcb32, user_id=f19ff658bb5d42428b592fcd079ca28a, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:53.746587 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8823b1-e1b7-4821-8559-94885eb4523e admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:53.759585 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1280/2543] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:11:53 2022] PUT /identity/v3/projects/92161f5dd622436386cbcc7ed16dcb32/users/f19ff658bb5d42428b592fcd079ca28a/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:11:53.763673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd7850-bd66-4811-9f89-d1501785e25c admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:53.773969 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd7850-bd66-4811-9f89-d1501785e25c admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:53.827344 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9d484-00c9-41d6-82a2-9f7cb4ca4059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:53.827999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9d484-00c9-41d6-82a2-9f7cb4ca4059 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:53.828279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9d484-00c9-41d6-82a2-9f7cb4ca4059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:53.828549 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9d484-00c9-41d6-82a2-9f7cb4ca4059 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:53.829262 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9d484-00c9-41d6-82a2-9f7cb4ca4059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:53.830944 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9d484-00c9-41d6-82a2-9f7cb4ca4059 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:53.841505 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1264/2544] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:11:53.845746 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8823b1-e1b7-4821-8559-94885eb4523e admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:53.856189 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8823b1-e1b7-4821-8559-94885eb4523e admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:53.860891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b80a41-451e-47e0-81e9-2ee0c5d57efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:53.861774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b80a41-451e-47e0-81e9-2ee0c5d57efa admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:53.862057 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b80a41-451e-47e0-81e9-2ee0c5d57efa admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:53.862368 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b80a41-451e-47e0-81e9-2ee0c5d57efa admin admin] PATH_INFO: `/v3/projects/92161f5dd622436386cbcc7ed16dcb32/users/f19ff658bb5d42428b592fcd079ca28a/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:53.864365 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b80a41-451e-47e0-81e9-2ee0c5d57efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=92161f5dd622436386cbcc7ed16dcb32, user_id=f19ff658bb5d42428b592fcd079ca28a, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:53.867029 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b80a41-451e-47e0-81e9-2ee0c5d57efa admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:53.877347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1281/2545] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:11:53 2022] PUT /identity/v3/projects/92161f5dd622436386cbcc7ed16dcb32/users/f19ff658bb5d42428b592fcd079ca28a/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:11:54.637836 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b3ae3-7cde-4106-80cd-c447b1300b04 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:54.638384 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b3ae3-7cde-4106-80cd-c447b1300b04 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:54.638480 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b3ae3-7cde-4106-80cd-c447b1300b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:54.672274 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-e08b3ae3-7cde-4106-80cd-c447b1300b04 None None] MFA Rules not processed for user `f19ff658bb5d42428b592fcd079ca28a`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:11:54.673579 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-e08b3ae3-7cde-4106-80cd-c447b1300b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:54.782173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1265/2546] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:11:54 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:11:55.860642 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b80a41-451e-47e0-81e9-2ee0c5d57efa admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:55.954608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b80a41-451e-47e0-81e9-2ee0c5d57efa admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:55.960788 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e22115-3c32-4da4-ae34-92a5f938e4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:55.961726 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e22115-3c32-4da4-ae34-92a5f938e4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:55.962011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e22115-3c32-4da4-ae34-92a5f938e4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:55.962331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e22115-3c32-4da4-ae34-92a5f938e4a0 admin admin] PATH_INFO: `/v3/users/b4d38be4f50d4e5fa25913d9bae6e721` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:55.963534 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e22115-3c32-4da4-ae34-92a5f938e4a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d38be4f50d4e5fa25913d9bae6e721)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:55.965474 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e22115-3c32-4da4-ae34-92a5f938e4a0 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:56.014119 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-65e22115-3c32-4da4-ae34-92a5f938e4a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d38be4f50d4e5fa25913d9bae6e721'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:56.014799 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-65e22115-3c32-4da4-ae34-92a5f938e4a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d38be4f50d4e5fa25913d9bae6e721'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:56.026764 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-65e22115-3c32-4da4-ae34-92a5f938e4a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d38be4f50d4e5fa25913d9bae6e721'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:56.033585 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-65e22115-3c32-4da4-ae34-92a5f938e4a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d38be4f50d4e5fa25913d9bae6e721'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:56.041431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-65e22115-3c32-4da4-ae34-92a5f938e4a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d38be4f50d4e5fa25913d9bae6e721'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:56.054096 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1282/2547] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:11:55 2022] DELETE /identity/v3/users/b4d38be4f50d4e5fa25913d9bae6e721 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:11:56.252891 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b3ae3-7cde-4106-80cd-c447b1300b04 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:56.265095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b3ae3-7cde-4106-80cd-c447b1300b04 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:56.336042 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db3569-9266-406e-966f-286cc8bf27b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:56.337399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db3569-9266-406e-966f-286cc8bf27b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:56.337859 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db3569-9266-406e-966f-286cc8bf27b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:56.338127 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db3569-9266-406e-966f-286cc8bf27b5 admin admin] PATH_INFO: `/v3/projects/5b0751990b234861977272bb98a5594b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:56.339724 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db3569-9266-406e-966f-286cc8bf27b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b0751990b234861977272bb98a5594b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:56.341839 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db3569-9266-406e-966f-286cc8bf27b5 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:56.391268 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f1db3569-9266-406e-966f-286cc8bf27b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b0751990b234861977272bb98a5594b', 'request_id': 'req-f1db3569-9266-406e-966f-286cc8bf27b5'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:56.397855 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f1db3569-9266-406e-966f-286cc8bf27b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b0751990b234861977272bb98a5594b', 'request_id': 'req-f1db3569-9266-406e-966f-286cc8bf27b5'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:56.404727 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f1db3569-9266-406e-966f-286cc8bf27b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b0751990b234861977272bb98a5594b', 'request_id': 'req-f1db3569-9266-406e-966f-286cc8bf27b5'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:56.419079 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f1db3569-9266-406e-966f-286cc8bf27b5 admin admin] The token cache is being invalidate because project 5b0751990b234861977272bb98a5594b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:11:56.419384 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f1db3569-9266-406e-966f-286cc8bf27b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:56.420009 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f1db3569-9266-406e-966f-286cc8bf27b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:56.421614 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1266/2548] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:11:56 2022] DELETE /identity/v3/projects/5b0751990b234861977272bb98a5594b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:11:56.425623 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e22115-3c32-4da4-ae34-92a5f938e4a0 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:56.427190 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-65e22115-3c32-4da4-ae34-92a5f938e4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:56.441785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e22115-3c32-4da4-ae34-92a5f938e4a0 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:56.499915 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3aaabe-58de-4236-ab1a-69265dd086d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:56.500787 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3aaabe-58de-4236-ab1a-69265dd086d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:56.501063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3aaabe-58de-4236-ab1a-69265dd086d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:56.501332 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3aaabe-58de-4236-ab1a-69265dd086d9 admin admin] PATH_INFO: `/v3/users/f19ff658bb5d42428b592fcd079ca28a` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:56.502538 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3aaabe-58de-4236-ab1a-69265dd086d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f19ff658bb5d42428b592fcd079ca28a)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:56.504432 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3aaabe-58de-4236-ab1a-69265dd086d9 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:56.551093 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0a3aaabe-58de-4236-ab1a-69265dd086d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f19ff658bb5d42428b592fcd079ca28a'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:56.551853 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0a3aaabe-58de-4236-ab1a-69265dd086d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f19ff658bb5d42428b592fcd079ca28a'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:56.563316 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0a3aaabe-58de-4236-ab1a-69265dd086d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f19ff658bb5d42428b592fcd079ca28a'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:56.570734 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0a3aaabe-58de-4236-ab1a-69265dd086d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f19ff658bb5d42428b592fcd079ca28a'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:56.577748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0a3aaabe-58de-4236-ab1a-69265dd086d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f19ff658bb5d42428b592fcd079ca28a'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:56.584388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1283/2549] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:11:56 2022] DELETE /identity/v3/users/f19ff658bb5d42428b592fcd079ca28a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:11:56.913377 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db3569-9266-406e-966f-286cc8bf27b5 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:56.914972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-f1db3569-9266-406e-966f-286cc8bf27b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:56.929172 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db3569-9266-406e-966f-286cc8bf27b5 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:56.988820 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84885af6-752e-45d2-8482-f1564f1530cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:56.990339 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84885af6-752e-45d2-8482-f1564f1530cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:56.990630 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84885af6-752e-45d2-8482-f1564f1530cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:56.990899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84885af6-752e-45d2-8482-f1564f1530cb admin admin] PATH_INFO: `/v3/projects/92161f5dd622436386cbcc7ed16dcb32` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:56.992091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84885af6-752e-45d2-8482-f1564f1530cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=92161f5dd622436386cbcc7ed16dcb32)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:56.993984 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84885af6-752e-45d2-8482-f1564f1530cb admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:57.065970 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-84885af6-752e-45d2-8482-f1564f1530cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92161f5dd622436386cbcc7ed16dcb32', 'request_id': 'req-84885af6-752e-45d2-8482-f1564f1530cb'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:57.072965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-84885af6-752e-45d2-8482-f1564f1530cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92161f5dd622436386cbcc7ed16dcb32', 'request_id': 'req-84885af6-752e-45d2-8482-f1564f1530cb'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:57.081310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-84885af6-752e-45d2-8482-f1564f1530cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92161f5dd622436386cbcc7ed16dcb32', 'request_id': 'req-84885af6-752e-45d2-8482-f1564f1530cb'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:57.102679 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-84885af6-752e-45d2-8482-f1564f1530cb admin admin] The token cache is being invalidate because project 92161f5dd622436386cbcc7ed16dcb32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:11:57.103199 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-84885af6-752e-45d2-8482-f1564f1530cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:57.104220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-84885af6-752e-45d2-8482-f1564f1530cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:57.106373 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1267/2550] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:11:56 2022] DELETE /identity/v3/projects/92161f5dd622436386cbcc7ed16dcb32 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:11:57.111159 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a8f5e-bd5c-417b-8978-8c79e4294310 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:57.111676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a8f5e-bd5c-417b-8978-8c79e4294310 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:57.111788 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a8f5e-bd5c-417b-8978-8c79e4294310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:57.147635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-649a8f5e-bd5c-417b-8978-8c79e4294310 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:11:57.149450 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-649a8f5e-bd5c-417b-8978-8c79e4294310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:57.220994 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1284/2551] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:11:57.230268 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3e1ec-9f85-4757-a2c9-8fd5dda267a9 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:57.230561 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3e1ec-9f85-4757-a2c9-8fd5dda267a9 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:57.230841 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3e1ec-9f85-4757-a2c9-8fd5dda267a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:57.251209 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-50b3e1ec-9f85-4757-a2c9-8fd5dda267a9 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:11:57.252499 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-50b3e1ec-9f85-4757-a2c9-8fd5dda267a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:57.261626 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1268/2552] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:11:57.266488 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a8f5e-bd5c-417b-8978-8c79e4294310 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:57.276846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a8f5e-bd5c-417b-8978-8c79e4294310 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:57.281376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0b51e-308d-47ef-b1e2-1e5e91dfbb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:57.282033 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0b51e-308d-47ef-b1e2-1e5e91dfbb9f admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:57.282340 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0b51e-308d-47ef-b1e2-1e5e91dfbb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:57.282613 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0b51e-308d-47ef-b1e2-1e5e91dfbb9f admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:57.283334 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0b51e-308d-47ef-b1e2-1e5e91dfbb9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:11:57.283637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0b51e-308d-47ef-b1e2-1e5e91dfbb9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:57.285239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0b51e-308d-47ef-b1e2-1e5e91dfbb9f admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:57.297897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1285/2553] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:11:57.302829 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3e1ec-9f85-4757-a2c9-8fd5dda267a9 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:57.313629 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3e1ec-9f85-4757-a2c9-8fd5dda267a9 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:57.319078 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6481d3-ec51-44f6-9bc3-15b499ded328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:57.319766 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6481d3-ec51-44f6-9bc3-15b499ded328 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:57.320047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6481d3-ec51-44f6-9bc3-15b499ded328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:57.320323 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6481d3-ec51-44f6-9bc3-15b499ded328 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:57.321083 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6481d3-ec51-44f6-9bc3-15b499ded328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:57.323105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6481d3-ec51-44f6-9bc3-15b499ded328 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:57.350734 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1269/2554] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:11:57 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:11:57.355327 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0b51e-308d-47ef-b1e2-1e5e91dfbb9f admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:57.366299 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0b51e-308d-47ef-b1e2-1e5e91dfbb9f admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:57.437269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53487ba-f020-4449-ab0b-81762c54c701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:57.438457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53487ba-f020-4449-ab0b-81762c54c701 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:57.438849 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53487ba-f020-4449-ab0b-81762c54c701 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:57.439130 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53487ba-f020-4449-ab0b-81762c54c701 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:57.439830 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53487ba-f020-4449-ab0b-81762c54c701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:57.441829 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53487ba-f020-4449-ab0b-81762c54c701 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:57.466709 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1286/2555] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:11:57 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:11:57.470881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6481d3-ec51-44f6-9bc3-15b499ded328 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:57.481875 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6481d3-ec51-44f6-9bc3-15b499ded328 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:57.486522 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd1e80-ca8f-4998-af70-7ff3286ca5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:57.487189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd1e80-ca8f-4998-af70-7ff3286ca5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:57.487489 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd1e80-ca8f-4998-af70-7ff3286ca5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:57.487746 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd1e80-ca8f-4998-af70-7ff3286ca5b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:57.488538 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd1e80-ca8f-4998-af70-7ff3286ca5b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:57.490692 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd1e80-ca8f-4998-af70-7ff3286ca5b5 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:57.501098 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1270/2556] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:11:57.505792 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53487ba-f020-4449-ab0b-81762c54c701 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:57.515454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53487ba-f020-4449-ab0b-81762c54c701 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:57.520007 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd3a4b-04b0-499d-a9bc-f2fc00ee1f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:57.521220 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd3a4b-04b0-499d-a9bc-f2fc00ee1f66 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:57.521495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd3a4b-04b0-499d-a9bc-f2fc00ee1f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:57.521764 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd3a4b-04b0-499d-a9bc-f2fc00ee1f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:57.522543 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd3a4b-04b0-499d-a9bc-f2fc00ee1f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:57.524099 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd3a4b-04b0-499d-a9bc-f2fc00ee1f66 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:57.533689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1287/2557] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:11:57.537719 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd1e80-ca8f-4998-af70-7ff3286ca5b5 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:57.547366 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd1e80-ca8f-4998-af70-7ff3286ca5b5 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:57.552055 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeab0a3-73f2-42ac-b891-aabed2171f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:57.552926 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeab0a3-73f2-42ac-b891-aabed2171f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:57.553207 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeab0a3-73f2-42ac-b891-aabed2171f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:57.553481 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeab0a3-73f2-42ac-b891-aabed2171f1c admin admin] PATH_INFO: `/v3/projects/000e8e21141c45c0ae0ea0df61640642/users/cefa869a19484c24a93bdf6fa3827262/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:57.568030 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeab0a3-73f2-42ac-b891-aabed2171f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=000e8e21141c45c0ae0ea0df61640642, user_id=cefa869a19484c24a93bdf6fa3827262, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:57.570711 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeab0a3-73f2-42ac-b891-aabed2171f1c admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:57.583928 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1271/2558] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:11:57 2022] PUT /identity/v3/projects/000e8e21141c45c0ae0ea0df61640642/users/cefa869a19484c24a93bdf6fa3827262/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:11:57.593977 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ebac9-984c-4ef0-8800-e8405406074d None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:57.594303 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ebac9-984c-4ef0-8800-e8405406074d None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:57.594589 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ebac9-984c-4ef0-8800-e8405406074d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:57.620778 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-e02ebac9-984c-4ef0-8800-e8405406074d None None] MFA Rules not processed for user `cefa869a19484c24a93bdf6fa3827262`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:11:57.621982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-e02ebac9-984c-4ef0-8800-e8405406074d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:57.685116 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1288/2559] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:11:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:11:57.689719 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeab0a3-73f2-42ac-b891-aabed2171f1c admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:57.807934 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeab0a3-73f2-42ac-b891-aabed2171f1c admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:57.816698 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaa170-1ae0-48f2-93dd-ede7eebd04d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:57.817264 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaa170-1ae0-48f2-93dd-ede7eebd04d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:57.818286 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaa170-1ae0-48f2-93dd-ede7eebd04d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:57.818790 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaa170-1ae0-48f2-93dd-ede7eebd04d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:57.819534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaa170-1ae0-48f2-93dd-ede7eebd04d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:57.822705 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaa170-1ae0-48f2-93dd-ede7eebd04d5 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:57.863148 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1272/2560] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:11:57 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:11:57.867705 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ebac9-984c-4ef0-8800-e8405406074d None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:57.881886 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ebac9-984c-4ef0-8800-e8405406074d None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:57.974034 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e6576-1483-429f-9728-76de6358aa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:57.978897 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e6576-1483-429f-9728-76de6358aa61 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:57.979298 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e6576-1483-429f-9728-76de6358aa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:57.979765 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e6576-1483-429f-9728-76de6358aa61 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:57.980699 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e6576-1483-429f-9728-76de6358aa61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:57.983007 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e6576-1483-429f-9728-76de6358aa61 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:58.006600 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1289/2561] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:11:57 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:11:58.010610 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaa170-1ae0-48f2-93dd-ede7eebd04d5 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:58.021329 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaa170-1ae0-48f2-93dd-ede7eebd04d5 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:58.026112 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cfbfd-6606-47a9-bb35-e3a1c982553c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:58.026900 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cfbfd-6606-47a9-bb35-e3a1c982553c admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:58.027259 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cfbfd-6606-47a9-bb35-e3a1c982553c admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:58.027612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cfbfd-6606-47a9-bb35-e3a1c982553c admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:58.028473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4cfbfd-6606-47a9-bb35-e3a1c982553c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:58.030142 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4cfbfd-6606-47a9-bb35-e3a1c982553c admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:58.044495 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1273/2562] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:11:58.045872 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e6576-1483-429f-9728-76de6358aa61 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:58.056603 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e6576-1483-429f-9728-76de6358aa61 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:58.061153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13222c7a-a533-4e05-8460-fbd844e75bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:58.062031 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13222c7a-a533-4e05-8460-fbd844e75bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:58.062344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13222c7a-a533-4e05-8460-fbd844e75bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:58.062620 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13222c7a-a533-4e05-8460-fbd844e75bd7 admin admin] PATH_INFO: `/v3/projects/408b12e13efd401cb63e3652f7b00b53/users/3629e0cc0c064a4f857fdbb41617d6e3/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:58.077807 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13222c7a-a533-4e05-8460-fbd844e75bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=408b12e13efd401cb63e3652f7b00b53, user_id=3629e0cc0c064a4f857fdbb41617d6e3, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:58.080459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13222c7a-a533-4e05-8460-fbd844e75bd7 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:58.093648 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1290/2563] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:11:58 2022] PUT /identity/v3/projects/408b12e13efd401cb63e3652f7b00b53/users/3629e0cc0c064a4f857fdbb41617d6e3/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:11:58.098036 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cfbfd-6606-47a9-bb35-e3a1c982553c admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:58.111263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cfbfd-6606-47a9-bb35-e3a1c982553c admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:58.179866 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648f80f-a7e5-466c-a44b-242c83213e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:58.180545 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648f80f-a7e5-466c-a44b-242c83213e5a admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:58.180826 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648f80f-a7e5-466c-a44b-242c83213e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:58.181100 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648f80f-a7e5-466c-a44b-242c83213e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:58.181830 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648f80f-a7e5-466c-a44b-242c83213e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:58.183471 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648f80f-a7e5-466c-a44b-242c83213e5a admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:58.197683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1274/2564] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:11:58.198886 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13222c7a-a533-4e05-8460-fbd844e75bd7 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:58.209708 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13222c7a-a533-4e05-8460-fbd844e75bd7 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:58.215405 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a24c43-1301-4afe-bcb7-fde06569d8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:58.216084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a24c43-1301-4afe-bcb7-fde06569d8d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:58.216401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a24c43-1301-4afe-bcb7-fde06569d8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:58.216682 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a24c43-1301-4afe-bcb7-fde06569d8d1 admin admin] PATH_INFO: `/v3/projects/408b12e13efd401cb63e3652f7b00b53/users/3629e0cc0c064a4f857fdbb41617d6e3/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:58.218702 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a24c43-1301-4afe-bcb7-fde06569d8d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=408b12e13efd401cb63e3652f7b00b53, user_id=3629e0cc0c064a4f857fdbb41617d6e3, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:58.221377 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a24c43-1301-4afe-bcb7-fde06569d8d1 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:58.233622 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1291/2565] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:11:58 2022] PUT /identity/v3/projects/408b12e13efd401cb63e3652f7b00b53/users/3629e0cc0c064a4f857fdbb41617d6e3/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:11:58.248916 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb4441-3a50-47d3-a3c2-37e84301337c None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:58.249222 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb4441-3a50-47d3-a3c2-37e84301337c None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:58.249479 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb4441-3a50-47d3-a3c2-37e84301337c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:58.275556 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-60bb4441-3a50-47d3-a3c2-37e84301337c None None] MFA Rules not processed for user `3629e0cc0c064a4f857fdbb41617d6e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:11:58.276742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-60bb4441-3a50-47d3-a3c2-37e84301337c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:58.353978 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1275/2566] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:11:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:11:58.366921 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a24c43-1301-4afe-bcb7-fde06569d8d1 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:58.368576 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-13a24c43-1301-4afe-bcb7-fde06569d8d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:58.442257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a24c43-1301-4afe-bcb7-fde06569d8d1 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:58.447648 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb85f0-c8f9-4209-b6c4-5b79a6ebad0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:58.448319 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb85f0-c8f9-4209-b6c4-5b79a6ebad0a service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:58.448609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb85f0-c8f9-4209-b6c4-5b79a6ebad0a service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:58.448890 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb85f0-c8f9-4209-b6c4-5b79a6ebad0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:58.460718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb85f0-c8f9-4209-b6c4-5b79a6ebad0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:58.462224 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb85f0-c8f9-4209-b6c4-5b79a6ebad0a service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:58.477654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1292/2567] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:11:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:11:58.954091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb4441-3a50-47d3-a3c2-37e84301337c None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:59.042711 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb4441-3a50-47d3-a3c2-37e84301337c None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:59.050775 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47f3be-71bd-4be1-801d-614a22317ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:59.051891 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47f3be-71bd-4be1-801d-614a22317ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:59.052182 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47f3be-71bd-4be1-801d-614a22317ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:59.052446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47f3be-71bd-4be1-801d-614a22317ba6 admin admin] PATH_INFO: `/v3/users/cefa869a19484c24a93bdf6fa3827262` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:59.053948 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47f3be-71bd-4be1-801d-614a22317ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cefa869a19484c24a93bdf6fa3827262)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:59.055982 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47f3be-71bd-4be1-801d-614a22317ba6 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:59.122818 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9e47f3be-71bd-4be1-801d-614a22317ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cefa869a19484c24a93bdf6fa3827262'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:59.131039 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9e47f3be-71bd-4be1-801d-614a22317ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cefa869a19484c24a93bdf6fa3827262'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:59.143197 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9e47f3be-71bd-4be1-801d-614a22317ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cefa869a19484c24a93bdf6fa3827262'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:59.143849 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9e47f3be-71bd-4be1-801d-614a22317ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cefa869a19484c24a93bdf6fa3827262'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:59.144565 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9e47f3be-71bd-4be1-801d-614a22317ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cefa869a19484c24a93bdf6fa3827262'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:59.160834 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1276/2568] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:11:58 2022] DELETE /identity/v3/users/cefa869a19484c24a93bdf6fa3827262 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:11:59.166781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b689c8-1abf-402d-8a4d-8a52ed109b05 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:59.167692 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b689c8-1abf-402d-8a4d-8a52ed109b05 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:59.168620 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b689c8-1abf-402d-8a4d-8a52ed109b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:59.202803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-b5b689c8-1abf-402d-8a4d-8a52ed109b05 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:11:59.205790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-b5b689c8-1abf-402d-8a4d-8a52ed109b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:59.278092 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1293/2569] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:11:59.287942 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47f3be-71bd-4be1-801d-614a22317ba6 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:59.289522 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-9e47f3be-71bd-4be1-801d-614a22317ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:59.345460 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47f3be-71bd-4be1-801d-614a22317ba6 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:59.349219 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876e131-5c17-4df4-99a2-c64ad24c0a97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:59.349858 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876e131-5c17-4df4-99a2-c64ad24c0a97 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:59.350140 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876e131-5c17-4df4-99a2-c64ad24c0a97 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:59.350444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876e131-5c17-4df4-99a2-c64ad24c0a97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:59.359301 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876e131-5c17-4df4-99a2-c64ad24c0a97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:59.360735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876e131-5c17-4df4-99a2-c64ad24c0a97 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:59.370671 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1277/2570] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:11:59.698000 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b689c8-1abf-402d-8a4d-8a52ed109b05 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:59.699669 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-b5b689c8-1abf-402d-8a4d-8a52ed109b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:59.717658 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b689c8-1abf-402d-8a4d-8a52ed109b05 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:59.734219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b3f13-570f-41e4-911e-461788da7d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:59.735138 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b3f13-570f-41e4-911e-461788da7d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:59.735539 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b3f13-570f-41e4-911e-461788da7d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:59.736078 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b3f13-570f-41e4-911e-461788da7d84 admin admin] PATH_INFO: `/v3/projects/000e8e21141c45c0ae0ea0df61640642` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:59.738593 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b3f13-570f-41e4-911e-461788da7d84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=000e8e21141c45c0ae0ea0df61640642)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:59.740658 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b3f13-570f-41e4-911e-461788da7d84 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:59.794595 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-633b3f13-570f-41e4-911e-461788da7d84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '000e8e21141c45c0ae0ea0df61640642', 'request_id': 'req-633b3f13-570f-41e4-911e-461788da7d84'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:59.800524 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-633b3f13-570f-41e4-911e-461788da7d84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '000e8e21141c45c0ae0ea0df61640642', 'request_id': 'req-633b3f13-570f-41e4-911e-461788da7d84'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:59.807633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-633b3f13-570f-41e4-911e-461788da7d84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '000e8e21141c45c0ae0ea0df61640642', 'request_id': 'req-633b3f13-570f-41e4-911e-461788da7d84'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:59.814370 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876e131-5c17-4df4-99a2-c64ad24c0a97 service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:59.816323 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-c876e131-5c17-4df4-99a2-c64ad24c0a97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:59.825146 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-633b3f13-570f-41e4-911e-461788da7d84 admin admin] The token cache is being invalidate because project 000e8e21141c45c0ae0ea0df61640642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:11:59.825758 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-633b3f13-570f-41e4-911e-461788da7d84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:59.826525 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-633b3f13-570f-41e4-911e-461788da7d84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:11:59.828910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1294/2571] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:11:59 2022] DELETE /identity/v3/projects/000e8e21141c45c0ae0ea0df61640642 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:11:59.837203 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876e131-5c17-4df4-99a2-c64ad24c0a97 service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:59.838136 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b3f13-570f-41e4-911e-461788da7d84 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:59.840293 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-633b3f13-570f-41e4-911e-461788da7d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:59.946656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b3f13-570f-41e4-911e-461788da7d84 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:59.947816 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ded55-8478-49c0-a689-21926c9a9a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:59.948875 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ded55-8478-49c0-a689-21926c9a9a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:59.949319 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ded55-8478-49c0-a689-21926c9a9a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:59.949760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ded55-8478-49c0-a689-21926c9a9a3f admin admin] PATH_INFO: `/v3/users/bfe4dcec51fe447290785f8cf160f327` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:59.951324 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ded55-8478-49c0-a689-21926c9a9a3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe4dcec51fe447290785f8cf160f327)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:59.951950 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1942372-47d9-4e11-bb57-a06ed8e5f04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:59.952900 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1942372-47d9-4e11-bb57-a06ed8e5f04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:59.953379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ded55-8478-49c0-a689-21926c9a9a3f admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:59.953493 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1942372-47d9-4e11-bb57-a06ed8e5f04d admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:59.953817 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1942372-47d9-4e11-bb57-a06ed8e5f04d admin admin] PATH_INFO: `/v3/users/3629e0cc0c064a4f857fdbb41617d6e3` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:59.959780 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1942372-47d9-4e11-bb57-a06ed8e5f04d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3629e0cc0c064a4f857fdbb41617d6e3)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:59.962081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1942372-47d9-4e11-bb57-a06ed8e5f04d admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:00.019945 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b91ded55-8478-49c0-a689-21926c9a9a3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe4dcec51fe447290785f8cf160f327'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:00.031130 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b91ded55-8478-49c0-a689-21926c9a9a3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe4dcec51fe447290785f8cf160f327'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:00.035410 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d1942372-47d9-4e11-bb57-a06ed8e5f04d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3629e0cc0c064a4f857fdbb41617d6e3'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:00.045748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d1942372-47d9-4e11-bb57-a06ed8e5f04d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3629e0cc0c064a4f857fdbb41617d6e3'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:00.047320 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b91ded55-8478-49c0-a689-21926c9a9a3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe4dcec51fe447290785f8cf160f327'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:00.048117 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b91ded55-8478-49c0-a689-21926c9a9a3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe4dcec51fe447290785f8cf160f327'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:00.048732 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b91ded55-8478-49c0-a689-21926c9a9a3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe4dcec51fe447290785f8cf160f327'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:00.063304 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1278/2572] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:11:59 2022] DELETE /identity/v3/users/bfe4dcec51fe447290785f8cf160f327 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:12:00.064602 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d1942372-47d9-4e11-bb57-a06ed8e5f04d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3629e0cc0c064a4f857fdbb41617d6e3'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:00.067953 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e12ffd-9aac-4816-923b-4d776d85bf10 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:00.068312 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e12ffd-9aac-4816-923b-4d776d85bf10 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:00.068655 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e12ffd-9aac-4816-923b-4d776d85bf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:00.081747 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d1942372-47d9-4e11-bb57-a06ed8e5f04d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3629e0cc0c064a4f857fdbb41617d6e3'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:00.087789 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-97e12ffd-9aac-4816-923b-4d776d85bf10 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:00.089651 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-97e12ffd-9aac-4816-923b-4d776d85bf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:00.094795 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d1942372-47d9-4e11-bb57-a06ed8e5f04d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3629e0cc0c064a4f857fdbb41617d6e3'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:00.105179 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1295/2573] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:11:59 2022] DELETE /identity/v3/users/3629e0cc0c064a4f857fdbb41617d6e3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:00.172004 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1279/2574] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:00.181212 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1942372-47d9-4e11-bb57-a06ed8e5f04d admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:00.182942 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-d1942372-47d9-4e11-bb57-a06ed8e5f04d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:00.263773 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1942372-47d9-4e11-bb57-a06ed8e5f04d admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:00.273112 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc34bc2-d25f-473d-887c-8e54c6e4555d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:00.274272 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc34bc2-d25f-473d-887c-8e54c6e4555d service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:00.274934 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc34bc2-d25f-473d-887c-8e54c6e4555d service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:00.275422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc34bc2-d25f-473d-887c-8e54c6e4555d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:00.356071 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc34bc2-d25f-473d-887c-8e54c6e4555d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:00.367422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc34bc2-d25f-473d-887c-8e54c6e4555d service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:00.381775 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1296/2575] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:12:00.643234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e12ffd-9aac-4816-923b-4d776d85bf10 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:00.644710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-97e12ffd-9aac-4816-923b-4d776d85bf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:00.656567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e12ffd-9aac-4816-923b-4d776d85bf10 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:00.661772 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5e4b5-d8bf-4457-87a1-bfe1cc80d1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:00.662731 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5e4b5-d8bf-4457-87a1-bfe1cc80d1e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:00.663158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5e4b5-d8bf-4457-87a1-bfe1cc80d1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:00.663519 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5e4b5-d8bf-4457-87a1-bfe1cc80d1e7 admin admin] PATH_INFO: `/v3/projects/408b12e13efd401cb63e3652f7b00b53` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:00.664791 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5e4b5-d8bf-4457-87a1-bfe1cc80d1e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=408b12e13efd401cb63e3652f7b00b53)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:00.666884 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5e4b5-d8bf-4457-87a1-bfe1cc80d1e7 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:00.724702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-24a5e4b5-d8bf-4457-87a1-bfe1cc80d1e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '408b12e13efd401cb63e3652f7b00b53', 'request_id': 'req-24a5e4b5-d8bf-4457-87a1-bfe1cc80d1e7'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:00.730307 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-24a5e4b5-d8bf-4457-87a1-bfe1cc80d1e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '408b12e13efd401cb63e3652f7b00b53', 'request_id': 'req-24a5e4b5-d8bf-4457-87a1-bfe1cc80d1e7'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:00.736773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-24a5e4b5-d8bf-4457-87a1-bfe1cc80d1e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '408b12e13efd401cb63e3652f7b00b53', 'request_id': 'req-24a5e4b5-d8bf-4457-87a1-bfe1cc80d1e7'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:00.750527 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-24a5e4b5-d8bf-4457-87a1-bfe1cc80d1e7 admin admin] The token cache is being invalidate because project 408b12e13efd401cb63e3652f7b00b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:12:00.750887 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-24a5e4b5-d8bf-4457-87a1-bfe1cc80d1e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:00.751587 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-24a5e4b5-d8bf-4457-87a1-bfe1cc80d1e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:00.753293 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1280/2576] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:12:00 2022] DELETE /identity/v3/projects/408b12e13efd401cb63e3652f7b00b53 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:00.758149 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a78b36-4e20-461d-b133-9e7133dc6f31 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:00.758480 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a78b36-4e20-461d-b133-9e7133dc6f31 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:00.758753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a78b36-4e20-461d-b133-9e7133dc6f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:00.773387 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5e4b5-d8bf-4457-87a1-bfe1cc80d1e7 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:00.775045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-24a5e4b5-d8bf-4457-87a1-bfe1cc80d1e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:00.778868 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-25a78b36-4e20-461d-b133-9e7133dc6f31 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:00.780156 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-25a78b36-4e20-461d-b133-9e7133dc6f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:00.843790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1297/2577] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:00.845745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5e4b5-d8bf-4457-87a1-bfe1cc80d1e7 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:00.851232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b6f2b-4fd4-4e79-bfb9-8ffdbc825c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:00.852096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b6f2b-4fd4-4e79-bfb9-8ffdbc825c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:00.852374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1ad9d-641e-4aff-839a-9e548ec5bf06 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:00.852482 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b6f2b-4fd4-4e79-bfb9-8ffdbc825c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:00.852645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b6f2b-4fd4-4e79-bfb9-8ffdbc825c77 admin admin] PATH_INFO: `/v3/projects/dd51444eba09461c8c67ede624707553` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:00.852826 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1ad9d-641e-4aff-839a-9e548ec5bf06 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:00.853208 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1ad9d-641e-4aff-839a-9e548ec5bf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:00.853849 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b6f2b-4fd4-4e79-bfb9-8ffdbc825c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd51444eba09461c8c67ede624707553)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:00.855855 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b6f2b-4fd4-4e79-bfb9-8ffdbc825c77 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:00.872174 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-03e1ad9d-641e-4aff-839a-9e548ec5bf06 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:00.873642 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-03e1ad9d-641e-4aff-839a-9e548ec5bf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:00.882990 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1298/2578] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:00.887256 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1ad9d-641e-4aff-839a-9e548ec5bf06 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:00.896566 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1ad9d-641e-4aff-839a-9e548ec5bf06 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:00.907183 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e69b6f2b-4fd4-4e79-bfb9-8ffdbc825c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd51444eba09461c8c67ede624707553', 'request_id': 'req-e69b6f2b-4fd4-4e79-bfb9-8ffdbc825c77'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:00.912445 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e69b6f2b-4fd4-4e79-bfb9-8ffdbc825c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd51444eba09461c8c67ede624707553', 'request_id': 'req-e69b6f2b-4fd4-4e79-bfb9-8ffdbc825c77'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:00.919326 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e69b6f2b-4fd4-4e79-bfb9-8ffdbc825c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd51444eba09461c8c67ede624707553', 'request_id': 'req-e69b6f2b-4fd4-4e79-bfb9-8ffdbc825c77'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:00.932150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e69b6f2b-4fd4-4e79-bfb9-8ffdbc825c77 admin admin] The token cache is being invalidate because project dd51444eba09461c8c67ede624707553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:12:00.932461 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e69b6f2b-4fd4-4e79-bfb9-8ffdbc825c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:00.933105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-e69b6f2b-4fd4-4e79-bfb9-8ffdbc825c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:00.934726 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1281/2579] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:12:00 2022] DELETE /identity/v3/projects/dd51444eba09461c8c67ede624707553 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:12:00.938730 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b6f2b-4fd4-4e79-bfb9-8ffdbc825c77 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:00.940156 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-e69b6f2b-4fd4-4e79-bfb9-8ffdbc825c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:00.952255 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21039fef-9f50-4669-951b-0b13217e56e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:00.952929 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21039fef-9f50-4669-951b-0b13217e56e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:00.953217 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21039fef-9f50-4669-951b-0b13217e56e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:00.953492 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21039fef-9f50-4669-951b-0b13217e56e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:00.954254 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21039fef-9f50-4669-951b-0b13217e56e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:12:00.954565 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21039fef-9f50-4669-951b-0b13217e56e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:00.956160 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21039fef-9f50-4669-951b-0b13217e56e5 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:00.968343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1299/2580] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:12:00.972523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21039fef-9f50-4669-951b-0b13217e56e5 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:00.974602 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-21039fef-9f50-4669-951b-0b13217e56e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:00.986424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21039fef-9f50-4669-951b-0b13217e56e5 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:00.991683 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047ca6b-a363-4dbf-a7af-f7e29bab9454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:00.992356 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047ca6b-a363-4dbf-a7af-f7e29bab9454 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:00.992643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047ca6b-a363-4dbf-a7af-f7e29bab9454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:00.992949 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047ca6b-a363-4dbf-a7af-f7e29bab9454 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:00.993630 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047ca6b-a363-4dbf-a7af-f7e29bab9454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:00.995602 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047ca6b-a363-4dbf-a7af-f7e29bab9454 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:01.007143 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b6f2b-4fd4-4e79-bfb9-8ffdbc825c77 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:01.011789 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889bf6a-6ab4-4fbf-9725-8f0e88089335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:01.012673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889bf6a-6ab4-4fbf-9725-8f0e88089335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:01.012970 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889bf6a-6ab4-4fbf-9725-8f0e88089335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:01.013363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889bf6a-6ab4-4fbf-9725-8f0e88089335 admin admin] PATH_INFO: `/v3/users/a9a834e5b887438ca20a8e81bfa1d95c` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:01.014604 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889bf6a-6ab4-4fbf-9725-8f0e88089335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9a834e5b887438ca20a8e81bfa1d95c)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:01.016578 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889bf6a-6ab4-4fbf-9725-8f0e88089335 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:01.022175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1300/2581] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:12:00 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:12:01.025810 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047ca6b-a363-4dbf-a7af-f7e29bab9454 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:01.061787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-d889bf6a-6ab4-4fbf-9725-8f0e88089335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9a834e5b887438ca20a8e81bfa1d95c'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:01.069959 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-d889bf6a-6ab4-4fbf-9725-8f0e88089335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9a834e5b887438ca20a8e81bfa1d95c'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:01.081905 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-d889bf6a-6ab4-4fbf-9725-8f0e88089335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9a834e5b887438ca20a8e81bfa1d95c'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:01.082603 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-d889bf6a-6ab4-4fbf-9725-8f0e88089335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9a834e5b887438ca20a8e81bfa1d95c'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:01.083299 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-d889bf6a-6ab4-4fbf-9725-8f0e88089335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9a834e5b887438ca20a8e81bfa1d95c'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:01.087740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047ca6b-a363-4dbf-a7af-f7e29bab9454 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:01.092416 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478114c4-8513-4900-990c-7d6c1cc58eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:01.093113 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478114c4-8513-4900-990c-7d6c1cc58eff admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:01.093395 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478114c4-8513-4900-990c-7d6c1cc58eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:01.093673 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478114c4-8513-4900-990c-7d6c1cc58eff admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:01.094438 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478114c4-8513-4900-990c-7d6c1cc58eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:01.095189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1282/2582] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:12:00 2022] DELETE /identity/v3/users/a9a834e5b887438ca20a8e81bfa1d95c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:12:01.096340 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478114c4-8513-4900-990c-7d6c1cc58eff admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:01.118230 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1301/2583] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:12:01 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:12:01.122363 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889bf6a-6ab4-4fbf-9725-8f0e88089335 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:01.124099 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-d889bf6a-6ab4-4fbf-9725-8f0e88089335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:01.190893 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889bf6a-6ab4-4fbf-9725-8f0e88089335 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:01.196385 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f4baa-31d4-4794-a0dc-4a17d57e7058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:01.197071 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f4baa-31d4-4794-a0dc-4a17d57e7058 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:01.197337 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f4baa-31d4-4794-a0dc-4a17d57e7058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:01.197608 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f4baa-31d4-4794-a0dc-4a17d57e7058 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:01.198364 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f4baa-31d4-4794-a0dc-4a17d57e7058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:01.199949 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f4baa-31d4-4794-a0dc-4a17d57e7058 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:01.209760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1283/2584] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:12:01.213808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478114c4-8513-4900-990c-7d6c1cc58eff admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:01.224954 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478114c4-8513-4900-990c-7d6c1cc58eff admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:01.229647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174c8a9-ec4a-46fd-9769-7a191e18bf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:01.230330 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174c8a9-ec4a-46fd-9769-7a191e18bf06 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:01.230612 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174c8a9-ec4a-46fd-9769-7a191e18bf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:01.230887 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174c8a9-ec4a-46fd-9769-7a191e18bf06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:01.231614 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174c8a9-ec4a-46fd-9769-7a191e18bf06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:01.233262 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174c8a9-ec4a-46fd-9769-7a191e18bf06 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:01.247843 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1302/2585] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:12:01.251802 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f4baa-31d4-4794-a0dc-4a17d57e7058 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:01.262089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f4baa-31d4-4794-a0dc-4a17d57e7058 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:01.267046 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e3df3-5d67-4105-8b26-71869ba18c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:01.267920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e3df3-5d67-4105-8b26-71869ba18c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:01.268197 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e3df3-5d67-4105-8b26-71869ba18c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:01.268470 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e3df3-5d67-4105-8b26-71869ba18c7d admin admin] PATH_INFO: `/v3/projects/5618e187eb6c4531b1829fc3847637b7/users/94a311c88e2c421c8e694b66b19852f7/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:01.283999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e3df3-5d67-4105-8b26-71869ba18c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5618e187eb6c4531b1829fc3847637b7, user_id=94a311c88e2c421c8e694b66b19852f7, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:01.287459 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e3df3-5d67-4105-8b26-71869ba18c7d admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:01.301047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1284/2586] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:12:01 2022] PUT /identity/v3/projects/5618e187eb6c4531b1829fc3847637b7/users/94a311c88e2c421c8e694b66b19852f7/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:01.311392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c985cf-0730-4c02-8168-cc6927204ca9 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:01.311942 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c985cf-0730-4c02-8168-cc6927204ca9 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:01.312046 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c985cf-0730-4c02-8168-cc6927204ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:01.339669 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-a4c985cf-0730-4c02-8168-cc6927204ca9 None None] MFA Rules not processed for user `94a311c88e2c421c8e694b66b19852f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:01.340892 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-a4c985cf-0730-4c02-8168-cc6927204ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:01.376112 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e3df3-5d67-4105-8b26-71869ba18c7d admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:01.377923 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-3b9e3df3-5d67-4105-8b26-71869ba18c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:01.412306 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1303/2587] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:12:01.416429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c985cf-0730-4c02-8168-cc6927204ca9 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:01.447636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e3df3-5d67-4105-8b26-71869ba18c7d admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:01.452527 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b35aa-940a-4179-822a-3c0410e23e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:01.453397 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b35aa-940a-4179-822a-3c0410e23e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:01.453681 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b35aa-940a-4179-822a-3c0410e23e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:01.453957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b35aa-940a-4179-822a-3c0410e23e48 admin admin] PATH_INFO: `/v3/projects/c77fbd123ea64a698b848531eb1dafd4` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:01.455210 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b35aa-940a-4179-822a-3c0410e23e48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c77fbd123ea64a698b848531eb1dafd4)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:01.457101 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b35aa-940a-4179-822a-3c0410e23e48 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:01.482242 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c985cf-0730-4c02-8168-cc6927204ca9 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:01.488040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158664a9-876e-47ad-80f7-2828c9c19379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:01.488754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158664a9-876e-47ad-80f7-2828c9c19379 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:01.489104 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158664a9-876e-47ad-80f7-2828c9c19379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:01.489413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158664a9-876e-47ad-80f7-2828c9c19379 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:01.490470 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158664a9-876e-47ad-80f7-2828c9c19379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:01.493420 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158664a9-876e-47ad-80f7-2828c9c19379 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:01.509033 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0e6b35aa-940a-4179-822a-3c0410e23e48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c77fbd123ea64a698b848531eb1dafd4', 'request_id': 'req-0e6b35aa-940a-4179-822a-3c0410e23e48'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:01.515221 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0e6b35aa-940a-4179-822a-3c0410e23e48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c77fbd123ea64a698b848531eb1dafd4', 'request_id': 'req-0e6b35aa-940a-4179-822a-3c0410e23e48'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:01.521535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1304/2588] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:12:01 2022] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:12:01.523090 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0e6b35aa-940a-4179-822a-3c0410e23e48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c77fbd123ea64a698b848531eb1dafd4', 'request_id': 'req-0e6b35aa-940a-4179-822a-3c0410e23e48'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:01.525697 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158664a9-876e-47ad-80f7-2828c9c19379 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:01.537249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0e6b35aa-940a-4179-822a-3c0410e23e48 admin admin] The token cache is being invalidate because project c77fbd123ea64a698b848531eb1dafd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:12:01.537551 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0e6b35aa-940a-4179-822a-3c0410e23e48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:01.538173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0e6b35aa-940a-4179-822a-3c0410e23e48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:01.544105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1285/2589] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:12:01 2022] DELETE /identity/v3/projects/c77fbd123ea64a698b848531eb1dafd4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:12:01.545990 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b198f-825a-4f19-8aaf-dedf6c49a912 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:01.546472 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b198f-825a-4f19-8aaf-dedf6c49a912 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:01.546755 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b198f-825a-4f19-8aaf-dedf6c49a912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:01.565950 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-f43b198f-825a-4f19-8aaf-dedf6c49a912 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:01.567097 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-f43b198f-825a-4f19-8aaf-dedf6c49a912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:01.592192 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158664a9-876e-47ad-80f7-2828c9c19379 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:01.597239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fe61d-0a5c-4f5d-9cb7-5315ebdfb4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:01.597968 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fe61d-0a5c-4f5d-9cb7-5315ebdfb4f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:01.598284 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fe61d-0a5c-4f5d-9cb7-5315ebdfb4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:01.598628 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fe61d-0a5c-4f5d-9cb7-5315ebdfb4f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:01.599827 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fe61d-0a5c-4f5d-9cb7-5315ebdfb4f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:01.601798 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fe61d-0a5c-4f5d-9cb7-5315ebdfb4f8 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:01.625617 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1305/2590] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:12:01 2022] POST /identity/v3/users => generated 303 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:12:01.629348 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fe61d-0a5c-4f5d-9cb7-5315ebdfb4f8 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:01.631434 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-4b9fe61d-0a5c-4f5d-9cb7-5315ebdfb4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:01.643021 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1286/2591] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:12:01.644234 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fe61d-0a5c-4f5d-9cb7-5315ebdfb4f8 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:01.644957 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c54b6-c3de-4516-925f-50d24f9bd2fa None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:01.646022 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c54b6-c3de-4516-925f-50d24f9bd2fa None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:01.646123 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c54b6-c3de-4516-925f-50d24f9bd2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:01.650238 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15d8dd-0033-4733-bc6e-30c2b0351a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:01.650918 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15d8dd-0033-4733-bc6e-30c2b0351a28 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:01.651195 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15d8dd-0033-4733-bc6e-30c2b0351a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:01.651470 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15d8dd-0033-4733-bc6e-30c2b0351a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:01.652198 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15d8dd-0033-4733-bc6e-30c2b0351a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:01.653769 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15d8dd-0033-4733-bc6e-30c2b0351a28 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:01.665460 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-ec4c54b6-c3de-4516-925f-50d24f9bd2fa None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:01.666690 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-ec4c54b6-c3de-4516-925f-50d24f9bd2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:01.669125 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1306/2592] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:12:01.673116 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15d8dd-0033-4733-bc6e-30c2b0351a28 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:01.674876 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1287/2593] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:01.679195 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c54b6-c3de-4516-925f-50d24f9bd2fa None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:01.683219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15d8dd-0033-4733-bc6e-30c2b0351a28 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:01.688049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214eab9a-40f7-4909-bb04-a338227d9d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:01.688224 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c54b6-c3de-4516-925f-50d24f9bd2fa None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:01.688921 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214eab9a-40f7-4909-bb04-a338227d9d16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:01.689207 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214eab9a-40f7-4909-bb04-a338227d9d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:01.689485 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214eab9a-40f7-4909-bb04-a338227d9d16 admin admin] PATH_INFO: `/v3/projects/111f011c42744ae29b264076ccbfa1ed/users/25df5db323284a8baff74d19736682ab/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:01.693583 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01507b8-ca11-4df3-aae4-be2913361d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:01.694251 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01507b8-ca11-4df3-aae4-be2913361d09 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:01.694544 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01507b8-ca11-4df3-aae4-be2913361d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:01.694838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01507b8-ca11-4df3-aae4-be2913361d09 admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:01.695702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01507b8-ca11-4df3-aae4-be2913361d09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:12:01.696010 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01507b8-ca11-4df3-aae4-be2913361d09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:01.697597 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01507b8-ca11-4df3-aae4-be2913361d09 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:01.703906 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214eab9a-40f7-4909-bb04-a338227d9d16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=111f011c42744ae29b264076ccbfa1ed, user_id=25df5db323284a8baff74d19736682ab, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:01.706660 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214eab9a-40f7-4909-bb04-a338227d9d16 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:01.709596 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1288/2594] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:12:01.714248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01507b8-ca11-4df3-aae4-be2913361d09 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:01.720399 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1307/2595] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:12:01 2022] PUT /identity/v3/projects/111f011c42744ae29b264076ccbfa1ed/users/25df5db323284a8baff74d19736682ab/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:12:01.725375 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01507b8-ca11-4df3-aae4-be2913361d09 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:01.726291 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214eab9a-40f7-4909-bb04-a338227d9d16 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:01.783149 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91a679-76cb-41bf-88b6-e63f1d29c85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:01.783856 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91a679-76cb-41bf-88b6-e63f1d29c85b admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:01.784140 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91a679-76cb-41bf-88b6-e63f1d29c85b admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:01.784416 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91a679-76cb-41bf-88b6-e63f1d29c85b admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:01.785104 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91a679-76cb-41bf-88b6-e63f1d29c85b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:01.785863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214eab9a-40f7-4909-bb04-a338227d9d16 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:01.787784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91a679-76cb-41bf-88b6-e63f1d29c85b admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:01.791812 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd42b4-5b09-42f4-9e35-5f377b8fcbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:01.792495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd42b4-5b09-42f4-9e35-5f377b8fcbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:01.792781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd42b4-5b09-42f4-9e35-5f377b8fcbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:01.793059 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd42b4-5b09-42f4-9e35-5f377b8fcbc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:01.793797 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd42b4-5b09-42f4-9e35-5f377b8fcbc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:01.795448 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd42b4-5b09-42f4-9e35-5f377b8fcbc6 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:01.807813 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1308/2596] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:12:01.810648 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd42b4-5b09-42f4-9e35-5f377b8fcbc6 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:01.815658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1289/2597] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:12:01 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:12:01.819605 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91a679-76cb-41bf-88b6-e63f1d29c85b admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:01.821770 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd42b4-5b09-42f4-9e35-5f377b8fcbc6 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:01.879272 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f9ad7-163f-4edb-8782-5066b1e15ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:01.880247 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f9ad7-163f-4edb-8782-5066b1e15ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:01.880733 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f9ad7-163f-4edb-8782-5066b1e15ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:01.881012 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f9ad7-163f-4edb-8782-5066b1e15ddf admin admin] PATH_INFO: `/v3/projects/111f011c42744ae29b264076ccbfa1ed/users/25df5db323284a8baff74d19736682ab/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:01.883140 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f9ad7-163f-4edb-8782-5066b1e15ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=111f011c42744ae29b264076ccbfa1ed, user_id=25df5db323284a8baff74d19736682ab, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:01.885767 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f9ad7-163f-4edb-8782-5066b1e15ddf admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:01.886638 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91a679-76cb-41bf-88b6-e63f1d29c85b admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:01.891765 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2c12a-a6df-446d-8009-b2a9305cdba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:01.892424 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2c12a-a6df-446d-8009-b2a9305cdba6 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:01.892704 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2c12a-a6df-446d-8009-b2a9305cdba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:01.892977 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2c12a-a6df-446d-8009-b2a9305cdba6 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:01.893655 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2c12a-a6df-446d-8009-b2a9305cdba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:01.896128 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2c12a-a6df-446d-8009-b2a9305cdba6 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:01.896335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1309/2598] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:12:01 2022] PUT /identity/v3/projects/111f011c42744ae29b264076ccbfa1ed/users/25df5db323284a8baff74d19736682ab/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:12:01.907292 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac3b04-cc8a-4476-91b8-03507c192985 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:01.907582 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac3b04-cc8a-4476-91b8-03507c192985 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:01.907857 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac3b04-cc8a-4476-91b8-03507c192985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:01.918270 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1290/2599] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:12:01 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:12:01.922814 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2c12a-a6df-446d-8009-b2a9305cdba6 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:01.932215 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2c12a-a6df-446d-8009-b2a9305cdba6 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:01.935182 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-28ac3b04-cc8a-4476-91b8-03507c192985 None None] MFA Rules not processed for user `25df5db323284a8baff74d19736682ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:01.936433 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-28ac3b04-cc8a-4476-91b8-03507c192985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:01.988267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e2101-6cfd-4da3-8c4e-966613fb67de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:01.988899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e2101-6cfd-4da3-8c4e-966613fb67de admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:01.989852 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e2101-6cfd-4da3-8c4e-966613fb67de admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:01.990279 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e2101-6cfd-4da3-8c4e-966613fb67de admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:01.991016 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e2101-6cfd-4da3-8c4e-966613fb67de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:01.992603 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e2101-6cfd-4da3-8c4e-966613fb67de admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:02.002497 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1291/2600] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:12:02.003656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1310/2601] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:12:02.008093 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e2101-6cfd-4da3-8c4e-966613fb67de admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:02.016404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac3b04-cc8a-4476-91b8-03507c192985 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:02.017876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-28ac3b04-cc8a-4476-91b8-03507c192985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:02.018020 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e2101-6cfd-4da3-8c4e-966613fb67de admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:02.023445 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8eff4-0b7e-42b4-90b4-0f973d457337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:02.024104 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8eff4-0b7e-42b4-90b4-0f973d457337 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:02.024383 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8eff4-0b7e-42b4-90b4-0f973d457337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:02.024663 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8eff4-0b7e-42b4-90b4-0f973d457337 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:02.025378 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8eff4-0b7e-42b4-90b4-0f973d457337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:02.026993 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8eff4-0b7e-42b4-90b4-0f973d457337 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:02.037410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1292/2602] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:12:02.041354 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8eff4-0b7e-42b4-90b4-0f973d457337 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:02.051124 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8eff4-0b7e-42b4-90b4-0f973d457337 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:02.056010 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4abeb-b605-407d-974f-6f6d5358feb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:02.056875 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4abeb-b605-407d-974f-6f6d5358feb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:02.057153 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4abeb-b605-407d-974f-6f6d5358feb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:02.057451 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4abeb-b605-407d-974f-6f6d5358feb3 admin admin] PATH_INFO: `/v3/projects/48583667f11d46a5b22122003587248a/users/efd5f5a75ab0476a85c71dea5de5b47c/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:02.072954 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4abeb-b605-407d-974f-6f6d5358feb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48583667f11d46a5b22122003587248a, user_id=efd5f5a75ab0476a85c71dea5de5b47c, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:02.075538 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac3b04-cc8a-4476-91b8-03507c192985 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:02.075694 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4abeb-b605-407d-974f-6f6d5358feb3 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:02.079272 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa2ebb-dd9e-4217-912a-e29a6729961a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:02.079928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa2ebb-dd9e-4217-912a-e29a6729961a service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:02.080235 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa2ebb-dd9e-4217-912a-e29a6729961a service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:02.080522 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa2ebb-dd9e-4217-912a-e29a6729961a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:02.089872 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1293/2603] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:12:02 2022] PUT /identity/v3/projects/48583667f11d46a5b22122003587248a/users/efd5f5a75ab0476a85c71dea5de5b47c/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:12:02.093885 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa2ebb-dd9e-4217-912a-e29a6729961a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:02.095362 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa2ebb-dd9e-4217-912a-e29a6729961a service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:02.100495 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5a4ce-23e1-49d5-99a5-93267c15b6ca None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:02.100864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5a4ce-23e1-49d5-99a5-93267c15b6ca None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:02.101149 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5a4ce-23e1-49d5-99a5-93267c15b6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:02.105625 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1311/2604] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:12:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:12:02.128207 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-e7a5a4ce-23e1-49d5-99a5-93267c15b6ca None None] MFA Rules not processed for user `efd5f5a75ab0476a85c71dea5de5b47c`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:02.129419 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-e7a5a4ce-23e1-49d5-99a5-93267c15b6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:02.151909 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa2ebb-dd9e-4217-912a-e29a6729961a service cinder] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:02.153388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-fcfa2ebb-dd9e-4217-912a-e29a6729961a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:02.166982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa2ebb-dd9e-4217-912a-e29a6729961a service cinder] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:02.194673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1294/2605] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:12:02.199024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5a4ce-23e1-49d5-99a5-93267c15b6ca None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:02.219966 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf1033-f58a-48de-8481-c7b671af8de3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:02.220970 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf1033-f58a-48de-8481-c7b671af8de3 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:02.221260 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf1033-f58a-48de-8481-c7b671af8de3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:02.221536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf1033-f58a-48de-8481-c7b671af8de3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:02.223450 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-cebf1033-f58a-48de-8481-c7b671af8de3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:02.259212 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5a4ce-23e1-49d5-99a5-93267c15b6ca None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:02.263802 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e721c9d-1ae2-4725-a27c-5f367c74426b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:02.264457 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e721c9d-1ae2-4725-a27c-5f367c74426b admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:02.264738 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e721c9d-1ae2-4725-a27c-5f367c74426b admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:02.265013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e721c9d-1ae2-4725-a27c-5f367c74426b admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:02.265702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e721c9d-1ae2-4725-a27c-5f367c74426b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:02.267628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e721c9d-1ae2-4725-a27c-5f367c74426b admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:02.281394 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf1033-f58a-48de-8481-c7b671af8de3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:02.282889 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf1033-f58a-48de-8481-c7b671af8de3 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:02.292055 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1312/2606] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:12:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:12:02.294398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1295/2607] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:12:02 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:12:02.297126 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf1033-f58a-48de-8481-c7b671af8de3 service cinder] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:02.308188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf1033-f58a-48de-8481-c7b671af8de3 service cinder] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:02.362517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657d8d2-4dc6-4ead-8ffe-15d8097bd43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:02.363194 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657d8d2-4dc6-4ead-8ffe-15d8097bd43c admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:02.363479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657d8d2-4dc6-4ead-8ffe-15d8097bd43c admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:02.363757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657d8d2-4dc6-4ead-8ffe-15d8097bd43c admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:02.364982 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657d8d2-4dc6-4ead-8ffe-15d8097bd43c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:02.367020 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657d8d2-4dc6-4ead-8ffe-15d8097bd43c admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:02.387435 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1313/2608] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:12:02 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:12:02.391439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e721c9d-1ae2-4725-a27c-5f367c74426b admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:02.401393 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e721c9d-1ae2-4725-a27c-5f367c74426b admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:02.406392 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bc737-3875-44e4-b278-9d255994b8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:02.407047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bc737-3875-44e4-b278-9d255994b8dd admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:02.407330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bc737-3875-44e4-b278-9d255994b8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:02.407603 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bc737-3875-44e4-b278-9d255994b8dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:02.408330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bc737-3875-44e4-b278-9d255994b8dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:02.409913 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bc737-3875-44e4-b278-9d255994b8dd admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:02.422228 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1296/2609] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:12:02.425733 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657d8d2-4dc6-4ead-8ffe-15d8097bd43c admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:02.437474 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657d8d2-4dc6-4ead-8ffe-15d8097bd43c admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:02.443424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4f81c-6ca3-4f29-a5bb-f16d9112b3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:02.444277 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4f81c-6ca3-4f29-a5bb-f16d9112b3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:02.444520 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4f81c-6ca3-4f29-a5bb-f16d9112b3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:02.444891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4f81c-6ca3-4f29-a5bb-f16d9112b3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:02.445736 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4f81c-6ca3-4f29-a5bb-f16d9112b3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:02.447391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4f81c-6ca3-4f29-a5bb-f16d9112b3e4 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:02.461621 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1314/2610] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:12:02.462850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bc737-3875-44e4-b278-9d255994b8dd admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:02.472972 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bc737-3875-44e4-b278-9d255994b8dd admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:02.477848 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab1bab-8b5d-4c9a-b7b0-afb1c484bdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:02.478840 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab1bab-8b5d-4c9a-b7b0-afb1c484bdd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:02.479125 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab1bab-8b5d-4c9a-b7b0-afb1c484bdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:02.479401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab1bab-8b5d-4c9a-b7b0-afb1c484bdd3 admin admin] PATH_INFO: `/v3/projects/13dd7819d288484c9e8e7e0227f5143c/users/fb049808920c4bbd870150b448d462d4/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:02.494623 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab1bab-8b5d-4c9a-b7b0-afb1c484bdd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13dd7819d288484c9e8e7e0227f5143c, user_id=fb049808920c4bbd870150b448d462d4, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:02.497721 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab1bab-8b5d-4c9a-b7b0-afb1c484bdd3 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:02.510963 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1297/2611] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:12:02 2022] PUT /identity/v3/projects/13dd7819d288484c9e8e7e0227f5143c/users/fb049808920c4bbd870150b448d462d4/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:12:02.522184 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faae6e8-1602-433f-8201-d4e4b19844aa None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:02.522722 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faae6e8-1602-433f-8201-d4e4b19844aa None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:02.522964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faae6e8-1602-433f-8201-d4e4b19844aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:02.553341 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-7faae6e8-1602-433f-8201-d4e4b19844aa None None] MFA Rules not processed for user `fb049808920c4bbd870150b448d462d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:02.554656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-7faae6e8-1602-433f-8201-d4e4b19844aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:02.624739 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1315/2612] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:02.629212 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab1bab-8b5d-4c9a-b7b0-afb1c484bdd3 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:02.694519 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab1bab-8b5d-4c9a-b7b0-afb1c484bdd3 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:02.699427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa332a5-d07e-4934-8b14-0af092fec9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:02.700362 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa332a5-d07e-4934-8b14-0af092fec9a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:02.700648 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa332a5-d07e-4934-8b14-0af092fec9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:02.700968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa332a5-d07e-4934-8b14-0af092fec9a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:02.701673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa332a5-d07e-4934-8b14-0af092fec9a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:02.703661 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa332a5-d07e-4934-8b14-0af092fec9a7 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:02.730593 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1298/2613] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:12:02 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:12:02.734618 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faae6e8-1602-433f-8201-d4e4b19844aa None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:02.746464 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faae6e8-1602-433f-8201-d4e4b19844aa None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:02.803282 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e9a00-9373-45ca-bbcb-e99a5a97ba3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:02.804328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e9a00-9373-45ca-bbcb-e99a5a97ba3d admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:02.804614 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e9a00-9373-45ca-bbcb-e99a5a97ba3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:02.805494 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e9a00-9373-45ca-bbcb-e99a5a97ba3d admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:02.806381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e9a00-9373-45ca-bbcb-e99a5a97ba3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:02.808332 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e9a00-9373-45ca-bbcb-e99a5a97ba3d admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:02.828664 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1316/2614] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:12:02 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:12:02.832285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa332a5-d07e-4934-8b14-0af092fec9a7 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:02.842469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa332a5-d07e-4934-8b14-0af092fec9a7 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:02.847047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43535863-de77-4f0c-b29d-eb2b8c4c807d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:02.847698 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43535863-de77-4f0c-b29d-eb2b8c4c807d admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:02.847974 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43535863-de77-4f0c-b29d-eb2b8c4c807d admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:02.848241 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43535863-de77-4f0c-b29d-eb2b8c4c807d admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:02.849595 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43535863-de77-4f0c-b29d-eb2b8c4c807d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:02.851220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43535863-de77-4f0c-b29d-eb2b8c4c807d admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:02.861621 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1299/2615] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:12:02.866490 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e9a00-9373-45ca-bbcb-e99a5a97ba3d admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:02.876630 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e9a00-9373-45ca-bbcb-e99a5a97ba3d admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:02.881439 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08291fc-e985-49ae-82cc-812223d14b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:02.882335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08291fc-e985-49ae-82cc-812223d14b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:02.882618 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08291fc-e985-49ae-82cc-812223d14b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:02.882895 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08291fc-e985-49ae-82cc-812223d14b6a admin admin] PATH_INFO: `/v3/projects/2734b6b9e05e4e39b6b8c8d7f7444820/users/a7dab612859d4cd9b3abb57e99f79d60/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:02.897103 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08291fc-e985-49ae-82cc-812223d14b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2734b6b9e05e4e39b6b8c8d7f7444820, user_id=a7dab612859d4cd9b3abb57e99f79d60, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:02.899777 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08291fc-e985-49ae-82cc-812223d14b6a admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:02.913665 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1317/2616] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:12:02 2022] PUT /identity/v3/projects/2734b6b9e05e4e39b6b8c8d7f7444820/users/a7dab612859d4cd9b3abb57e99f79d60/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:12:02.917737 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43535863-de77-4f0c-b29d-eb2b8c4c807d admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:02.928664 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43535863-de77-4f0c-b29d-eb2b8c4c807d admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:02.984546 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac06d5-43fd-4efe-acb0-6bced2ec6f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:02.985221 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac06d5-43fd-4efe-acb0-6bced2ec6f44 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:02.985503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac06d5-43fd-4efe-acb0-6bced2ec6f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:02.985775 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac06d5-43fd-4efe-acb0-6bced2ec6f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:02.986535 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac06d5-43fd-4efe-acb0-6bced2ec6f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:02.988158 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac06d5-43fd-4efe-acb0-6bced2ec6f44 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:02.998767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1300/2617] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:12:03.002911 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08291fc-e985-49ae-82cc-812223d14b6a admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:03.013007 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08291fc-e985-49ae-82cc-812223d14b6a admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:03.017581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df24fdf-8a92-4f99-a1c8-4832bcbfbded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:03.018498 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df24fdf-8a92-4f99-a1c8-4832bcbfbded admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:03.018785 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df24fdf-8a92-4f99-a1c8-4832bcbfbded admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:03.019067 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df24fdf-8a92-4f99-a1c8-4832bcbfbded admin admin] PATH_INFO: `/v3/projects/2734b6b9e05e4e39b6b8c8d7f7444820/users/a7dab612859d4cd9b3abb57e99f79d60/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:03.021196 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df24fdf-8a92-4f99-a1c8-4832bcbfbded admin admin] RBAC: Authorizing `identity:create_grant(project_id=2734b6b9e05e4e39b6b8c8d7f7444820, user_id=a7dab612859d4cd9b3abb57e99f79d60, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:03.023871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df24fdf-8a92-4f99-a1c8-4832bcbfbded admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:03.033880 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1318/2618] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:12:03 2022] PUT /identity/v3/projects/2734b6b9e05e4e39b6b8c8d7f7444820/users/a7dab612859d4cd9b3abb57e99f79d60/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:03.045508 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea478e-81cf-4841-a27c-5f5ddd810de4 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:03.045800 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea478e-81cf-4841-a27c-5f5ddd810de4 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:03.046083 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea478e-81cf-4841-a27c-5f5ddd810de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:03.073522 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-09ea478e-81cf-4841-a27c-5f5ddd810de4 None None] MFA Rules not processed for user `a7dab612859d4cd9b3abb57e99f79d60`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:03.074757 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-09ea478e-81cf-4841-a27c-5f5ddd810de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:03.141303 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1301/2619] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:03.153156 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df24fdf-8a92-4f99-a1c8-4832bcbfbded admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:03.205304 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df24fdf-8a92-4f99-a1c8-4832bcbfbded admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:03.209572 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6cf4a-9d68-48fb-b593-fb43c20399d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:03.210219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6cf4a-9d68-48fb-b593-fb43c20399d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:03.210518 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6cf4a-9d68-48fb-b593-fb43c20399d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:03.210777 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6cf4a-9d68-48fb-b593-fb43c20399d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:03.220230 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6cf4a-9d68-48fb-b593-fb43c20399d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:03.221668 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6cf4a-9d68-48fb-b593-fb43c20399d3 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:03.231740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1319/2620] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:12:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:12:03.705916 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea478e-81cf-4841-a27c-5f5ddd810de4 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:03.716152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea478e-81cf-4841-a27c-5f5ddd810de4 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:03.719682 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96560606-8cff-433b-b9bd-620ee8974cfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:03.725635 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96560606-8cff-433b-b9bd-620ee8974cfd service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:03.725635 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96560606-8cff-433b-b9bd-620ee8974cfd service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:03.725635 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96560606-8cff-433b-b9bd-620ee8974cfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:03.777991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96560606-8cff-433b-b9bd-620ee8974cfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:03.779457 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96560606-8cff-433b-b9bd-620ee8974cfd service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:03.788393 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1302/2621] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:12:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:12:05.545757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6cf4a-9d68-48fb-b593-fb43c20399d3 service cinder] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:05.609198 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6cf4a-9d68-48fb-b593-fb43c20399d3 service cinder] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:05.613754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c49f4-9db6-4df5-abe9-ae0e17f2656b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:05.615127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c49f4-9db6-4df5-abe9-ae0e17f2656b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:05.615414 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c49f4-9db6-4df5-abe9-ae0e17f2656b admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:05.615700 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c49f4-9db6-4df5-abe9-ae0e17f2656b admin admin] PATH_INFO: `/v3/users/94a311c88e2c421c8e694b66b19852f7` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:05.616890 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c49f4-9db6-4df5-abe9-ae0e17f2656b admin admin] RBAC: Authorizing `identity:delete_user(user_id=94a311c88e2c421c8e694b66b19852f7)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:05.618854 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c49f4-9db6-4df5-abe9-ae0e17f2656b admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:05.664875 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-347c49f4-9db6-4df5-abe9-ae0e17f2656b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94a311c88e2c421c8e694b66b19852f7'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:05.665455 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-347c49f4-9db6-4df5-abe9-ae0e17f2656b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94a311c88e2c421c8e694b66b19852f7'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:05.677228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-347c49f4-9db6-4df5-abe9-ae0e17f2656b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94a311c88e2c421c8e694b66b19852f7'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:05.683923 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-347c49f4-9db6-4df5-abe9-ae0e17f2656b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94a311c88e2c421c8e694b66b19852f7'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:05.690496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-347c49f4-9db6-4df5-abe9-ae0e17f2656b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94a311c88e2c421c8e694b66b19852f7'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:05.697327 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1320/2622] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:12:05 2022] DELETE /identity/v3/users/94a311c88e2c421c8e694b66b19852f7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:05.701922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eba36a-4de5-4933-a12f-48b87f016f6d None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:05.702436 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eba36a-4de5-4933-a12f-48b87f016f6d None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:05.702540 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eba36a-4de5-4933-a12f-48b87f016f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:05.719631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-d0eba36a-4de5-4933-a12f-48b87f016f6d None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:05.720849 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-d0eba36a-4de5-4933-a12f-48b87f016f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:05.778184 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1303/2623] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:05.788112 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c49f4-9db6-4df5-abe9-ae0e17f2656b admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:05.789512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-347c49f4-9db6-4df5-abe9-ae0e17f2656b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:05.845834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c49f4-9db6-4df5-abe9-ae0e17f2656b admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:05.849519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b201f-b261-47f2-be4f-f8efe118a93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:05.850164 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b201f-b261-47f2-be4f-f8efe118a93e service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:05.850472 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b201f-b261-47f2-be4f-f8efe118a93e service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:05.850750 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b201f-b261-47f2-be4f-f8efe118a93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:05.860133 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b201f-b261-47f2-be4f-f8efe118a93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:05.861561 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b201f-b261-47f2-be4f-f8efe118a93e service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:05.871359 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1321/2624] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:12:06.135858 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eba36a-4de5-4933-a12f-48b87f016f6d None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:06.137274 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-d0eba36a-4de5-4933-a12f-48b87f016f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:06.150794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eba36a-4de5-4933-a12f-48b87f016f6d None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:06.156592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b6785-5a31-4e16-a1aa-4e9d62d3e7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:06.157542 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b6785-5a31-4e16-a1aa-4e9d62d3e7d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:06.157865 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b6785-5a31-4e16-a1aa-4e9d62d3e7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:06.158084 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b6785-5a31-4e16-a1aa-4e9d62d3e7d1 admin admin] PATH_INFO: `/v3/projects/5618e187eb6c4531b1829fc3847637b7` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:06.159546 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b6785-5a31-4e16-a1aa-4e9d62d3e7d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5618e187eb6c4531b1829fc3847637b7)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:06.162800 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b6785-5a31-4e16-a1aa-4e9d62d3e7d1 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:06.210368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-3c8b6785-5a31-4e16-a1aa-4e9d62d3e7d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5618e187eb6c4531b1829fc3847637b7', 'request_id': 'req-3c8b6785-5a31-4e16-a1aa-4e9d62d3e7d1'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:06.215673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-3c8b6785-5a31-4e16-a1aa-4e9d62d3e7d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5618e187eb6c4531b1829fc3847637b7', 'request_id': 'req-3c8b6785-5a31-4e16-a1aa-4e9d62d3e7d1'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:06.221713 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-3c8b6785-5a31-4e16-a1aa-4e9d62d3e7d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5618e187eb6c4531b1829fc3847637b7', 'request_id': 'req-3c8b6785-5a31-4e16-a1aa-4e9d62d3e7d1'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:06.234592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-3c8b6785-5a31-4e16-a1aa-4e9d62d3e7d1 admin admin] The token cache is being invalidate because project 5618e187eb6c4531b1829fc3847637b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:12:06.234880 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-3c8b6785-5a31-4e16-a1aa-4e9d62d3e7d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:06.235508 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-3c8b6785-5a31-4e16-a1aa-4e9d62d3e7d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:06.237059 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1304/2625] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:12:06 2022] DELETE /identity/v3/projects/5618e187eb6c4531b1829fc3847637b7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:06.241246 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b201f-b261-47f2-be4f-f8efe118a93e service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:06.251123 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b201f-b261-47f2-be4f-f8efe118a93e service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:06.308581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ac9b6-9281-49fd-a179-1824a244dde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:06.309458 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ac9b6-9281-49fd-a179-1824a244dde1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:06.309736 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ac9b6-9281-49fd-a179-1824a244dde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:06.310007 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ac9b6-9281-49fd-a179-1824a244dde1 admin admin] PATH_INFO: `/v3/users/25df5db323284a8baff74d19736682ab` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:06.311250 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ac9b6-9281-49fd-a179-1824a244dde1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25df5db323284a8baff74d19736682ab)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:06.313162 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ac9b6-9281-49fd-a179-1824a244dde1 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:06.370121 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-fd7ac9b6-9281-49fd-a179-1824a244dde1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25df5db323284a8baff74d19736682ab'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:06.370976 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-fd7ac9b6-9281-49fd-a179-1824a244dde1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25df5db323284a8baff74d19736682ab'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:06.383395 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-fd7ac9b6-9281-49fd-a179-1824a244dde1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25df5db323284a8baff74d19736682ab'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:06.391341 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-fd7ac9b6-9281-49fd-a179-1824a244dde1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25df5db323284a8baff74d19736682ab'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:06.399078 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-fd7ac9b6-9281-49fd-a179-1824a244dde1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25df5db323284a8baff74d19736682ab'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:06.405556 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1322/2626] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:12:06 2022] DELETE /identity/v3/users/25df5db323284a8baff74d19736682ab => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:06.685083 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b6785-5a31-4e16-a1aa-4e9d62d3e7d1 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:06.686512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-3c8b6785-5a31-4e16-a1aa-4e9d62d3e7d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:06.699913 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b6785-5a31-4e16-a1aa-4e9d62d3e7d1 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:06.758134 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69f6d3-684b-4cfa-9728-c0426a9294fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:06.759049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69f6d3-684b-4cfa-9728-c0426a9294fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:06.759334 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69f6d3-684b-4cfa-9728-c0426a9294fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:06.759610 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69f6d3-684b-4cfa-9728-c0426a9294fb admin admin] PATH_INFO: `/v3/projects/111f011c42744ae29b264076ccbfa1ed` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:06.760813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69f6d3-684b-4cfa-9728-c0426a9294fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=111f011c42744ae29b264076ccbfa1ed)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:06.762749 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69f6d3-684b-4cfa-9728-c0426a9294fb admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:06.807254 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1e69f6d3-684b-4cfa-9728-c0426a9294fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '111f011c42744ae29b264076ccbfa1ed', 'request_id': 'req-1e69f6d3-684b-4cfa-9728-c0426a9294fb'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:06.812445 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1e69f6d3-684b-4cfa-9728-c0426a9294fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '111f011c42744ae29b264076ccbfa1ed', 'request_id': 'req-1e69f6d3-684b-4cfa-9728-c0426a9294fb'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:06.819332 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1e69f6d3-684b-4cfa-9728-c0426a9294fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '111f011c42744ae29b264076ccbfa1ed', 'request_id': 'req-1e69f6d3-684b-4cfa-9728-c0426a9294fb'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:06.830651 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1e69f6d3-684b-4cfa-9728-c0426a9294fb admin admin] The token cache is being invalidate because project 111f011c42744ae29b264076ccbfa1ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:12:06.830937 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1e69f6d3-684b-4cfa-9728-c0426a9294fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:06.831554 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-1e69f6d3-684b-4cfa-9728-c0426a9294fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:06.836593 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1305/2627] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:12:06 2022] DELETE /identity/v3/projects/111f011c42744ae29b264076ccbfa1ed => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:06.838517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a72bb0-1a4d-4f3a-b810-359f313e9a4c None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:06.838976 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a72bb0-1a4d-4f3a-b810-359f313e9a4c None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:06.839077 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a72bb0-1a4d-4f3a-b810-359f313e9a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:06.857577 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-45a72bb0-1a4d-4f3a-b810-359f313e9a4c None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:06.858816 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-45a72bb0-1a4d-4f3a-b810-359f313e9a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:06.915813 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1323/2628] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:06.923549 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783a64c-203f-4a77-9cca-00e95983974c None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:06.923838 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783a64c-203f-4a77-9cca-00e95983974c None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:06.924120 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783a64c-203f-4a77-9cca-00e95983974c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:06.943916 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-e783a64c-203f-4a77-9cca-00e95983974c None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:06.945117 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-e783a64c-203f-4a77-9cca-00e95983974c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:06.953176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1306/2629] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:06.957541 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a72bb0-1a4d-4f3a-b810-359f313e9a4c None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:06.967541 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a72bb0-1a4d-4f3a-b810-359f313e9a4c None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:06.972114 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a1edc-b04e-4161-b078-aad1fdb9a71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:06.972773 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a1edc-b04e-4161-b078-aad1fdb9a71a admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:06.973058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a1edc-b04e-4161-b078-aad1fdb9a71a admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:06.973417 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a1edc-b04e-4161-b078-aad1fdb9a71a admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:06.974428 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a1edc-b04e-4161-b078-aad1fdb9a71a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:12:06.974739 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a1edc-b04e-4161-b078-aad1fdb9a71a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:06.976338 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a1edc-b04e-4161-b078-aad1fdb9a71a admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:06.987699 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1324/2630] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:12:06.992427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783a64c-203f-4a77-9cca-00e95983974c None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:07.001822 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783a64c-203f-4a77-9cca-00e95983974c None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:07.007028 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1aad13-e935-496e-aeb9-dbc8457f0ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:07.007671 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aad13-e935-496e-aeb9-dbc8457f0ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:07.007950 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aad13-e935-496e-aeb9-dbc8457f0ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:07.008222 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aad13-e935-496e-aeb9-dbc8457f0ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:07.008917 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1aad13-e935-496e-aeb9-dbc8457f0ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:07.010855 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1aad13-e935-496e-aeb9-dbc8457f0ee8 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:07.035639 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1307/2631] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:12:06 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:12:07.039582 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a1edc-b04e-4161-b078-aad1fdb9a71a admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:07.049352 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a1edc-b04e-4161-b078-aad1fdb9a71a admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:07.105245 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1de20-0157-458c-bfc9-b276df911b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:07.105913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1de20-0157-458c-bfc9-b276df911b93 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:07.106222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1de20-0157-458c-bfc9-b276df911b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:07.106501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1de20-0157-458c-bfc9-b276df911b93 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:07.107195 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1de20-0157-458c-bfc9-b276df911b93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:07.109094 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1de20-0157-458c-bfc9-b276df911b93 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:07.131388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1325/2632] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:12:07 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:12:07.135600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1aad13-e935-496e-aeb9-dbc8457f0ee8 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:07.146081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1aad13-e935-496e-aeb9-dbc8457f0ee8 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:07.150790 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98c930-cfc2-4a45-a18b-43cba0d52df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:07.151448 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98c930-cfc2-4a45-a18b-43cba0d52df7 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:07.151727 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98c930-cfc2-4a45-a18b-43cba0d52df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:07.152000 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98c930-cfc2-4a45-a18b-43cba0d52df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:07.152723 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98c930-cfc2-4a45-a18b-43cba0d52df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:07.154456 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98c930-cfc2-4a45-a18b-43cba0d52df7 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:07.166642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1308/2633] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:12:07.170618 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1de20-0157-458c-bfc9-b276df911b93 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:07.182590 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1de20-0157-458c-bfc9-b276df911b93 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:07.188028 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3546174-d98e-4544-a22c-1b2a22b9bc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:07.188757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3546174-d98e-4544-a22c-1b2a22b9bc6c admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:07.189042 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3546174-d98e-4544-a22c-1b2a22b9bc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:07.189320 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3546174-d98e-4544-a22c-1b2a22b9bc6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:07.190048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3546174-d98e-4544-a22c-1b2a22b9bc6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:07.191738 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3546174-d98e-4544-a22c-1b2a22b9bc6c admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:07.205647 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1326/2634] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:12:07.210607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98c930-cfc2-4a45-a18b-43cba0d52df7 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:07.220592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98c930-cfc2-4a45-a18b-43cba0d52df7 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:07.225402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad15102-328d-48e8-ae33-672b208a4c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:07.226305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad15102-328d-48e8-ae33-672b208a4c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:07.226588 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad15102-328d-48e8-ae33-672b208a4c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:07.226861 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad15102-328d-48e8-ae33-672b208a4c1a admin admin] PATH_INFO: `/v3/projects/2b448582cc214c6f8b9620ba09caf78a/users/04d9d67095db4e8080c0a6f0420b30a6/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:07.242980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad15102-328d-48e8-ae33-672b208a4c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b448582cc214c6f8b9620ba09caf78a, user_id=04d9d67095db4e8080c0a6f0420b30a6, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:07.245623 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad15102-328d-48e8-ae33-672b208a4c1a admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:07.260054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1309/2635] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:12:07 2022] PUT /identity/v3/projects/2b448582cc214c6f8b9620ba09caf78a/users/04d9d67095db4e8080c0a6f0420b30a6/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:07.272036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0b189-87b9-472f-8262-a98eb9d0a236 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:07.272351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0b189-87b9-472f-8262-a98eb9d0a236 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:07.272628 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0b189-87b9-472f-8262-a98eb9d0a236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:07.299062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-d1a0b189-87b9-472f-8262-a98eb9d0a236 None None] MFA Rules not processed for user `04d9d67095db4e8080c0a6f0420b30a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:07.300253 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-d1a0b189-87b9-472f-8262-a98eb9d0a236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:07.361640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1327/2636] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:07.366083 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad15102-328d-48e8-ae33-672b208a4c1a admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:07.426696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad15102-328d-48e8-ae33-672b208a4c1a admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:07.431325 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa384a-86cf-4bd7-90bc-7fe62f4859bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:07.431980 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa384a-86cf-4bd7-90bc-7fe62f4859bd admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:07.432258 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa384a-86cf-4bd7-90bc-7fe62f4859bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:07.432528 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa384a-86cf-4bd7-90bc-7fe62f4859bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:07.433218 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa384a-86cf-4bd7-90bc-7fe62f4859bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:07.435137 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa384a-86cf-4bd7-90bc-7fe62f4859bd admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:07.463245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1310/2637] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:12:07 2022] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:12:07.467343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0b189-87b9-472f-8262-a98eb9d0a236 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:07.477890 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0b189-87b9-472f-8262-a98eb9d0a236 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:07.534696 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a2a01-82dc-4cf7-9e07-1062c1de0684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:07.535375 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a2a01-82dc-4cf7-9e07-1062c1de0684 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:07.535681 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a2a01-82dc-4cf7-9e07-1062c1de0684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:07.536101 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a2a01-82dc-4cf7-9e07-1062c1de0684 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:07.536794 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a2a01-82dc-4cf7-9e07-1062c1de0684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:07.538706 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a2a01-82dc-4cf7-9e07-1062c1de0684 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:07.558386 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1328/2638] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:12:07 2022] POST /identity/v3/users => generated 301 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:12:07.562301 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa384a-86cf-4bd7-90bc-7fe62f4859bd admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:07.573031 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa384a-86cf-4bd7-90bc-7fe62f4859bd admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:07.577557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbbdbc-d6be-4538-929d-d0554bc899f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:07.578225 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbbdbc-d6be-4538-929d-d0554bc899f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:07.578508 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbbdbc-d6be-4538-929d-d0554bc899f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:07.578777 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbbdbc-d6be-4538-929d-d0554bc899f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:07.579493 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbbdbc-d6be-4538-929d-d0554bc899f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:07.581058 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbbdbc-d6be-4538-929d-d0554bc899f5 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:07.591981 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1311/2639] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:12:07.595984 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a2a01-82dc-4cf7-9e07-1062c1de0684 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:07.606361 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a2a01-82dc-4cf7-9e07-1062c1de0684 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:07.610898 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b11180-6837-432e-bd53-e327f01b6633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:07.611769 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b11180-6837-432e-bd53-e327f01b6633 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:07.612048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b11180-6837-432e-bd53-e327f01b6633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:07.612317 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b11180-6837-432e-bd53-e327f01b6633 admin admin] PATH_INFO: `/v3/projects/19f2fc251237418f8c36b33693276970/users/8b5fc79ec69b47318b17979295f8f4b5/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:07.627062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b11180-6837-432e-bd53-e327f01b6633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f2fc251237418f8c36b33693276970, user_id=8b5fc79ec69b47318b17979295f8f4b5, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:07.629693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b11180-6837-432e-bd53-e327f01b6633 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:07.642913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1329/2640] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:12:07 2022] PUT /identity/v3/projects/19f2fc251237418f8c36b33693276970/users/8b5fc79ec69b47318b17979295f8f4b5/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:12:07.647492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbbdbc-d6be-4538-929d-d0554bc899f5 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:07.657458 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbbdbc-d6be-4538-929d-d0554bc899f5 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:07.713639 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690d690-3646-4a03-96a0-1c77e69a4623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:07.714335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690d690-3646-4a03-96a0-1c77e69a4623 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:07.714615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690d690-3646-4a03-96a0-1c77e69a4623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:07.714886 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690d690-3646-4a03-96a0-1c77e69a4623 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:07.715615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690d690-3646-4a03-96a0-1c77e69a4623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:07.717201 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690d690-3646-4a03-96a0-1c77e69a4623 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:07.727623 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1312/2641] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:12:07.731838 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b11180-6837-432e-bd53-e327f01b6633 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:07.742646 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b11180-6837-432e-bd53-e327f01b6633 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:07.747512 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71f18f-17db-4f88-8a8a-97b1c4476a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:07.748657 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71f18f-17db-4f88-8a8a-97b1c4476a93 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:07.748934 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71f18f-17db-4f88-8a8a-97b1c4476a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:07.749205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71f18f-17db-4f88-8a8a-97b1c4476a93 admin admin] PATH_INFO: `/v3/projects/19f2fc251237418f8c36b33693276970/users/8b5fc79ec69b47318b17979295f8f4b5/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:07.751342 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71f18f-17db-4f88-8a8a-97b1c4476a93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f2fc251237418f8c36b33693276970, user_id=8b5fc79ec69b47318b17979295f8f4b5, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:07.753999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71f18f-17db-4f88-8a8a-97b1c4476a93 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:07.764787 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1330/2642] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:12:07 2022] PUT /identity/v3/projects/19f2fc251237418f8c36b33693276970/users/8b5fc79ec69b47318b17979295f8f4b5/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:07.775465 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d8afd-23c3-4954-a100-57d2a3439d99 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:07.775952 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d8afd-23c3-4954-a100-57d2a3439d99 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:07.776049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d8afd-23c3-4954-a100-57d2a3439d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:07.805502 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71f18f-17db-4f88-8a8a-97b1c4476a93 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:07.807248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-0b71f18f-17db-4f88-8a8a-97b1c4476a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:07.810677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-000d8afd-23c3-4954-a100-57d2a3439d99 None None] MFA Rules not processed for user `8b5fc79ec69b47318b17979295f8f4b5`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:07.811841 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-000d8afd-23c3-4954-a100-57d2a3439d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:07.865986 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71f18f-17db-4f88-8a8a-97b1c4476a93 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:07.869971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f992a2-86e8-4562-a58c-1ca25f78920a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:07.870656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f992a2-86e8-4562-a58c-1ca25f78920a service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:07.870941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f992a2-86e8-4562-a58c-1ca25f78920a service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:07.871219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f992a2-86e8-4562-a58c-1ca25f78920a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:07.873324 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-43f992a2-86e8-4562-a58c-1ca25f78920a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:07.879288 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1313/2643] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:07 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:07.890326 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d8afd-23c3-4954-a100-57d2a3439d99 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:07.891645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-000d8afd-23c3-4954-a100-57d2a3439d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:07.903926 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d8afd-23c3-4954-a100-57d2a3439d99 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:07.907612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469c2d5-8772-4e44-aea6-ac92bdb47f8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:07.908247 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469c2d5-8772-4e44-aea6-ac92bdb47f8c service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:07.908525 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469c2d5-8772-4e44-aea6-ac92bdb47f8c service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:07.908797 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469c2d5-8772-4e44-aea6-ac92bdb47f8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:07.918634 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469c2d5-8772-4e44-aea6-ac92bdb47f8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:07.920055 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469c2d5-8772-4e44-aea6-ac92bdb47f8c service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:07.929714 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1314/2644] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:12:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:12:07.934634 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f992a2-86e8-4562-a58c-1ca25f78920a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:07.936070 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f992a2-86e8-4562-a58c-1ca25f78920a service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:07.946413 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1331/2645] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:12:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:12:08.057784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469c2d5-8772-4e44-aea6-ac92bdb47f8c service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:08.121869 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469c2d5-8772-4e44-aea6-ac92bdb47f8c service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:08.126753 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf5d4e-7827-4677-9692-4a15a9c09938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:08.127619 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf5d4e-7827-4677-9692-4a15a9c09938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:08.127896 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf5d4e-7827-4677-9692-4a15a9c09938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:08.128167 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf5d4e-7827-4677-9692-4a15a9c09938 admin admin] PATH_INFO: `/v3/users/04d9d67095db4e8080c0a6f0420b30a6` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:08.129438 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf5d4e-7827-4677-9692-4a15a9c09938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04d9d67095db4e8080c0a6f0420b30a6)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:08.131999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf5d4e-7827-4677-9692-4a15a9c09938 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:08.180434 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0fbf5d4e-7827-4677-9692-4a15a9c09938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04d9d67095db4e8080c0a6f0420b30a6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:08.187154 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0fbf5d4e-7827-4677-9692-4a15a9c09938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04d9d67095db4e8080c0a6f0420b30a6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:08.199882 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0fbf5d4e-7827-4677-9692-4a15a9c09938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04d9d67095db4e8080c0a6f0420b30a6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:08.200582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0fbf5d4e-7827-4677-9692-4a15a9c09938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04d9d67095db4e8080c0a6f0420b30a6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:08.201245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-0fbf5d4e-7827-4677-9692-4a15a9c09938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04d9d67095db4e8080c0a6f0420b30a6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:08.213787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1315/2646] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:12:08 2022] DELETE /identity/v3/users/04d9d67095db4e8080c0a6f0420b30a6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:08.218425 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198c742-7f31-49c2-8351-4ba3444dab75 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:08.218718 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198c742-7f31-49c2-8351-4ba3444dab75 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:08.218999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198c742-7f31-49c2-8351-4ba3444dab75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:08.237898 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-1198c742-7f31-49c2-8351-4ba3444dab75 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:08.239777 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-1198c742-7f31-49c2-8351-4ba3444dab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:08.315669 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1332/2647] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:12:08.326376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf5d4e-7827-4677-9692-4a15a9c09938 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:08.327582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-0fbf5d4e-7827-4677-9692-4a15a9c09938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:08.387242 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf5d4e-7827-4677-9692-4a15a9c09938 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:08.390965 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7b01c-8cc4-4d64-8a5c-d9d8eff72bee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:08.391610 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7b01c-8cc4-4d64-8a5c-d9d8eff72bee service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:08.391897 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7b01c-8cc4-4d64-8a5c-d9d8eff72bee service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:08.392175 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7b01c-8cc4-4d64-8a5c-d9d8eff72bee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:08.402787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7b01c-8cc4-4d64-8a5c-d9d8eff72bee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:08.404022 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7b01c-8cc4-4d64-8a5c-d9d8eff72bee service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:08.414193 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1316/2648] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:12:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:12:08.689729 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198c742-7f31-49c2-8351-4ba3444dab75 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:08.691210 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-1198c742-7f31-49c2-8351-4ba3444dab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:08.707844 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198c742-7f31-49c2-8351-4ba3444dab75 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:08.714509 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785df94-4415-4b88-a1cb-cd41459a2a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:08.715509 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785df94-4415-4b88-a1cb-cd41459a2a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:08.716538 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785df94-4415-4b88-a1cb-cd41459a2a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:08.716893 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785df94-4415-4b88-a1cb-cd41459a2a88 admin admin] PATH_INFO: `/v3/projects/2b448582cc214c6f8b9620ba09caf78a` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:08.718823 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785df94-4415-4b88-a1cb-cd41459a2a88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b448582cc214c6f8b9620ba09caf78a)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:08.721885 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785df94-4415-4b88-a1cb-cd41459a2a88 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:08.783777 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1785df94-4415-4b88-a1cb-cd41459a2a88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b448582cc214c6f8b9620ba09caf78a', 'request_id': 'req-1785df94-4415-4b88-a1cb-cd41459a2a88'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:08.789950 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1785df94-4415-4b88-a1cb-cd41459a2a88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b448582cc214c6f8b9620ba09caf78a', 'request_id': 'req-1785df94-4415-4b88-a1cb-cd41459a2a88'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:08.796003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1785df94-4415-4b88-a1cb-cd41459a2a88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b448582cc214c6f8b9620ba09caf78a', 'request_id': 'req-1785df94-4415-4b88-a1cb-cd41459a2a88'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:08.808901 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1785df94-4415-4b88-a1cb-cd41459a2a88 admin admin] The token cache is being invalidate because project 2b448582cc214c6f8b9620ba09caf78a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:12:08.809189 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1785df94-4415-4b88-a1cb-cd41459a2a88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:08.809846 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1785df94-4415-4b88-a1cb-cd41459a2a88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:08.811414 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1333/2649] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:12:08 2022] DELETE /identity/v3/projects/2b448582cc214c6f8b9620ba09caf78a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:12:08.815366 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7b01c-8cc4-4d64-8a5c-d9d8eff72bee service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:08.824928 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7b01c-8cc4-4d64-8a5c-d9d8eff72bee service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:08.880388 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c578f-b400-4e0a-8649-096a43c15623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:08.881259 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c578f-b400-4e0a-8649-096a43c15623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:08.881543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c578f-b400-4e0a-8649-096a43c15623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:08.881822 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c578f-b400-4e0a-8649-096a43c15623 admin admin] PATH_INFO: `/v3/users/8b5fc79ec69b47318b17979295f8f4b5` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:08.883040 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c578f-b400-4e0a-8649-096a43c15623 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b5fc79ec69b47318b17979295f8f4b5)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:08.884952 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c578f-b400-4e0a-8649-096a43c15623 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:08.931376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f96c578f-b400-4e0a-8649-096a43c15623 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b5fc79ec69b47318b17979295f8f4b5'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:08.941170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f96c578f-b400-4e0a-8649-096a43c15623 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b5fc79ec69b47318b17979295f8f4b5'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:08.953169 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f96c578f-b400-4e0a-8649-096a43c15623 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b5fc79ec69b47318b17979295f8f4b5'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:08.953862 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f96c578f-b400-4e0a-8649-096a43c15623 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b5fc79ec69b47318b17979295f8f4b5'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:08.954513 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f96c578f-b400-4e0a-8649-096a43c15623 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b5fc79ec69b47318b17979295f8f4b5'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:08.967096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1317/2650] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:12:08 2022] DELETE /identity/v3/users/8b5fc79ec69b47318b17979295f8f4b5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:09.235593 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785df94-4415-4b88-a1cb-cd41459a2a88 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:09.237065 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-1785df94-4415-4b88-a1cb-cd41459a2a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:09.250393 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785df94-4415-4b88-a1cb-cd41459a2a88 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:09.307077 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfec597-15ce-4f07-b0a9-632f2ba65cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:09.307932 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfec597-15ce-4f07-b0a9-632f2ba65cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:09.308246 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfec597-15ce-4f07-b0a9-632f2ba65cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:09.308524 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfec597-15ce-4f07-b0a9-632f2ba65cf4 admin admin] PATH_INFO: `/v3/projects/19f2fc251237418f8c36b33693276970` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:09.309697 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfec597-15ce-4f07-b0a9-632f2ba65cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f2fc251237418f8c36b33693276970)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:09.311623 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfec597-15ce-4f07-b0a9-632f2ba65cf4 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:09.355686 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-fbfec597-15ce-4f07-b0a9-632f2ba65cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f2fc251237418f8c36b33693276970', 'request_id': 'req-fbfec597-15ce-4f07-b0a9-632f2ba65cf4'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:09.360895 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-fbfec597-15ce-4f07-b0a9-632f2ba65cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f2fc251237418f8c36b33693276970', 'request_id': 'req-fbfec597-15ce-4f07-b0a9-632f2ba65cf4'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:09.367119 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-fbfec597-15ce-4f07-b0a9-632f2ba65cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f2fc251237418f8c36b33693276970', 'request_id': 'req-fbfec597-15ce-4f07-b0a9-632f2ba65cf4'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:09.378854 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-fbfec597-15ce-4f07-b0a9-632f2ba65cf4 admin admin] The token cache is being invalidate because project 19f2fc251237418f8c36b33693276970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:12:09.379138 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-fbfec597-15ce-4f07-b0a9-632f2ba65cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:09.380070 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-fbfec597-15ce-4f07-b0a9-632f2ba65cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:09.381534 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1334/2651] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:12:09 2022] DELETE /identity/v3/projects/19f2fc251237418f8c36b33693276970 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:09.386658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e1b9c-0a99-401d-9651-38a98a7a66e2 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:09.386951 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e1b9c-0a99-401d-9651-38a98a7a66e2 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:09.387232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e1b9c-0a99-401d-9651-38a98a7a66e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:09.405902 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-ef2e1b9c-0a99-401d-9651-38a98a7a66e2 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:09.407139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-ef2e1b9c-0a99-401d-9651-38a98a7a66e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:09.467055 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1318/2652] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:09.475133 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6edf1-cc2d-46cb-a9d8-9aa43821b11b None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:09.475424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6edf1-cc2d-46cb-a9d8-9aa43821b11b None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:09.475699 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6edf1-cc2d-46cb-a9d8-9aa43821b11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:09.494159 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-0cf6edf1-cc2d-46cb-a9d8-9aa43821b11b None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:09.495395 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-0cf6edf1-cc2d-46cb-a9d8-9aa43821b11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:09.503422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1335/2653] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:09.508656 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e1b9c-0a99-401d-9651-38a98a7a66e2 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:09.517973 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e1b9c-0a99-401d-9651-38a98a7a66e2 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:09.523642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5638120-1def-43d2-beaf-196fd03e997b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:09.524296 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5638120-1def-43d2-beaf-196fd03e997b admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:09.524577 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5638120-1def-43d2-beaf-196fd03e997b admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:09.524851 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5638120-1def-43d2-beaf-196fd03e997b admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:09.525578 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5638120-1def-43d2-beaf-196fd03e997b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:12:09.525887 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5638120-1def-43d2-beaf-196fd03e997b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:09.527511 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5638120-1def-43d2-beaf-196fd03e997b admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:09.539126 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1319/2654] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:12:09.543370 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6edf1-cc2d-46cb-a9d8-9aa43821b11b None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:09.552942 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6edf1-cc2d-46cb-a9d8-9aa43821b11b None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:09.557637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6346b7-1d09-499c-a7f4-161499bcf210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:09.558311 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6346b7-1d09-499c-a7f4-161499bcf210 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:09.558599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6346b7-1d09-499c-a7f4-161499bcf210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:09.558876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6346b7-1d09-499c-a7f4-161499bcf210 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:09.559569 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6346b7-1d09-499c-a7f4-161499bcf210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:09.561445 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6346b7-1d09-499c-a7f4-161499bcf210 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:09.588580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1336/2655] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:12:09 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:12:09.592756 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5638120-1def-43d2-beaf-196fd03e997b admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:09.603010 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5638120-1def-43d2-beaf-196fd03e997b admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:09.660593 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba31099-ec1c-45a9-bda0-f0436e1e39d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:09.661379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba31099-ec1c-45a9-bda0-f0436e1e39d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:09.661660 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba31099-ec1c-45a9-bda0-f0436e1e39d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:09.661933 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba31099-ec1c-45a9-bda0-f0436e1e39d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:09.662652 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba31099-ec1c-45a9-bda0-f0436e1e39d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:09.664586 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba31099-ec1c-45a9-bda0-f0436e1e39d9 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:09.686255 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1320/2656] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:12:09 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:12:09.689081 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6346b7-1d09-499c-a7f4-161499bcf210 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:09.700953 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6346b7-1d09-499c-a7f4-161499bcf210 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:09.706565 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c24a79-ccec-4866-a5bd-ba0c6458f1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:09.707538 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c24a79-ccec-4866-a5bd-ba0c6458f1db admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:09.708714 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c24a79-ccec-4866-a5bd-ba0c6458f1db admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:09.709172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c24a79-ccec-4866-a5bd-ba0c6458f1db admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:09.710064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c24a79-ccec-4866-a5bd-ba0c6458f1db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:09.711827 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c24a79-ccec-4866-a5bd-ba0c6458f1db admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:09.722676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1337/2657] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:12:09.726999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba31099-ec1c-45a9-bda0-f0436e1e39d9 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:09.737191 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba31099-ec1c-45a9-bda0-f0436e1e39d9 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:09.741991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5e336-5e8c-48a4-ba94-0931c199edca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:09.742800 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5e336-5e8c-48a4-ba94-0931c199edca admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:09.743089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5e336-5e8c-48a4-ba94-0931c199edca admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:09.743360 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5e336-5e8c-48a4-ba94-0931c199edca admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:09.744089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5e336-5e8c-48a4-ba94-0931c199edca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:09.745665 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5e336-5e8c-48a4-ba94-0931c199edca admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:09.758257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1321/2658] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:12:09.762098 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c24a79-ccec-4866-a5bd-ba0c6458f1db admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:09.774941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c24a79-ccec-4866-a5bd-ba0c6458f1db admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:09.788454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15effb55-cb5e-4cfc-a4be-28eb7f8826fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:09.789503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15effb55-cb5e-4cfc-a4be-28eb7f8826fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:09.789791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15effb55-cb5e-4cfc-a4be-28eb7f8826fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:09.790138 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15effb55-cb5e-4cfc-a4be-28eb7f8826fe admin admin] PATH_INFO: `/v3/projects/d0652892a9ac4f75a011be90346b0a42/users/567c8d60a94744278c2bc923e9234a3f/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:09.810339 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15effb55-cb5e-4cfc-a4be-28eb7f8826fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0652892a9ac4f75a011be90346b0a42, user_id=567c8d60a94744278c2bc923e9234a3f, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:09.813187 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15effb55-cb5e-4cfc-a4be-28eb7f8826fe admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:09.833167 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1338/2659] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:12:09 2022] PUT /identity/v3/projects/d0652892a9ac4f75a011be90346b0a42/users/567c8d60a94744278c2bc923e9234a3f/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:09.845872 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdf87e-be35-4287-98fa-23be282062fb None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:09.846526 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdf87e-be35-4287-98fa-23be282062fb None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:09.846686 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdf87e-be35-4287-98fa-23be282062fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:09.883170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-6fcdf87e-be35-4287-98fa-23be282062fb None None] MFA Rules not processed for user `567c8d60a94744278c2bc923e9234a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:09.884401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-6fcdf87e-be35-4287-98fa-23be282062fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:09.974811 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1322/2660] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:09.987675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15effb55-cb5e-4cfc-a4be-28eb7f8826fe admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:09.991423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-15effb55-cb5e-4cfc-a4be-28eb7f8826fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:10.057538 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15effb55-cb5e-4cfc-a4be-28eb7f8826fe admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:10.061266 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08826475-720c-4c21-8449-a7877ba8aab6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:10.061911 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08826475-720c-4c21-8449-a7877ba8aab6 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:10.062190 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08826475-720c-4c21-8449-a7877ba8aab6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:10.062516 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08826475-720c-4c21-8449-a7877ba8aab6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:10.071857 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08826475-720c-4c21-8449-a7877ba8aab6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:10.073308 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08826475-720c-4c21-8449-a7877ba8aab6 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:10.082411 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1339/2661] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:12:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:12:10.102896 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdf87e-be35-4287-98fa-23be282062fb None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:10.116841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08826475-720c-4c21-8449-a7877ba8aab6 service cinder] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:10.118228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-08826475-720c-4c21-8449-a7877ba8aab6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:10.166138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdf87e-be35-4287-98fa-23be282062fb None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:10.171136 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7d419-e929-44af-bc1e-a734d5343405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:10.172024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7d419-e929-44af-bc1e-a734d5343405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:10.172308 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7d419-e929-44af-bc1e-a734d5343405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:10.172583 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7d419-e929-44af-bc1e-a734d5343405 admin admin] PATH_INFO: `/v3/users/567c8d60a94744278c2bc923e9234a3f` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:10.173798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7d419-e929-44af-bc1e-a734d5343405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=567c8d60a94744278c2bc923e9234a3f)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:10.175767 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7d419-e929-44af-bc1e-a734d5343405 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:10.183646 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08826475-720c-4c21-8449-a7877ba8aab6 service cinder] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:10.189227 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead9616-fb89-4235-b6f8-87669760ce24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:10.190099 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead9616-fb89-4235-b6f8-87669760ce24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:10.190414 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead9616-fb89-4235-b6f8-87669760ce24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:10.190689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead9616-fb89-4235-b6f8-87669760ce24 admin admin] PATH_INFO: `/v3/users/efd5f5a75ab0476a85c71dea5de5b47c` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:10.191890 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead9616-fb89-4235-b6f8-87669760ce24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efd5f5a75ab0476a85c71dea5de5b47c)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:10.194531 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead9616-fb89-4235-b6f8-87669760ce24 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:10.224552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b2c7d419-e929-44af-bc1e-a734d5343405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '567c8d60a94744278c2bc923e9234a3f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:10.232147 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b2c7d419-e929-44af-bc1e-a734d5343405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '567c8d60a94744278c2bc923e9234a3f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:10.242068 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6ead9616-fb89-4235-b6f8-87669760ce24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efd5f5a75ab0476a85c71dea5de5b47c'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:10.242798 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6ead9616-fb89-4235-b6f8-87669760ce24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efd5f5a75ab0476a85c71dea5de5b47c'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:10.246081 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b2c7d419-e929-44af-bc1e-a734d5343405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '567c8d60a94744278c2bc923e9234a3f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:10.246756 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b2c7d419-e929-44af-bc1e-a734d5343405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '567c8d60a94744278c2bc923e9234a3f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:10.247352 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-b2c7d419-e929-44af-bc1e-a734d5343405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '567c8d60a94744278c2bc923e9234a3f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:10.254398 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6ead9616-fb89-4235-b6f8-87669760ce24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efd5f5a75ab0476a85c71dea5de5b47c'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:10.260070 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1323/2662] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:12:10 2022] DELETE /identity/v3/users/567c8d60a94744278c2bc923e9234a3f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:10.263301 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6ead9616-fb89-4235-b6f8-87669760ce24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efd5f5a75ab0476a85c71dea5de5b47c'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:10.264755 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d322de-b7e6-491c-81fd-f8cb95460946 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:10.265037 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d322de-b7e6-491c-81fd-f8cb95460946 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:10.265339 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d322de-b7e6-491c-81fd-f8cb95460946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:10.271500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-6ead9616-fb89-4235-b6f8-87669760ce24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efd5f5a75ab0476a85c71dea5de5b47c'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:10.277595 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1340/2663] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:12:10 2022] DELETE /identity/v3/users/efd5f5a75ab0476a85c71dea5de5b47c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:12:10.282022 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa21924-153f-4f1c-97a7-25ddbd84479a None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:10.282381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa21924-153f-4f1c-97a7-25ddbd84479a None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:10.282600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-c5d322de-b7e6-491c-81fd-f8cb95460946 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:10.282711 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa21924-153f-4f1c-97a7-25ddbd84479a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:10.283803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-c5d322de-b7e6-491c-81fd-f8cb95460946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:10.299621 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-7fa21924-153f-4f1c-97a7-25ddbd84479a None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:10.300798 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-7fa21924-153f-4f1c-97a7-25ddbd84479a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:10.341635 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1324/2664] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:10.351784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d322de-b7e6-491c-81fd-f8cb95460946 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:10.353082 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-c5d322de-b7e6-491c-81fd-f8cb95460946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:10.359375 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1341/2665] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:12:10.369209 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa21924-153f-4f1c-97a7-25ddbd84479a None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:10.370607 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-7fa21924-153f-4f1c-97a7-25ddbd84479a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:10.408698 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d322de-b7e6-491c-81fd-f8cb95460946 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:10.413109 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2445b3e-e0a2-4f7f-a984-c3b7958b991c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:10.413760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2445b3e-e0a2-4f7f-a984-c3b7958b991c service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:10.414046 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2445b3e-e0a2-4f7f-a984-c3b7958b991c service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:10.414350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2445b3e-e0a2-4f7f-a984-c3b7958b991c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:10.423773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2445b3e-e0a2-4f7f-a984-c3b7958b991c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:10.425349 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2445b3e-e0a2-4f7f-a984-c3b7958b991c service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:10.426227 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa21924-153f-4f1c-97a7-25ddbd84479a None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:10.430715 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793ce24-29cf-4552-ace8-5486b33d0b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:10.431365 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793ce24-29cf-4552-ace8-5486b33d0b3f service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:10.431648 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793ce24-29cf-4552-ace8-5486b33d0b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:10.431926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793ce24-29cf-4552-ace8-5486b33d0b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:10.436011 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1325/2666] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:12:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:12:10.441265 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793ce24-29cf-4552-ace8-5486b33d0b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:10.442815 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793ce24-29cf-4552-ace8-5486b33d0b3f service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:10.452588 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1342/2667] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:12:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:12:10.780476 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2445b3e-e0a2-4f7f-a984-c3b7958b991c service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:10.782356 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-e2445b3e-e0a2-4f7f-a984-c3b7958b991c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:10.797683 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2445b3e-e0a2-4f7f-a984-c3b7958b991c service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:10.803648 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d51e6a-2544-493e-92c5-541468ee122c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:10.804601 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d51e6a-2544-493e-92c5-541468ee122c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:10.804946 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d51e6a-2544-493e-92c5-541468ee122c admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:10.805231 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d51e6a-2544-493e-92c5-541468ee122c admin admin] PATH_INFO: `/v3/projects/d0652892a9ac4f75a011be90346b0a42` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:10.807226 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d51e6a-2544-493e-92c5-541468ee122c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0652892a9ac4f75a011be90346b0a42)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:10.810400 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d51e6a-2544-493e-92c5-541468ee122c admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:10.811370 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793ce24-29cf-4552-ace8-5486b33d0b3f service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:10.812769 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-5793ce24-29cf-4552-ace8-5486b33d0b3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:10.829577 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793ce24-29cf-4552-ace8-5486b33d0b3f service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:10.838666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300680f-aabe-40ec-ae54-0171e6c8ddd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:10.839977 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300680f-aabe-40ec-ae54-0171e6c8ddd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:10.840267 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300680f-aabe-40ec-ae54-0171e6c8ddd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:10.840536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300680f-aabe-40ec-ae54-0171e6c8ddd6 admin admin] PATH_INFO: `/v3/projects/48583667f11d46a5b22122003587248a` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:10.842738 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300680f-aabe-40ec-ae54-0171e6c8ddd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48583667f11d46a5b22122003587248a)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:10.844724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300680f-aabe-40ec-ae54-0171e6c8ddd6 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:10.865721 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f2d51e6a-2544-493e-92c5-541468ee122c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0652892a9ac4f75a011be90346b0a42', 'request_id': 'req-f2d51e6a-2544-493e-92c5-541468ee122c'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:10.870920 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f2d51e6a-2544-493e-92c5-541468ee122c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0652892a9ac4f75a011be90346b0a42', 'request_id': 'req-f2d51e6a-2544-493e-92c5-541468ee122c'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:10.877236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f2d51e6a-2544-493e-92c5-541468ee122c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0652892a9ac4f75a011be90346b0a42', 'request_id': 'req-f2d51e6a-2544-493e-92c5-541468ee122c'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:10.888514 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f2d51e6a-2544-493e-92c5-541468ee122c admin admin] The token cache is being invalidate because project d0652892a9ac4f75a011be90346b0a42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:12:10.888795 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f2d51e6a-2544-493e-92c5-541468ee122c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:10.889402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f2d51e6a-2544-493e-92c5-541468ee122c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:10.890953 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1326/2668] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:12:10 2022] DELETE /identity/v3/projects/d0652892a9ac4f75a011be90346b0a42 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:10.893445 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-c300680f-aabe-40ec-ae54-0171e6c8ddd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48583667f11d46a5b22122003587248a', 'request_id': 'req-c300680f-aabe-40ec-ae54-0171e6c8ddd6'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:10.896169 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e54e9-9e76-47f2-9295-81713aae7021 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:10.896452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e54e9-9e76-47f2-9295-81713aae7021 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:10.896722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e54e9-9e76-47f2-9295-81713aae7021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:10.900454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-c300680f-aabe-40ec-ae54-0171e6c8ddd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48583667f11d46a5b22122003587248a', 'request_id': 'req-c300680f-aabe-40ec-ae54-0171e6c8ddd6'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:10.906773 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-c300680f-aabe-40ec-ae54-0171e6c8ddd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48583667f11d46a5b22122003587248a', 'request_id': 'req-c300680f-aabe-40ec-ae54-0171e6c8ddd6'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:10.914841 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-f76e54e9-9e76-47f2-9295-81713aae7021 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:10.916038 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-f76e54e9-9e76-47f2-9295-81713aae7021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:10.920276 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-c300680f-aabe-40ec-ae54-0171e6c8ddd6 admin admin] The token cache is being invalidate because project 48583667f11d46a5b22122003587248a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:12:10.920570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-c300680f-aabe-40ec-ae54-0171e6c8ddd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:10.921194 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-c300680f-aabe-40ec-ae54-0171e6c8ddd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:10.922798 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1343/2669] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:12:10 2022] DELETE /identity/v3/projects/48583667f11d46a5b22122003587248a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:12:10.928059 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300680f-aabe-40ec-ae54-0171e6c8ddd6 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:10.929321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c300680f-aabe-40ec-ae54-0171e6c8ddd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:10.984197 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1327/2670] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:10.991267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0440e-7832-4f15-9038-11bd38940af5 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:10.991559 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0440e-7832-4f15-9038-11bd38940af5 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:10.991837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0440e-7832-4f15-9038-11bd38940af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:11.000750 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300680f-aabe-40ec-ae54-0171e6c8ddd6 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:11.012391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47453f-a85d-4c2b-9e1d-4d1f089109c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:11.013024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-d7e0440e-7832-4f15-9038-11bd38940af5 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:11.014045 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47453f-a85d-4c2b-9e1d-4d1f089109c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:11.014485 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47453f-a85d-4c2b-9e1d-4d1f089109c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:11.014775 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47453f-a85d-4c2b-9e1d-4d1f089109c0 admin admin] PATH_INFO: `/v3/users/fb049808920c4bbd870150b448d462d4` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:11.015203 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-d7e0440e-7832-4f15-9038-11bd38940af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:11.016178 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47453f-a85d-4c2b-9e1d-4d1f089109c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb049808920c4bbd870150b448d462d4)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:11.019072 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47453f-a85d-4c2b-9e1d-4d1f089109c0 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:11.029878 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1328/2671] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:12:11.034602 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0440e-7832-4f15-9038-11bd38940af5 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:11.044027 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0440e-7832-4f15-9038-11bd38940af5 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:11.049245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18f393-e3fa-4124-9478-739667e01dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:11.050036 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18f393-e3fa-4124-9478-739667e01dcd admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:11.050422 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18f393-e3fa-4124-9478-739667e01dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:11.050771 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18f393-e3fa-4124-9478-739667e01dcd admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:11.051937 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18f393-e3fa-4124-9478-739667e01dcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:12:11.052249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18f393-e3fa-4124-9478-739667e01dcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:11.054094 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18f393-e3fa-4124-9478-739667e01dcd admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:11.074386 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1329/2672] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:12:11.077002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18f393-e3fa-4124-9478-739667e01dcd admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:11.084390 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-4c47453f-a85d-4c2b-9e1d-4d1f089109c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb049808920c4bbd870150b448d462d4'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:11.085087 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-4c47453f-a85d-4c2b-9e1d-4d1f089109c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb049808920c4bbd870150b448d462d4'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:11.091368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18f393-e3fa-4124-9478-739667e01dcd admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:11.096939 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b9c47-63f3-4877-b635-8f9b24231159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:11.097830 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b9c47-63f3-4877-b635-8f9b24231159 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:11.098380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b9c47-63f3-4877-b635-8f9b24231159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:11.098880 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b9c47-63f3-4877-b635-8f9b24231159 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:11.099792 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b9c47-63f3-4877-b635-8f9b24231159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:11.102166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b9c47-63f3-4877-b635-8f9b24231159 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:11.104332 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-4c47453f-a85d-4c2b-9e1d-4d1f089109c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb049808920c4bbd870150b448d462d4'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:11.115423 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-4c47453f-a85d-4c2b-9e1d-4d1f089109c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb049808920c4bbd870150b448d462d4'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:11.126729 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-4c47453f-a85d-4c2b-9e1d-4d1f089109c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb049808920c4bbd870150b448d462d4'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:11.135640 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1344/2673] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:12:10 2022] DELETE /identity/v3/users/fb049808920c4bbd870150b448d462d4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:11.142823 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1330/2674] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:12:11 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:12:11.147737 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47453f-a85d-4c2b-9e1d-4d1f089109c0 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:11.150540 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-4c47453f-a85d-4c2b-9e1d-4d1f089109c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:11.231798 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47453f-a85d-4c2b-9e1d-4d1f089109c0 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:11.312381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e2cb3-6092-4e5d-893d-c4ec722575fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:11.313137 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e2cb3-6092-4e5d-893d-c4ec722575fa admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:11.313366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e2cb3-6092-4e5d-893d-c4ec722575fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:11.313767 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e2cb3-6092-4e5d-893d-c4ec722575fa admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:11.314374 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e2cb3-6092-4e5d-893d-c4ec722575fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:11.316408 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e2cb3-6092-4e5d-893d-c4ec722575fa admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:11.343354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1345/2675] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:12:11 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:12:11.344692 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b9c47-63f3-4877-b635-8f9b24231159 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:11.359122 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b9c47-63f3-4877-b635-8f9b24231159 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:11.364609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c54457-e7d1-4555-b0b6-6c6ab1970cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:11.365336 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c54457-e7d1-4555-b0b6-6c6ab1970cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:11.365638 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c54457-e7d1-4555-b0b6-6c6ab1970cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:11.365888 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c54457-e7d1-4555-b0b6-6c6ab1970cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:11.366649 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c54457-e7d1-4555-b0b6-6c6ab1970cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:11.368249 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c54457-e7d1-4555-b0b6-6c6ab1970cf4 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:11.378784 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1331/2676] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:12:11.383459 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e2cb3-6092-4e5d-893d-c4ec722575fa admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:11.393817 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e2cb3-6092-4e5d-893d-c4ec722575fa admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:11.398544 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c1ac4-5e17-4433-b319-01cb330b3545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:11.399208 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c1ac4-5e17-4433-b319-01cb330b3545 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:11.399500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c1ac4-5e17-4433-b319-01cb330b3545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:11.399774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c1ac4-5e17-4433-b319-01cb330b3545 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:11.400502 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c1ac4-5e17-4433-b319-01cb330b3545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:11.402142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c1ac4-5e17-4433-b319-01cb330b3545 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:11.412405 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1346/2677] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:12:11.416514 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c54457-e7d1-4555-b0b6-6c6ab1970cf4 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:11.426189 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c54457-e7d1-4555-b0b6-6c6ab1970cf4 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:11.435628 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef1529-95a6-4dba-89f0-2fbdd7812011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:11.437047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef1529-95a6-4dba-89f0-2fbdd7812011 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:11.437405 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef1529-95a6-4dba-89f0-2fbdd7812011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:11.437751 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef1529-95a6-4dba-89f0-2fbdd7812011 admin admin] PATH_INFO: `/v3/projects/41c12a4697c94557a7033e2af0d32d19/users/64b583f2a49f47c1ab91330e2d32f8f1/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:11.451412 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c1ac4-5e17-4433-b319-01cb330b3545 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:11.453256 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-b82c1ac4-5e17-4433-b319-01cb330b3545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:11.453904 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef1529-95a6-4dba-89f0-2fbdd7812011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c12a4697c94557a7033e2af0d32d19, user_id=64b583f2a49f47c1ab91330e2d32f8f1, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:11.456549 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef1529-95a6-4dba-89f0-2fbdd7812011 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:11.469084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c1ac4-5e17-4433-b319-01cb330b3545 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:11.477805 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1332/2678] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:12:11 2022] PUT /identity/v3/projects/41c12a4697c94557a7033e2af0d32d19/users/64b583f2a49f47c1ab91330e2d32f8f1/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:11.483171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e947b6-db75-4232-9487-83948acf43f6 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:11.483642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e947b6-db75-4232-9487-83948acf43f6 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:11.484106 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e947b6-db75-4232-9487-83948acf43f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:11.501910 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-17e947b6-db75-4232-9487-83948acf43f6 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:11.503227 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-17e947b6-db75-4232-9487-83948acf43f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:11.527861 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71325ae1-8c76-4939-98a4-f1918edcd6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:11.528870 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71325ae1-8c76-4939-98a4-f1918edcd6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:11.529160 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71325ae1-8c76-4939-98a4-f1918edcd6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:11.529442 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71325ae1-8c76-4939-98a4-f1918edcd6aa admin admin] PATH_INFO: `/v3/projects/13dd7819d288484c9e8e7e0227f5143c` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:11.530654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71325ae1-8c76-4939-98a4-f1918edcd6aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=13dd7819d288484c9e8e7e0227f5143c)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:11.532578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71325ae1-8c76-4939-98a4-f1918edcd6aa admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:11.563074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1333/2679] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:11.574501 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e947b6-db75-4232-9487-83948acf43f6 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:11.576008 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-17e947b6-db75-4232-9487-83948acf43f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:11.589363 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-71325ae1-8c76-4939-98a4-f1918edcd6aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13dd7819d288484c9e8e7e0227f5143c', 'request_id': 'req-71325ae1-8c76-4939-98a4-f1918edcd6aa'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:11.596429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-71325ae1-8c76-4939-98a4-f1918edcd6aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13dd7819d288484c9e8e7e0227f5143c', 'request_id': 'req-71325ae1-8c76-4939-98a4-f1918edcd6aa'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:11.604284 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-71325ae1-8c76-4939-98a4-f1918edcd6aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13dd7819d288484c9e8e7e0227f5143c', 'request_id': 'req-71325ae1-8c76-4939-98a4-f1918edcd6aa'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:11.618356 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-71325ae1-8c76-4939-98a4-f1918edcd6aa admin admin] The token cache is being invalidate because project 13dd7819d288484c9e8e7e0227f5143c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:12:11.618781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-71325ae1-8c76-4939-98a4-f1918edcd6aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:11.619562 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-71325ae1-8c76-4939-98a4-f1918edcd6aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:11.621415 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1347/2680] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:12:11 2022] DELETE /identity/v3/projects/13dd7819d288484c9e8e7e0227f5143c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:11.626577 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71325ae1-8c76-4939-98a4-f1918edcd6aa admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:11.628604 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-71325ae1-8c76-4939-98a4-f1918edcd6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:11.639095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e947b6-db75-4232-9487-83948acf43f6 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:11.690806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5f892-0260-4ebd-b565-aad2d66ec9ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:11.691462 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5f892-0260-4ebd-b565-aad2d66ec9ea service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:11.691742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5f892-0260-4ebd-b565-aad2d66ec9ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:11.692720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5f892-0260-4ebd-b565-aad2d66ec9ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:11.694710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-48b5f892-0260-4ebd-b565-aad2d66ec9ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:11.700440 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71325ae1-8c76-4939-98a4-f1918edcd6aa admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:11.705100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b08cee-e1d8-4498-afdd-4be63edca2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:11.706077 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b08cee-e1d8-4498-afdd-4be63edca2cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:11.706394 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b08cee-e1d8-4498-afdd-4be63edca2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:11.706673 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b08cee-e1d8-4498-afdd-4be63edca2cc admin admin] PATH_INFO: `/v3/users/a7dab612859d4cd9b3abb57e99f79d60` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:11.706772 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5f892-0260-4ebd-b565-aad2d66ec9ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:11.708545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b08cee-e1d8-4498-afdd-4be63edca2cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7dab612859d4cd9b3abb57e99f79d60)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:11.708967 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5f892-0260-4ebd-b565-aad2d66ec9ea service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:11.711163 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b08cee-e1d8-4498-afdd-4be63edca2cc admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:11.718482 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1334/2681] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:12:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:12:11.759029 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-e0b08cee-e1d8-4498-afdd-4be63edca2cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7dab612859d4cd9b3abb57e99f79d60'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:11.759703 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-e0b08cee-e1d8-4498-afdd-4be63edca2cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7dab612859d4cd9b3abb57e99f79d60'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:11.772986 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-e0b08cee-e1d8-4498-afdd-4be63edca2cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7dab612859d4cd9b3abb57e99f79d60'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:11.780257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-e0b08cee-e1d8-4498-afdd-4be63edca2cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7dab612859d4cd9b3abb57e99f79d60'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:11.787958 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-e0b08cee-e1d8-4498-afdd-4be63edca2cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7dab612859d4cd9b3abb57e99f79d60'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:11.794631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1348/2682] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:12:11 2022] DELETE /identity/v3/users/a7dab612859d4cd9b3abb57e99f79d60 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:12:12.285581 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5f892-0260-4ebd-b565-aad2d66ec9ea service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:12.295251 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5f892-0260-4ebd-b565-aad2d66ec9ea service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:12.355418 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc88f5b-aed6-4da3-8aae-c694d3c77550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:12.356282 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc88f5b-aed6-4da3-8aae-c694d3c77550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:12.356558 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc88f5b-aed6-4da3-8aae-c694d3c77550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:12.356837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc88f5b-aed6-4da3-8aae-c694d3c77550 admin admin] PATH_INFO: `/v3/projects/2734b6b9e05e4e39b6b8c8d7f7444820` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:12.358013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc88f5b-aed6-4da3-8aae-c694d3c77550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2734b6b9e05e4e39b6b8c8d7f7444820)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:12.359926 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc88f5b-aed6-4da3-8aae-c694d3c77550 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:12.410619 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-5dc88f5b-aed6-4da3-8aae-c694d3c77550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2734b6b9e05e4e39b6b8c8d7f7444820', 'request_id': 'req-5dc88f5b-aed6-4da3-8aae-c694d3c77550'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:12.416898 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-5dc88f5b-aed6-4da3-8aae-c694d3c77550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2734b6b9e05e4e39b6b8c8d7f7444820', 'request_id': 'req-5dc88f5b-aed6-4da3-8aae-c694d3c77550'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:12.423250 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-5dc88f5b-aed6-4da3-8aae-c694d3c77550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2734b6b9e05e4e39b6b8c8d7f7444820', 'request_id': 'req-5dc88f5b-aed6-4da3-8aae-c694d3c77550'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:12.437538 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-5dc88f5b-aed6-4da3-8aae-c694d3c77550 admin admin] The token cache is being invalidate because project 2734b6b9e05e4e39b6b8c8d7f7444820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:12:12.437894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-5dc88f5b-aed6-4da3-8aae-c694d3c77550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:12.438622 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-5dc88f5b-aed6-4da3-8aae-c694d3c77550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:12.440181 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1335/2683] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:12:12 2022] DELETE /identity/v3/projects/2734b6b9e05e4e39b6b8c8d7f7444820 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:12.446434 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c15024-f9b5-4269-a1f6-67f2e788b58b None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:12.446926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c15024-f9b5-4269-a1f6-67f2e788b58b None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:12.447011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c15024-f9b5-4269-a1f6-67f2e788b58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:12.465844 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-90c15024-f9b5-4269-a1f6-67f2e788b58b None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:12.467079 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-90c15024-f9b5-4269-a1f6-67f2e788b58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:12.529535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1349/2684] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:12.539924 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b777f27-179a-46ab-baef-e5c2b4b9b8a6 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:12.539924 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b777f27-179a-46ab-baef-e5c2b4b9b8a6 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:12.539924 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b777f27-179a-46ab-baef-e5c2b4b9b8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:12.564246 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0dae4-1e67-4557-a0ef-26de4ddc4bea None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:12.564530 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0dae4-1e67-4557-a0ef-26de4ddc4bea None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:12.564803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0dae4-1e67-4557-a0ef-26de4ddc4bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:12.577412 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-3b777f27-179a-46ab-baef-e5c2b4b9b8a6 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:12.578681 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-3b777f27-179a-46ab-baef-e5c2b4b9b8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:12.591360 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1336/2685] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:12.592394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b777f27-179a-46ab-baef-e5c2b4b9b8a6 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:12.595217 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-d7e0dae4-1e67-4557-a0ef-26de4ddc4bea None None] MFA Rules not processed for user `64b583f2a49f47c1ab91330e2d32f8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:12.596537 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-d7e0dae4-1e67-4557-a0ef-26de4ddc4bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:12.602570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b777f27-179a-46ab-baef-e5c2b4b9b8a6 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:12.607674 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a968d2-7624-49e5-bd2d-3dd56e03dd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:12.608323 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a968d2-7624-49e5-bd2d-3dd56e03dd40 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:12.608605 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a968d2-7624-49e5-bd2d-3dd56e03dd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:12.609182 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a968d2-7624-49e5-bd2d-3dd56e03dd40 admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:12.609590 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a968d2-7624-49e5-bd2d-3dd56e03dd40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:12:12.609896 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a968d2-7624-49e5-bd2d-3dd56e03dd40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:12.611520 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a968d2-7624-49e5-bd2d-3dd56e03dd40 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:12.627554 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1337/2686] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:12:12.629262 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a968d2-7624-49e5-bd2d-3dd56e03dd40 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:12.639689 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a968d2-7624-49e5-bd2d-3dd56e03dd40 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:12.645328 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1568d6-dff9-44e6-8b0b-226b0480d1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:12.646137 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1568d6-dff9-44e6-8b0b-226b0480d1ab admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:12.646446 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1568d6-dff9-44e6-8b0b-226b0480d1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:12.646717 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1568d6-dff9-44e6-8b0b-226b0480d1ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:12.647564 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1568d6-dff9-44e6-8b0b-226b0480d1ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:12.649678 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1568d6-dff9-44e6-8b0b-226b0480d1ab admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:12.675340 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1350/2687] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:12.679886 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1338/2688] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:12:12 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:12:12.683677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0dae4-1e67-4557-a0ef-26de4ddc4bea None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:12.687199 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1568d6-dff9-44e6-8b0b-226b0480d1ab admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:12.688912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-af1568d6-dff9-44e6-8b0b-226b0480d1ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:12.696767 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0dae4-1e67-4557-a0ef-26de4ddc4bea None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:12.751970 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1568d6-dff9-44e6-8b0b-226b0480d1ab admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:12.756702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c503f46-db47-45c0-8819-c2e07fb33a25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:12.757491 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c503f46-db47-45c0-8819-c2e07fb33a25 service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:12.757869 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c503f46-db47-45c0-8819-c2e07fb33a25 service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:12.758272 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c503f46-db47-45c0-8819-c2e07fb33a25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:12.763962 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaed877-75b3-4132-9bba-8ed4cadaaa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:12.764786 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed877-75b3-4132-9bba-8ed4cadaaa20 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:12.765250 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed877-75b3-4132-9bba-8ed4cadaaa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:12.765670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed877-75b3-4132-9bba-8ed4cadaaa20 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:12.766471 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaed877-75b3-4132-9bba-8ed4cadaaa20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:12.768473 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaed877-75b3-4132-9bba-8ed4cadaaa20 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:12.788732 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1351/2689] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:12:12 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:12:12.792757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaed877-75b3-4132-9bba-8ed4cadaaa20 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:12.802839 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaed877-75b3-4132-9bba-8ed4cadaaa20 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:12.807735 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be74c4-5663-451d-9b31-5d9a8d41a986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:12.808429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be74c4-5663-451d-9b31-5d9a8d41a986 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:12.808716 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be74c4-5663-451d-9b31-5d9a8d41a986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:12.808993 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be74c4-5663-451d-9b31-5d9a8d41a986 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:12.809716 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be74c4-5663-451d-9b31-5d9a8d41a986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:12.811384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be74c4-5663-451d-9b31-5d9a8d41a986 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:12.816700 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c503f46-db47-45c0-8819-c2e07fb33a25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:12.818916 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c503f46-db47-45c0-8819-c2e07fb33a25 service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:12.821658 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1352/2690] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:12:12.825587 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be74c4-5663-451d-9b31-5d9a8d41a986 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:12.828065 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1339/2691] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:12:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:12:12.836563 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be74c4-5663-451d-9b31-5d9a8d41a986 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:12.841441 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257cc06-b265-41f7-af1a-6423dc6cd930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:12.842111 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257cc06-b265-41f7-af1a-6423dc6cd930 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:12.842426 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257cc06-b265-41f7-af1a-6423dc6cd930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:12.842705 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257cc06-b265-41f7-af1a-6423dc6cd930 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:12.843465 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257cc06-b265-41f7-af1a-6423dc6cd930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:12.845035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257cc06-b265-41f7-af1a-6423dc6cd930 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:12.857097 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1353/2692] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:12:12.861469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c503f46-db47-45c0-8819-c2e07fb33a25 service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:12.872571 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c503f46-db47-45c0-8819-c2e07fb33a25 service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:12.877901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6b80d-2a87-4205-bf88-1b6ae62c2462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:12.879075 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6b80d-2a87-4205-bf88-1b6ae62c2462 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:12.880160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6b80d-2a87-4205-bf88-1b6ae62c2462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:12.880545 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6b80d-2a87-4205-bf88-1b6ae62c2462 admin admin] PATH_INFO: `/v3/projects/ea28f5c5c160409ba9d42c67104829a2/users/6904278119ea47ffa77ade3775017843/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:12.895806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6b80d-2a87-4205-bf88-1b6ae62c2462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea28f5c5c160409ba9d42c67104829a2, user_id=6904278119ea47ffa77ade3775017843, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:12.899094 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6b80d-2a87-4205-bf88-1b6ae62c2462 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:12.914693 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1340/2693] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:12:12 2022] PUT /identity/v3/projects/ea28f5c5c160409ba9d42c67104829a2/users/6904278119ea47ffa77ade3775017843/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:12.927921 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1efe3-3916-470c-a519-996c457f7deb None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:12.928210 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1efe3-3916-470c-a519-996c457f7deb None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:12.928491 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1efe3-3916-470c-a519-996c457f7deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:12.956264 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-abe1efe3-3916-470c-a519-996c457f7deb None None] MFA Rules not processed for user `6904278119ea47ffa77ade3775017843`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:12.957389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-abe1efe3-3916-470c-a519-996c457f7deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:13.052835 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1354/2694] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:13.058742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6b80d-2a87-4205-bf88-1b6ae62c2462 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:13.175599 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6b80d-2a87-4205-bf88-1b6ae62c2462 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:13.181452 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a1466-b903-4ab9-bb67-e3bc4553662f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:13.181874 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a1466-b903-4ab9-bb67-e3bc4553662f admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:13.182271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a1466-b903-4ab9-bb67-e3bc4553662f admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:13.182494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a1466-b903-4ab9-bb67-e3bc4553662f admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:13.183230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a1466-b903-4ab9-bb67-e3bc4553662f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:13.185287 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a1466-b903-4ab9-bb67-e3bc4553662f admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:13.220906 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1341/2695] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:12:13 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:12:13.222241 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1efe3-3916-470c-a519-996c457f7deb None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:13.237153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1efe3-3916-470c-a519-996c457f7deb None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:13.296479 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5499769-1401-4390-ae94-ab1de56d9eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:13.297186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5499769-1401-4390-ae94-ab1de56d9eed admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:13.297476 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5499769-1401-4390-ae94-ab1de56d9eed admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:13.297773 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5499769-1401-4390-ae94-ab1de56d9eed admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:13.298553 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5499769-1401-4390-ae94-ab1de56d9eed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:13.300531 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5499769-1401-4390-ae94-ab1de56d9eed admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:13.328289 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1355/2696] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:12:13 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:12:13.333751 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a1466-b903-4ab9-bb67-e3bc4553662f admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:13.345810 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a1466-b903-4ab9-bb67-e3bc4553662f admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:13.350934 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1e0c2-57dd-4ed1-bf5e-8a46ae42bc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:13.351601 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1e0c2-57dd-4ed1-bf5e-8a46ae42bc24 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:13.351882 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1e0c2-57dd-4ed1-bf5e-8a46ae42bc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:13.352161 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1e0c2-57dd-4ed1-bf5e-8a46ae42bc24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:13.352881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1e0c2-57dd-4ed1-bf5e-8a46ae42bc24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:13.356145 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1e0c2-57dd-4ed1-bf5e-8a46ae42bc24 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:13.365332 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1342/2697] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:12:13.369981 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5499769-1401-4390-ae94-ab1de56d9eed admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:13.381547 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5499769-1401-4390-ae94-ab1de56d9eed admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:13.386186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044a2c7-a48a-404c-bfec-e803c08cf375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:13.387141 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044a2c7-a48a-404c-bfec-e803c08cf375 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:13.387422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044a2c7-a48a-404c-bfec-e803c08cf375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:13.387699 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044a2c7-a48a-404c-bfec-e803c08cf375 admin admin] PATH_INFO: `/v3/projects/d19e9508102c445197ef5ab6cf34cc4c/users/dd99058cbf5b41cea9d5252f489a0c58/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:13.404656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044a2c7-a48a-404c-bfec-e803c08cf375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d19e9508102c445197ef5ab6cf34cc4c, user_id=dd99058cbf5b41cea9d5252f489a0c58, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:13.407346 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044a2c7-a48a-404c-bfec-e803c08cf375 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:13.421276 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1356/2698] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:12:13 2022] PUT /identity/v3/projects/d19e9508102c445197ef5ab6cf34cc4c/users/dd99058cbf5b41cea9d5252f489a0c58/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:13.424899 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1e0c2-57dd-4ed1-bf5e-8a46ae42bc24 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:13.435761 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1e0c2-57dd-4ed1-bf5e-8a46ae42bc24 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:13.494019 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4be64d-60a9-4271-9ac0-26ba832ced58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:13.494718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4be64d-60a9-4271-9ac0-26ba832ced58 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:13.494998 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4be64d-60a9-4271-9ac0-26ba832ced58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:13.495267 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4be64d-60a9-4271-9ac0-26ba832ced58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:13.496027 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4be64d-60a9-4271-9ac0-26ba832ced58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:13.497605 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4be64d-60a9-4271-9ac0-26ba832ced58 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:13.512362 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1343/2699] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:12:13.513636 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044a2c7-a48a-404c-bfec-e803c08cf375 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:13.525148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044a2c7-a48a-404c-bfec-e803c08cf375 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:13.530405 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c718346-ee8c-42fc-ab56-1d3d8943c473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:13.531300 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c718346-ee8c-42fc-ab56-1d3d8943c473 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:13.531572 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c718346-ee8c-42fc-ab56-1d3d8943c473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:13.531838 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c718346-ee8c-42fc-ab56-1d3d8943c473 admin admin] PATH_INFO: `/v3/projects/d19e9508102c445197ef5ab6cf34cc4c/users/dd99058cbf5b41cea9d5252f489a0c58/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:13.533828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c718346-ee8c-42fc-ab56-1d3d8943c473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d19e9508102c445197ef5ab6cf34cc4c, user_id=dd99058cbf5b41cea9d5252f489a0c58, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:13.536518 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c718346-ee8c-42fc-ab56-1d3d8943c473 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:13.549535 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1357/2700] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:12:13 2022] PUT /identity/v3/projects/d19e9508102c445197ef5ab6cf34cc4c/users/dd99058cbf5b41cea9d5252f489a0c58/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:13.561692 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce4ebf-e2ab-47d1-93c7-9d5ec360402e None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:13.562038 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce4ebf-e2ab-47d1-93c7-9d5ec360402e None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:13.562361 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce4ebf-e2ab-47d1-93c7-9d5ec360402e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:13.605849 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-9fce4ebf-e2ab-47d1-93c7-9d5ec360402e None None] MFA Rules not processed for user `dd99058cbf5b41cea9d5252f489a0c58`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:13.607090 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-9fce4ebf-e2ab-47d1-93c7-9d5ec360402e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:13.636842 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c718346-ee8c-42fc-ab56-1d3d8943c473 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:13.638589 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-1c718346-ee8c-42fc-ab56-1d3d8943c473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:13.674766 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1344/2701] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:13.687211 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce4ebf-e2ab-47d1-93c7-9d5ec360402e None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:13.698009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c718346-ee8c-42fc-ab56-1d3d8943c473 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:13.701754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d0fc8-cd46-4072-8631-3343cad3efc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:13.702540 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d0fc8-cd46-4072-8631-3343cad3efc1 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:13.702803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d0fc8-cd46-4072-8631-3343cad3efc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:13.703159 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d0fc8-cd46-4072-8631-3343cad3efc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:13.705035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-ae2d0fc8-cd46-4072-8631-3343cad3efc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:13.716742 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d0fc8-cd46-4072-8631-3343cad3efc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:13.718237 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d0fc8-cd46-4072-8631-3343cad3efc1 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:13.728219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1358/2702] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:12:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:12:13.747979 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce4ebf-e2ab-47d1-93c7-9d5ec360402e None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:13.751967 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a2be8-c9af-467e-ad69-aecc93b1231e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:13.752641 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a2be8-c9af-467e-ad69-aecc93b1231e service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:13.752907 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a2be8-c9af-467e-ad69-aecc93b1231e service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:13.753182 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a2be8-c9af-467e-ad69-aecc93b1231e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:13.762955 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a2be8-c9af-467e-ad69-aecc93b1231e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:13.764402 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a2be8-c9af-467e-ad69-aecc93b1231e service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:13.775349 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1345/2703] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:12:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:12:13.847912 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d0fc8-cd46-4072-8631-3343cad3efc1 service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:13.858169 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d0fc8-cd46-4072-8631-3343cad3efc1 service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:13.861861 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86d570-bc46-4ee1-ae32-47d116e19cf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:13.862569 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86d570-bc46-4ee1-ae32-47d116e19cf3 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:13.862853 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86d570-bc46-4ee1-ae32-47d116e19cf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:13.863146 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86d570-bc46-4ee1-ae32-47d116e19cf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:13.920034 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86d570-bc46-4ee1-ae32-47d116e19cf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:13.921475 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86d570-bc46-4ee1-ae32-47d116e19cf3 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:13.930510 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1359/2704] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:12:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:12:14.200450 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a2be8-c9af-467e-ad69-aecc93b1231e service cinder] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:14.217414 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83289002-04d7-439d-a630-cc084539613f None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:14.217705 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83289002-04d7-439d-a630-cc084539613f None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:14.217988 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83289002-04d7-439d-a630-cc084539613f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:14.235810 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-83289002-04d7-439d-a630-cc084539613f None None] MFA Rules not processed for user `64b583f2a49f47c1ab91330e2d32f8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:14.237028 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-83289002-04d7-439d-a630-cc084539613f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:14.265225 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a2be8-c9af-467e-ad69-aecc93b1231e service cinder] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:14.270516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca52395-64ba-4717-8c43-e7e706f96931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:14.271382 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca52395-64ba-4717-8c43-e7e706f96931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:14.271657 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca52395-64ba-4717-8c43-e7e706f96931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:14.271962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca52395-64ba-4717-8c43-e7e706f96931 admin admin] PATH_INFO: `/v3/users/6904278119ea47ffa77ade3775017843` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:14.273374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca52395-64ba-4717-8c43-e7e706f96931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6904278119ea47ffa77ade3775017843)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:14.275338 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca52395-64ba-4717-8c43-e7e706f96931 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:14.295509 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1360/2705] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:12:14.322136 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-aca52395-64ba-4717-8c43-e7e706f96931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6904278119ea47ffa77ade3775017843'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:14.330166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-aca52395-64ba-4717-8c43-e7e706f96931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6904278119ea47ffa77ade3775017843'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:14.343408 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-aca52395-64ba-4717-8c43-e7e706f96931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6904278119ea47ffa77ade3775017843'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:14.344287 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-aca52395-64ba-4717-8c43-e7e706f96931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6904278119ea47ffa77ade3775017843'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:14.344921 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-aca52395-64ba-4717-8c43-e7e706f96931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6904278119ea47ffa77ade3775017843'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:14.359876 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1346/2706] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:12:14 2022] DELETE /identity/v3/users/6904278119ea47ffa77ade3775017843 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:14.365400 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5520c44-730e-404d-8c9e-9c8618e69b51 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:14.365741 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5520c44-730e-404d-8c9e-9c8618e69b51 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:14.366027 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5520c44-730e-404d-8c9e-9c8618e69b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:14.385349 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-b5520c44-730e-404d-8c9e-9c8618e69b51 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:14.386624 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-b5520c44-730e-404d-8c9e-9c8618e69b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:14.449297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1361/2707] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:14.460760 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca52395-64ba-4717-8c43-e7e706f96931 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:14.463567 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-aca52395-64ba-4717-8c43-e7e706f96931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:14.524149 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca52395-64ba-4717-8c43-e7e706f96931 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:14.527813 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a63f2-7a53-4ea4-9982-7e629f8473b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:14.528476 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a63f2-7a53-4ea4-9982-7e629f8473b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:14.528761 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a63f2-7a53-4ea4-9982-7e629f8473b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:14.529043 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a63f2-7a53-4ea4-9982-7e629f8473b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:14.539936 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a63f2-7a53-4ea4-9982-7e629f8473b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:14.541389 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a63f2-7a53-4ea4-9982-7e629f8473b6 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:14.552094 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1347/2708] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:12:14.953293 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5520c44-730e-404d-8c9e-9c8618e69b51 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:14.956130 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-b5520c44-730e-404d-8c9e-9c8618e69b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:14.975241 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5520c44-730e-404d-8c9e-9c8618e69b51 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:14.980256 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f0717-b772-4a39-9a68-98b21710f849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:14.981457 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f0717-b772-4a39-9a68-98b21710f849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:14.981742 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f0717-b772-4a39-9a68-98b21710f849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:14.982021 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f0717-b772-4a39-9a68-98b21710f849 admin admin] PATH_INFO: `/v3/projects/ea28f5c5c160409ba9d42c67104829a2` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:14.983335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f0717-b772-4a39-9a68-98b21710f849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea28f5c5c160409ba9d42c67104829a2)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:14.985467 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f0717-b772-4a39-9a68-98b21710f849 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:15.034609 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d14f0717-b772-4a39-9a68-98b21710f849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea28f5c5c160409ba9d42c67104829a2', 'request_id': 'req-d14f0717-b772-4a39-9a68-98b21710f849'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:15.041060 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d14f0717-b772-4a39-9a68-98b21710f849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea28f5c5c160409ba9d42c67104829a2', 'request_id': 'req-d14f0717-b772-4a39-9a68-98b21710f849'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:15.047450 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d14f0717-b772-4a39-9a68-98b21710f849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea28f5c5c160409ba9d42c67104829a2', 'request_id': 'req-d14f0717-b772-4a39-9a68-98b21710f849'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:15.061636 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d14f0717-b772-4a39-9a68-98b21710f849 admin admin] The token cache is being invalidate because project ea28f5c5c160409ba9d42c67104829a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:12:15.061959 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d14f0717-b772-4a39-9a68-98b21710f849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:15.062572 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d14f0717-b772-4a39-9a68-98b21710f849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:15.064369 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1362/2709] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:12:14 2022] DELETE /identity/v3/projects/ea28f5c5c160409ba9d42c67104829a2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:15.068638 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a63f2-7a53-4ea4-9982-7e629f8473b6 service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:15.078401 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a63f2-7a53-4ea4-9982-7e629f8473b6 service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:15.140702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af9449-dfd1-44d9-a28c-e4f1e0e34034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:15.141543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af9449-dfd1-44d9-a28c-e4f1e0e34034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:15.141847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af9449-dfd1-44d9-a28c-e4f1e0e34034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:15.142102 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af9449-dfd1-44d9-a28c-e4f1e0e34034 admin admin] PATH_INFO: `/v3/users/dd99058cbf5b41cea9d5252f489a0c58` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:15.143374 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af9449-dfd1-44d9-a28c-e4f1e0e34034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd99058cbf5b41cea9d5252f489a0c58)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:15.146620 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af9449-dfd1-44d9-a28c-e4f1e0e34034 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:15.199221 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-a6af9449-dfd1-44d9-a28c-e4f1e0e34034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd99058cbf5b41cea9d5252f489a0c58'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:15.206696 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-a6af9449-dfd1-44d9-a28c-e4f1e0e34034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd99058cbf5b41cea9d5252f489a0c58'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:15.219565 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-a6af9449-dfd1-44d9-a28c-e4f1e0e34034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd99058cbf5b41cea9d5252f489a0c58'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:15.220247 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-a6af9449-dfd1-44d9-a28c-e4f1e0e34034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd99058cbf5b41cea9d5252f489a0c58'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:15.220873 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-a6af9449-dfd1-44d9-a28c-e4f1e0e34034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd99058cbf5b41cea9d5252f489a0c58'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:15.234718 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1348/2710] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:12:15 2022] DELETE /identity/v3/users/dd99058cbf5b41cea9d5252f489a0c58 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:15.511235 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f0717-b772-4a39-9a68-98b21710f849 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:15.512739 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-d14f0717-b772-4a39-9a68-98b21710f849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:15.529673 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ad76e-ddbd-4aa5-be9b-e7970844973d None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:15.530192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ad76e-ddbd-4aa5-be9b-e7970844973d None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:15.530192 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ad76e-ddbd-4aa5-be9b-e7970844973d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:15.538775 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f0717-b772-4a39-9a68-98b21710f849 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:15.550404 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-f29ad76e-ddbd-4aa5-be9b-e7970844973d None None] MFA Rules not processed for user `686c869be43c40a9b63b3647bf689c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:15.551887 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-f29ad76e-ddbd-4aa5-be9b-e7970844973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:15.602998 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6a9ac-f299-4c6b-a41f-5c89981945ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:15.603866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6a9ac-f299-4c6b-a41f-5c89981945ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:15.604153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6a9ac-f299-4c6b-a41f-5c89981945ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:15.604623 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6a9ac-f299-4c6b-a41f-5c89981945ea admin admin] PATH_INFO: `/v3/projects/d19e9508102c445197ef5ab6cf34cc4c` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:15.605834 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6a9ac-f299-4c6b-a41f-5c89981945ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d19e9508102c445197ef5ab6cf34cc4c)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:15.607837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6a9ac-f299-4c6b-a41f-5c89981945ea admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:15.616372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1349/2711] 10.222.0.32 () {58 vars in 967 bytes} [Tue May 10 14:12:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:15.630742 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ad76e-ddbd-4aa5-be9b-e7970844973d None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:15.632263 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-f29ad76e-ddbd-4aa5-be9b-e7970844973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:15.666837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-7ec6a9ac-f299-4c6b-a41f-5c89981945ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd19e9508102c445197ef5ab6cf34cc4c', 'request_id': 'req-7ec6a9ac-f299-4c6b-a41f-5c89981945ea'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:15.676454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-7ec6a9ac-f299-4c6b-a41f-5c89981945ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd19e9508102c445197ef5ab6cf34cc4c', 'request_id': 'req-7ec6a9ac-f299-4c6b-a41f-5c89981945ea'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:15.684468 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-7ec6a9ac-f299-4c6b-a41f-5c89981945ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd19e9508102c445197ef5ab6cf34cc4c', 'request_id': 'req-7ec6a9ac-f299-4c6b-a41f-5c89981945ea'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:15.700290 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-7ec6a9ac-f299-4c6b-a41f-5c89981945ea admin admin] The token cache is being invalidate because project d19e9508102c445197ef5ab6cf34cc4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:12:15.701105 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-7ec6a9ac-f299-4c6b-a41f-5c89981945ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:15.701744 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-7ec6a9ac-f299-4c6b-a41f-5c89981945ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:12:15.703631 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1363/2712] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:12:15 2022] DELETE /identity/v3/projects/d19e9508102c445197ef5ab6cf34cc4c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:12:15.709871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b9f98-37e3-45ef-98cb-0daa43c96acb None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:15.710137 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b9f98-37e3-45ef-98cb-0daa43c96acb None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:15.710677 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b9f98-37e3-45ef-98cb-0daa43c96acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:15.714835 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ad76e-ddbd-4aa5-be9b-e7970844973d None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:15.729476 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-8b1b9f98-37e3-45ef-98cb-0daa43c96acb None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:15.730703 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-8b1b9f98-37e3-45ef-98cb-0daa43c96acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:15.776512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50764a50-c8d0-401a-b4c6-def4e6f388ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bbad5318b6417087d7ce6906f8281f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:15.777199 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50764a50-c8d0-401a-b4c6-def4e6f388ff service swift] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:15.777481 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50764a50-c8d0-401a-b4c6-def4e6f388ff service swift] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:15.777753 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50764a50-c8d0-401a-b4c6-def4e6f388ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:15.779676 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-50764a50-c8d0-401a-b4c6-def4e6f388ff service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:15.789025 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1364/2713] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:12:15.796811 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad0f4b-d0b0-46c1-86a8-f6cede5d1452 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:15.797183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad0f4b-d0b0-46c1-86a8-f6cede5d1452 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:15.797470 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad0f4b-d0b0-46c1-86a8-f6cede5d1452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:15.815779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-54ad0f4b-d0b0-46c1-86a8-f6cede5d1452 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:15.817687 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-54ad0f4b-d0b0-46c1-86a8-f6cede5d1452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:15.825709 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1365/2714] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:12:15.829740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad0f4b-d0b0-46c1-86a8-f6cede5d1452 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:15.836897 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50764a50-c8d0-401a-b4c6-def4e6f388ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:15.838540 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50764a50-c8d0-401a-b4c6-def4e6f388ff service swift] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:15.838944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad0f4b-d0b0-46c1-86a8-f6cede5d1452 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:15.843668 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65f31a-2d31-445c-87fa-f30bc1191340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:15.844328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65f31a-2d31-445c-87fa-f30bc1191340 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:15.844614 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65f31a-2d31-445c-87fa-f30bc1191340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:15.844891 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65f31a-2d31-445c-87fa-f30bc1191340 admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:15.845622 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65f31a-2d31-445c-87fa-f30bc1191340 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:12:15.845930 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65f31a-2d31-445c-87fa-f30bc1191340 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:15.846717 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1350/2715] 10.222.0.32 () {60 vars in 1384 bytes} [Tue May 10 14:12:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 14:12:15.851725 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65f31a-2d31-445c-87fa-f30bc1191340 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:15.866528 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1366/2716] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:12:15.868979 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50764a50-c8d0-401a-b4c6-def4e6f388ff service swift] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:15.879975 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50764a50-c8d0-401a-b4c6-def4e6f388ff service swift] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:15.887664 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44210ab-2153-421f-9f78-2b7528d5e55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:15.888586 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44210ab-2153-421f-9f78-2b7528d5e55a admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:15.889006 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44210ab-2153-421f-9f78-2b7528d5e55a admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:15.889386 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44210ab-2153-421f-9f78-2b7528d5e55a admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:15.890254 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44210ab-2153-421f-9f78-2b7528d5e55a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:15.892626 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44210ab-2153-421f-9f78-2b7528d5e55a admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:15.922543 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1351/2717] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:12:15 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:12:15.927444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65f31a-2d31-445c-87fa-f30bc1191340 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:15.938920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65f31a-2d31-445c-87fa-f30bc1191340 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:16.060882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2510497-e3f2-45af-a2f1-0231f3344af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:16.061748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2510497-e3f2-45af-a2f1-0231f3344af8 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:16.061912 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2510497-e3f2-45af-a2f1-0231f3344af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:16.062153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2510497-e3f2-45af-a2f1-0231f3344af8 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:16.062898 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2510497-e3f2-45af-a2f1-0231f3344af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:16.066933 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2510497-e3f2-45af-a2f1-0231f3344af8 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:16.112185 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1367/2718] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:12:15 2022] POST /identity/v3/users => generated 284 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:12:16.119226 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44210ab-2153-421f-9f78-2b7528d5e55a admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:16.133817 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44210ab-2153-421f-9f78-2b7528d5e55a admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:16.141110 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99cf6b-9d51-4e09-ad8c-ecb5f530289c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:16.142103 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99cf6b-9d51-4e09-ad8c-ecb5f530289c admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:16.142672 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99cf6b-9d51-4e09-ad8c-ecb5f530289c admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:16.143103 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99cf6b-9d51-4e09-ad8c-ecb5f530289c admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:16.144006 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99cf6b-9d51-4e09-ad8c-ecb5f530289c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:16.146761 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99cf6b-9d51-4e09-ad8c-ecb5f530289c admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:16.159852 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1352/2719] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:12:16.164228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2510497-e3f2-45af-a2f1-0231f3344af8 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:16.176198 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2510497-e3f2-45af-a2f1-0231f3344af8 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:16.181803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7fa1e-2f2d-4633-9043-7c03ed309ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:16.182368 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7fa1e-2f2d-4633-9043-7c03ed309ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:16.182641 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7fa1e-2f2d-4633-9043-7c03ed309ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:16.182987 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7fa1e-2f2d-4633-9043-7c03ed309ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:16.183791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7fa1e-2f2d-4633-9043-7c03ed309ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:16.185693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7fa1e-2f2d-4633-9043-7c03ed309ae2 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:16.199650 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1368/2720] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:12:16.206510 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99cf6b-9d51-4e09-ad8c-ecb5f530289c admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:16.218891 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99cf6b-9d51-4e09-ad8c-ecb5f530289c admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:16.224274 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0e2d8-92d2-41c4-9601-e04df6fb1ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:16.225492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0e2d8-92d2-41c4-9601-e04df6fb1ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:16.225881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0e2d8-92d2-41c4-9601-e04df6fb1ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:16.226224 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0e2d8-92d2-41c4-9601-e04df6fb1ec3 admin admin] PATH_INFO: `/v3/projects/8e76a8e1114f43cb92c1dcd9dff1239d/users/5972807d1a1540f98219092ee123d32d/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:16.245350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0e2d8-92d2-41c4-9601-e04df6fb1ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e76a8e1114f43cb92c1dcd9dff1239d, user_id=5972807d1a1540f98219092ee123d32d, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:16.248875 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0e2d8-92d2-41c4-9601-e04df6fb1ec3 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:16.265386 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1353/2721] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:12:16 2022] PUT /identity/v3/projects/8e76a8e1114f43cb92c1dcd9dff1239d/users/5972807d1a1540f98219092ee123d32d/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:12:16.277595 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4eb9be-d1d1-4e21-b0f7-513570d2215d None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:16.278011 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4eb9be-d1d1-4e21-b0f7-513570d2215d None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:16.278541 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4eb9be-d1d1-4e21-b0f7-513570d2215d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:16.313047 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-0c4eb9be-d1d1-4e21-b0f7-513570d2215d None None] MFA Rules not processed for user `5972807d1a1540f98219092ee123d32d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:16.314660 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-0c4eb9be-d1d1-4e21-b0f7-513570d2215d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:16.399797 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1369/2722] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:16.409469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0e2d8-92d2-41c4-9601-e04df6fb1ec3 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:16.411335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-cfc0e2d8-92d2-41c4-9601-e04df6fb1ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:16.473139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0e2d8-92d2-41c4-9601-e04df6fb1ec3 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:16.477611 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba88711-9bed-4828-b019-12cfb2afe28b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada4e799ead24839b109377db3c6393b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:16.478548 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba88711-9bed-4828-b019-12cfb2afe28b service glance] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:16.478999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba88711-9bed-4828-b019-12cfb2afe28b service glance] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:16.479283 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba88711-9bed-4828-b019-12cfb2afe28b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:16.490179 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba88711-9bed-4828-b019-12cfb2afe28b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:16.493174 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba88711-9bed-4828-b019-12cfb2afe28b service glance] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:16.503197 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1354/2723] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:12:16 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:12:29.810723 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95fe7c-3760-4938-bf9e-e3a56de12685 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:29.811222 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95fe7c-3760-4938-bf9e-e3a56de12685 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:29.811321 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95fe7c-3760-4938-bf9e-e3a56de12685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:29.829635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-9c95fe7c-3760-4938-bf9e-e3a56de12685 None None] MFA Rules not processed for user `64b583f2a49f47c1ab91330e2d32f8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:29.830855 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-9c95fe7c-3760-4938-bf9e-e3a56de12685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:29.884422 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1370/2724] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:12:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:49.406045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba88711-9bed-4828-b019-12cfb2afe28b service glance] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:49.407598 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-1ba88711-9bed-4828-b019-12cfb2afe28b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:49.488424 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba88711-9bed-4828-b019-12cfb2afe28b service glance] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:49.494134 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa9cfe-1e94-4e1a-af50-ad78113926eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:49.494803 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa9cfe-1e94-4e1a-af50-ad78113926eb service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:49.495084 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa9cfe-1e94-4e1a-af50-ad78113926eb service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:49.495787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa9cfe-1e94-4e1a-af50-ad78113926eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:49.497552 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-2ffa9cfe-1e94-4e1a-af50-ad78113926eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:49.511150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa9cfe-1e94-4e1a-af50-ad78113926eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:49.512778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa9cfe-1e94-4e1a-af50-ad78113926eb service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:49.526439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1355/2725] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:12:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:12:58.792764 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e641f6-e4ed-4a47-b46b-6a9995088caa None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:58.793271 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e641f6-e4ed-4a47-b46b-6a9995088caa None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:58.793382 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e641f6-e4ed-4a47-b46b-6a9995088caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:58.811747 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-f5e641f6-e4ed-4a47-b46b-6a9995088caa None None] MFA Rules not processed for user `686c869be43c40a9b63b3647bf689c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:58.812923 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f5e641f6-e4ed-4a47-b46b-6a9995088caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:58.870529 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1371/2726] 10.222.0.32 () {58 vars in 1009 bytes} [Tue May 10 14:12:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:58.894509 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa9cfe-1e94-4e1a-af50-ad78113926eb service nova] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:58.896131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-2ffa9cfe-1e94-4e1a-af50-ad78113926eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:58.973426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa9cfe-1e94-4e1a-af50-ad78113926eb service nova] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:58.978901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392a019-f167-4e19-8ce0-b40b52487724 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bbad5318b6417087d7ce6906f8281f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:58.979586 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392a019-f167-4e19-8ce0-b40b52487724 service swift] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:58.979869 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392a019-f167-4e19-8ce0-b40b52487724 service swift] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:58.980143 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392a019-f167-4e19-8ce0-b40b52487724 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:58.988023 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392a019-f167-4e19-8ce0-b40b52487724 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:58.989529 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392a019-f167-4e19-8ce0-b40b52487724 service swift] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:58.997847 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1356/2727] 10.222.0.32 () {60 vars in 1384 bytes} [Tue May 10 14:12:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:13:03.440119 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e641f6-e4ed-4a47-b46b-6a9995088caa None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:03.529944 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e641f6-e4ed-4a47-b46b-6a9995088caa None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:03.535168 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92961fb3-31fa-40c8-abe3-2c0cf300b19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:03.537178 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92961fb3-31fa-40c8-abe3-2c0cf300b19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:03.537178 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92961fb3-31fa-40c8-abe3-2c0cf300b19a admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:03.537178 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92961fb3-31fa-40c8-abe3-2c0cf300b19a admin admin] PATH_INFO: `/v3/users/5972807d1a1540f98219092ee123d32d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:03.537778 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92961fb3-31fa-40c8-abe3-2c0cf300b19a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5972807d1a1540f98219092ee123d32d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:03.539791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92961fb3-31fa-40c8-abe3-2c0cf300b19a admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:03.593299 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-92961fb3-31fa-40c8-abe3-2c0cf300b19a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5972807d1a1540f98219092ee123d32d'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:03.594483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-92961fb3-31fa-40c8-abe3-2c0cf300b19a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5972807d1a1540f98219092ee123d32d'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:03.608019 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-92961fb3-31fa-40c8-abe3-2c0cf300b19a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5972807d1a1540f98219092ee123d32d'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:03.617333 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-92961fb3-31fa-40c8-abe3-2c0cf300b19a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5972807d1a1540f98219092ee123d32d'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:03.625194 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-92961fb3-31fa-40c8-abe3-2c0cf300b19a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5972807d1a1540f98219092ee123d32d'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:03.631220 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1372/2728] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:13:03 2022] DELETE /identity/v3/users/5972807d1a1540f98219092ee123d32d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:13:03.636597 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396ae44-c69a-41d2-adce-ed70b5aa3b53 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:03.637055 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396ae44-c69a-41d2-adce-ed70b5aa3b53 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:03.637173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396ae44-c69a-41d2-adce-ed70b5aa3b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:03.655141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-9396ae44-c69a-41d2-adce-ed70b5aa3b53 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:13:03.656357 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-9396ae44-c69a-41d2-adce-ed70b5aa3b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:03.724375 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1357/2729] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:13:03.731200 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92961fb3-31fa-40c8-abe3-2c0cf300b19a admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:03.732605 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-92961fb3-31fa-40c8-abe3-2c0cf300b19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:03.796966 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92961fb3-31fa-40c8-abe3-2c0cf300b19a admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:03.800964 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd73758-14f1-4783-b345-2a2608dfb4ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:03.801618 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd73758-14f1-4783-b345-2a2608dfb4ce service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:03.801900 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd73758-14f1-4783-b345-2a2608dfb4ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:03.802175 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd73758-14f1-4783-b345-2a2608dfb4ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:03.818263 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd73758-14f1-4783-b345-2a2608dfb4ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:03.820052 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd73758-14f1-4783-b345-2a2608dfb4ce service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:03.835979 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1373/2730] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:13:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:13:04.197671 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396ae44-c69a-41d2-adce-ed70b5aa3b53 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:04.199131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-9396ae44-c69a-41d2-adce-ed70b5aa3b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:04.216750 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396ae44-c69a-41d2-adce-ed70b5aa3b53 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:04.231030 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98313d46-cf0f-4461-8ebc-6e5cf3be287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:04.232215 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98313d46-cf0f-4461-8ebc-6e5cf3be287a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:04.232722 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98313d46-cf0f-4461-8ebc-6e5cf3be287a admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:04.233233 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98313d46-cf0f-4461-8ebc-6e5cf3be287a admin admin] PATH_INFO: `/v3/projects/8e76a8e1114f43cb92c1dcd9dff1239d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:04.235087 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98313d46-cf0f-4461-8ebc-6e5cf3be287a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e76a8e1114f43cb92c1dcd9dff1239d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:04.237304 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98313d46-cf0f-4461-8ebc-6e5cf3be287a admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:04.301931 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-98313d46-cf0f-4461-8ebc-6e5cf3be287a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e76a8e1114f43cb92c1dcd9dff1239d', 'request_id': 'req-98313d46-cf0f-4461-8ebc-6e5cf3be287a'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:04.308368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-98313d46-cf0f-4461-8ebc-6e5cf3be287a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e76a8e1114f43cb92c1dcd9dff1239d', 'request_id': 'req-98313d46-cf0f-4461-8ebc-6e5cf3be287a'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:04.315295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-98313d46-cf0f-4461-8ebc-6e5cf3be287a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e76a8e1114f43cb92c1dcd9dff1239d', 'request_id': 'req-98313d46-cf0f-4461-8ebc-6e5cf3be287a'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:04.330837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-98313d46-cf0f-4461-8ebc-6e5cf3be287a admin admin] The token cache is being invalidate because project 8e76a8e1114f43cb92c1dcd9dff1239d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:13:04.331224 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-98313d46-cf0f-4461-8ebc-6e5cf3be287a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:04.332108 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-98313d46-cf0f-4461-8ebc-6e5cf3be287a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:04.334063 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1358/2731] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:13:04 2022] DELETE /identity/v3/projects/8e76a8e1114f43cb92c1dcd9dff1239d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:13:04.339354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f0bc9-f434-4f7d-9896-58e351669c2b None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:04.339851 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f0bc9-f434-4f7d-9896-58e351669c2b None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:04.340333 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f0bc9-f434-4f7d-9896-58e351669c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:04.360550 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-222f0bc9-f434-4f7d-9896-58e351669c2b None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:13:04.361757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-222f0bc9-f434-4f7d-9896-58e351669c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:04.434409 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1374/2732] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:13:04.443228 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cf906-8343-45c0-82ec-daea046ffab7 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:04.443522 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cf906-8343-45c0-82ec-daea046ffab7 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:04.443808 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cf906-8343-45c0-82ec-daea046ffab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:04.464441 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-145cf906-8343-45c0-82ec-daea046ffab7 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:13:04.465781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-145cf906-8343-45c0-82ec-daea046ffab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:04.473715 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1359/2733] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:13:04.479063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f0bc9-f434-4f7d-9896-58e351669c2b None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:04.495594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f0bc9-f434-4f7d-9896-58e351669c2b None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:04.501012 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ce11e-65ce-4323-8607-e2ee87d3faf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:04.501637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ce11e-65ce-4323-8607-e2ee87d3faf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:04.501957 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ce11e-65ce-4323-8607-e2ee87d3faf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:04.502289 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ce11e-65ce-4323-8607-e2ee87d3faf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:04.503172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ce11e-65ce-4323-8607-e2ee87d3faf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:13:04.503491 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ce11e-65ce-4323-8607-e2ee87d3faf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:04.505211 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ce11e-65ce-4323-8607-e2ee87d3faf4 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:04.521995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1375/2734] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:13:04.523560 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cf906-8343-45c0-82ec-daea046ffab7 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:04.534671 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cf906-8343-45c0-82ec-daea046ffab7 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:04.540699 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843f2f2-6b24-4383-bc85-f015628d1334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:04.541362 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843f2f2-6b24-4383-bc85-f015628d1334 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:04.541642 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843f2f2-6b24-4383-bc85-f015628d1334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:04.541914 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843f2f2-6b24-4383-bc85-f015628d1334 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:04.542635 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843f2f2-6b24-4383-bc85-f015628d1334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:04.544545 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843f2f2-6b24-4383-bc85-f015628d1334 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:04.580251 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1360/2735] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:13:04 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:13:04.581515 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ce11e-65ce-4323-8607-e2ee87d3faf4 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:04.592986 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ce11e-65ce-4323-8607-e2ee87d3faf4 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:04.662162 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce30f0-fbde-4ff9-88a8-733542fa6f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:04.662968 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce30f0-fbde-4ff9-88a8-733542fa6f8a admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:04.663257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce30f0-fbde-4ff9-88a8-733542fa6f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:04.663537 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce30f0-fbde-4ff9-88a8-733542fa6f8a admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:04.664253 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce30f0-fbde-4ff9-88a8-733542fa6f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:04.666429 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce30f0-fbde-4ff9-88a8-733542fa6f8a admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:04.751791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1376/2736] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:13:04 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:13:04.757708 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843f2f2-6b24-4383-bc85-f015628d1334 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:04.769430 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843f2f2-6b24-4383-bc85-f015628d1334 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:04.776668 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b73d90-2f3e-47d0-8fdc-175500b842e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:04.777348 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b73d90-2f3e-47d0-8fdc-175500b842e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:04.777637 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b73d90-2f3e-47d0-8fdc-175500b842e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:04.777912 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b73d90-2f3e-47d0-8fdc-175500b842e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:04.778688 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b73d90-2f3e-47d0-8fdc-175500b842e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:04.780335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b73d90-2f3e-47d0-8fdc-175500b842e1 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:04.793568 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1361/2737] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:13:04.797540 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce30f0-fbde-4ff9-88a8-733542fa6f8a admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:04.809381 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce30f0-fbde-4ff9-88a8-733542fa6f8a admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:04.817283 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd33bd-9555-482a-b9e7-35481b9a38bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:04.818147 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd33bd-9555-482a-b9e7-35481b9a38bf admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:04.818495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd33bd-9555-482a-b9e7-35481b9a38bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:04.818781 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd33bd-9555-482a-b9e7-35481b9a38bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:04.819587 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd33bd-9555-482a-b9e7-35481b9a38bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:04.821394 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd33bd-9555-482a-b9e7-35481b9a38bf admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:04.835594 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1377/2738] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:13:04.839179 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b73d90-2f3e-47d0-8fdc-175500b842e1 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:04.849444 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b73d90-2f3e-47d0-8fdc-175500b842e1 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:04.855013 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3e6a3-e204-4977-b708-465a3d7fc314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:04.856332 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3e6a3-e204-4977-b708-465a3d7fc314 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:04.856778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3e6a3-e204-4977-b708-465a3d7fc314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:04.857372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3e6a3-e204-4977-b708-465a3d7fc314 admin admin] PATH_INFO: `/v3/projects/6350c410027a478988e364b17696da95/users/da9685af6f6f47c8a59fb93df9bd0ec1/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:04.874234 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3e6a3-e204-4977-b708-465a3d7fc314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6350c410027a478988e364b17696da95, user_id=da9685af6f6f47c8a59fb93df9bd0ec1, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:04.876906 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3e6a3-e204-4977-b708-465a3d7fc314 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:04.893437 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1362/2739] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:13:04 2022] PUT /identity/v3/projects/6350c410027a478988e364b17696da95/users/da9685af6f6f47c8a59fb93df9bd0ec1/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:13:04.899118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519d5dd-d61d-4ec6-a87d-0fb6a39ad1dd None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:04.899627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519d5dd-d61d-4ec6-a87d-0fb6a39ad1dd None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:04.900194 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519d5dd-d61d-4ec6-a87d-0fb6a39ad1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:04.924537 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-7519d5dd-d61d-4ec6-a87d-0fb6a39ad1dd None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:13:04.925762 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-7519d5dd-d61d-4ec6-a87d-0fb6a39ad1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:04.992904 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1378/2740] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:13:05.004432 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3e6a3-e204-4977-b708-465a3d7fc314 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:05.006344 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-eaa3e6a3-e204-4977-b708-465a3d7fc314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:05.082025 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3e6a3-e204-4977-b708-465a3d7fc314 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:05.086720 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba9d78-4123-446c-b19d-59ce81f52bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:05.088292 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba9d78-4123-446c-b19d-59ce81f52bda service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:05.088583 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba9d78-4123-446c-b19d-59ce81f52bda service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:05.089251 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba9d78-4123-446c-b19d-59ce81f52bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:05.105403 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba9d78-4123-446c-b19d-59ce81f52bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:05.107648 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba9d78-4123-446c-b19d-59ce81f52bda service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:05.121034 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1363/2741] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:13:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:13:10.560202 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2d0ca-b00f-44f6-afaf-49b967062168 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:10.560936 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2d0ca-b00f-44f6-afaf-49b967062168 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:10.560936 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2d0ca-b00f-44f6-afaf-49b967062168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:10.619917 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-cbe2d0ca-b00f-44f6-afaf-49b967062168 None None] MFA Rules not processed for user `da9685af6f6f47c8a59fb93df9bd0ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:13:10.621471 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-cbe2d0ca-b00f-44f6-afaf-49b967062168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:10.719314 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1379/2742] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:13:10.723419 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba9d78-4123-446c-b19d-59ce81f52bda service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:10.760724 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba9d78-4123-446c-b19d-59ce81f52bda service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:10.767644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c28f18-de3f-4404-9240-27a84fbc8532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:10.768540 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c28f18-de3f-4404-9240-27a84fbc8532 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:10.769157 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c28f18-de3f-4404-9240-27a84fbc8532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:10.769583 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c28f18-de3f-4404-9240-27a84fbc8532 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:10.770460 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c28f18-de3f-4404-9240-27a84fbc8532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:10.772745 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c28f18-de3f-4404-9240-27a84fbc8532 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:10.814887 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1364/2743] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:13:10 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:13:10.818877 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2d0ca-b00f-44f6-afaf-49b967062168 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:10.839309 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2d0ca-b00f-44f6-afaf-49b967062168 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:10.919520 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2dcc9-47ce-4d5d-9333-fd2221e70b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:10.920218 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2dcc9-47ce-4d5d-9333-fd2221e70b5e admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:10.920502 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2dcc9-47ce-4d5d-9333-fd2221e70b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:10.920774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2dcc9-47ce-4d5d-9333-fd2221e70b5e admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:10.921717 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2dcc9-47ce-4d5d-9333-fd2221e70b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:10.923678 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2dcc9-47ce-4d5d-9333-fd2221e70b5e admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:10.954116 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1380/2744] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:13:10 2022] POST /identity/v3/users => generated 295 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:13:10.957724 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c28f18-de3f-4404-9240-27a84fbc8532 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:10.968624 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c28f18-de3f-4404-9240-27a84fbc8532 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:10.973632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6238cab-611b-497c-bea4-1830c88e1d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:10.974412 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6238cab-611b-497c-bea4-1830c88e1d22 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:10.974698 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6238cab-611b-497c-bea4-1830c88e1d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:10.974971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6238cab-611b-497c-bea4-1830c88e1d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:10.975914 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6238cab-611b-497c-bea4-1830c88e1d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:10.978104 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6238cab-611b-497c-bea4-1830c88e1d22 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:10.994725 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1365/2745] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:13:10.995877 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2dcc9-47ce-4d5d-9333-fd2221e70b5e admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:11.007454 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2dcc9-47ce-4d5d-9333-fd2221e70b5e admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:11.013663 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ef789-9b58-4057-a91f-0dbad8316163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:11.014763 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ef789-9b58-4057-a91f-0dbad8316163 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:11.015048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ef789-9b58-4057-a91f-0dbad8316163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:11.015327 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ef789-9b58-4057-a91f-0dbad8316163 admin admin] PATH_INFO: `/v3/projects/1003748f1422448fa4680c87337e862b/users/01760d8c7d6b4fbd86610dae0279c702/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:11.033711 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ef789-9b58-4057-a91f-0dbad8316163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1003748f1422448fa4680c87337e862b, user_id=01760d8c7d6b4fbd86610dae0279c702, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:11.036753 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ef789-9b58-4057-a91f-0dbad8316163 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:11.059570 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1381/2746] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:13:10 2022] PUT /identity/v3/projects/1003748f1422448fa4680c87337e862b/users/01760d8c7d6b4fbd86610dae0279c702/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:13:11.060991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6238cab-611b-497c-bea4-1830c88e1d22 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:11.081085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6238cab-611b-497c-bea4-1830c88e1d22 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:11.169151 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8916cb-220a-4994-a8b3-1315792ad5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:11.170139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8916cb-220a-4994-a8b3-1315792ad5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:11.170695 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8916cb-220a-4994-a8b3-1315792ad5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:11.171187 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8916cb-220a-4994-a8b3-1315792ad5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:11.172144 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8916cb-220a-4994-a8b3-1315792ad5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:11.174152 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8916cb-220a-4994-a8b3-1315792ad5d5 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:11.190606 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1366/2747] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:13:11.191335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ef789-9b58-4057-a91f-0dbad8316163 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:11.204241 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ef789-9b58-4057-a91f-0dbad8316163 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:11.209484 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7219984-4f00-4bf8-95d5-b68cdcf6c5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:11.210500 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7219984-4f00-4bf8-95d5-b68cdcf6c5d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:11.210986 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7219984-4f00-4bf8-95d5-b68cdcf6c5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:11.211340 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7219984-4f00-4bf8-95d5-b68cdcf6c5d1 admin admin] PATH_INFO: `/v3/projects/1003748f1422448fa4680c87337e862b/users/01760d8c7d6b4fbd86610dae0279c702/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:11.215076 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7219984-4f00-4bf8-95d5-b68cdcf6c5d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1003748f1422448fa4680c87337e862b, user_id=01760d8c7d6b4fbd86610dae0279c702, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:11.218227 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7219984-4f00-4bf8-95d5-b68cdcf6c5d1 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:11.234538 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1382/2748] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:13:11 2022] PUT /identity/v3/projects/1003748f1422448fa4680c87337e862b/users/01760d8c7d6b4fbd86610dae0279c702/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:13:17.522818 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ea725-dc92-4a3c-95db-e4a4395ea175 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:17.523854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ea725-dc92-4a3c-95db-e4a4395ea175 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:17.524952 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ea725-dc92-4a3c-95db-e4a4395ea175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:17.557606 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-5f6ea725-dc92-4a3c-95db-e4a4395ea175 None None] MFA Rules not processed for user `01760d8c7d6b4fbd86610dae0279c702`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:13:17.559943 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-5f6ea725-dc92-4a3c-95db-e4a4395ea175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:17.688020 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1367/2749] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:13:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:13:17.715936 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7219984-4f00-4bf8-95d5-b68cdcf6c5d1 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:17.719661 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-d7219984-4f00-4bf8-95d5-b68cdcf6c5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:17.821034 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7219984-4f00-4bf8-95d5-b68cdcf6c5d1 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:17.838845 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a038f0-7ed8-41f4-b08b-0fd84badfa36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:17.840406 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a038f0-7ed8-41f4-b08b-0fd84badfa36 service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:17.840917 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a038f0-7ed8-41f4-b08b-0fd84badfa36 service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:17.841434 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a038f0-7ed8-41f4-b08b-0fd84badfa36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:17.983790 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a038f0-7ed8-41f4-b08b-0fd84badfa36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:17.987256 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a038f0-7ed8-41f4-b08b-0fd84badfa36 service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:18.014696 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1383/2750] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:13:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:13:19.481183 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af6d66-5425-4198-aebe-94d9d3f9b2fc None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:19.481726 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af6d66-5425-4198-aebe-94d9d3f9b2fc None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:19.481879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af6d66-5425-4198-aebe-94d9d3f9b2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:19.503005 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-b2af6d66-5425-4198-aebe-94d9d3f9b2fc None None] MFA Rules not processed for user `686c869be43c40a9b63b3647bf689c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:13:19.504413 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b2af6d66-5425-4198-aebe-94d9d3f9b2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:19.568869 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1368/2751] 10.222.0.32 () {58 vars in 967 bytes} [Tue May 10 14:13:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:13:19.585031 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a038f0-7ed8-41f4-b08b-0fd84badfa36 service nova] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:19.591018 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-41a038f0-7ed8-41f4-b08b-0fd84badfa36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:19.685347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a038f0-7ed8-41f4-b08b-0fd84badfa36 service nova] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:19.690814 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63e6bb-0dea-4c08-8597-3e9321fb8f67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bbad5318b6417087d7ce6906f8281f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:19.691701 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63e6bb-0dea-4c08-8597-3e9321fb8f67 service swift] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:19.692156 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63e6bb-0dea-4c08-8597-3e9321fb8f67 service swift] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:19.692585 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63e6bb-0dea-4c08-8597-3e9321fb8f67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:19.702012 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63e6bb-0dea-4c08-8597-3e9321fb8f67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:19.703667 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63e6bb-0dea-4c08-8597-3e9321fb8f67 service swift] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:19.713659 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1384/2752] 10.222.0.32 () {60 vars in 1384 bytes} [Tue May 10 14:13:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:13:21.811039 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af6d66-5425-4198-aebe-94d9d3f9b2fc None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:21.812653 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b2af6d66-5425-4198-aebe-94d9d3f9b2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:21.893598 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af6d66-5425-4198-aebe-94d9d3f9b2fc None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:21.898430 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db748a92-1840-4420-8e53-15d9f10153c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:21.900136 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db748a92-1840-4420-8e53-15d9f10153c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:21.900494 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db748a92-1840-4420-8e53-15d9f10153c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:21.900776 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db748a92-1840-4420-8e53-15d9f10153c3 admin admin] PATH_INFO: `/v3/users/64b583f2a49f47c1ab91330e2d32f8f1` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:21.902020 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db748a92-1840-4420-8e53-15d9f10153c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64b583f2a49f47c1ab91330e2d32f8f1)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:21.903991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db748a92-1840-4420-8e53-15d9f10153c3 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:21.954638 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-db748a92-1840-4420-8e53-15d9f10153c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64b583f2a49f47c1ab91330e2d32f8f1'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:21.964353 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-db748a92-1840-4420-8e53-15d9f10153c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64b583f2a49f47c1ab91330e2d32f8f1'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:21.976747 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-db748a92-1840-4420-8e53-15d9f10153c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64b583f2a49f47c1ab91330e2d32f8f1'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:21.978450 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-db748a92-1840-4420-8e53-15d9f10153c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64b583f2a49f47c1ab91330e2d32f8f1'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:21.979232 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-db748a92-1840-4420-8e53-15d9f10153c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64b583f2a49f47c1ab91330e2d32f8f1'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:21.993112 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1369/2753] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:13:21 2022] DELETE /identity/v3/users/64b583f2a49f47c1ab91330e2d32f8f1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:13:22.174756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63e6bb-0dea-4c08-8597-3e9321fb8f67 service swift] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:22.187793 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63e6bb-0dea-4c08-8597-3e9321fb8f67 service swift] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:22.257291 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891d9a8-9bd5-41cb-b3b8-44b5e279508e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:22.258319 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891d9a8-9bd5-41cb-b3b8-44b5e279508e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:22.258801 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891d9a8-9bd5-41cb-b3b8-44b5e279508e admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:22.259387 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891d9a8-9bd5-41cb-b3b8-44b5e279508e admin admin] PATH_INFO: `/v3/projects/41c12a4697c94557a7033e2af0d32d19` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:22.260707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891d9a8-9bd5-41cb-b3b8-44b5e279508e admin admin] RBAC: Authorizing `identity:delete_project(project_id=41c12a4697c94557a7033e2af0d32d19)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:22.263111 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891d9a8-9bd5-41cb-b3b8-44b5e279508e admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:22.317355 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-8891d9a8-9bd5-41cb-b3b8-44b5e279508e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41c12a4697c94557a7033e2af0d32d19', 'request_id': 'req-8891d9a8-9bd5-41cb-b3b8-44b5e279508e'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:22.322607 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-8891d9a8-9bd5-41cb-b3b8-44b5e279508e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41c12a4697c94557a7033e2af0d32d19', 'request_id': 'req-8891d9a8-9bd5-41cb-b3b8-44b5e279508e'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:22.328714 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-8891d9a8-9bd5-41cb-b3b8-44b5e279508e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41c12a4697c94557a7033e2af0d32d19', 'request_id': 'req-8891d9a8-9bd5-41cb-b3b8-44b5e279508e'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:22.343722 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-8891d9a8-9bd5-41cb-b3b8-44b5e279508e admin admin] The token cache is being invalidate because project 41c12a4697c94557a7033e2af0d32d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:13:22.345357 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-8891d9a8-9bd5-41cb-b3b8-44b5e279508e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:22.346110 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-8891d9a8-9bd5-41cb-b3b8-44b5e279508e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:22.347937 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1385/2754] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:13:22 2022] DELETE /identity/v3/projects/41c12a4697c94557a7033e2af0d32d19 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:13:22.355003 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3030a-82da-4f46-8455-ec33bd956857 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:22.355293 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3030a-82da-4f46-8455-ec33bd956857 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:22.355557 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3030a-82da-4f46-8455-ec33bd956857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:22.376939 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-a9e3030a-82da-4f46-8455-ec33bd956857 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:13:22.378150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a9e3030a-82da-4f46-8455-ec33bd956857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:22.440328 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1370/2755] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:13:22.501903 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9dd9d-078b-4666-8faf-88793a142ede None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:22.502102 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9dd9d-078b-4666-8faf-88793a142ede None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:22.502390 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9dd9d-078b-4666-8faf-88793a142ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:22.521471 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-d6c9dd9d-078b-4666-8faf-88793a142ede None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:13:22.522757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-d6c9dd9d-078b-4666-8faf-88793a142ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:22.530973 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1386/2756] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:13:22.535318 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3030a-82da-4f46-8455-ec33bd956857 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:22.545380 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3030a-82da-4f46-8455-ec33bd956857 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:22.549908 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ad5d1-3d6c-4593-82ff-0057cf41c81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:22.550586 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ad5d1-3d6c-4593-82ff-0057cf41c81e admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:22.550866 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ad5d1-3d6c-4593-82ff-0057cf41c81e admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:22.551142 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ad5d1-3d6c-4593-82ff-0057cf41c81e admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:22.551862 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ad5d1-3d6c-4593-82ff-0057cf41c81e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:13:22.552171 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ad5d1-3d6c-4593-82ff-0057cf41c81e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:22.553776 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ad5d1-3d6c-4593-82ff-0057cf41c81e admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:22.566239 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1371/2757] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:13:22.570708 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9dd9d-078b-4666-8faf-88793a142ede None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:22.580153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9dd9d-078b-4666-8faf-88793a142ede None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:22.584738 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5e50f-4810-4ddc-bf5a-67e38956a6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:22.585398 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5e50f-4810-4ddc-bf5a-67e38956a6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:22.585676 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5e50f-4810-4ddc-bf5a-67e38956a6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:22.586003 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5e50f-4810-4ddc-bf5a-67e38956a6e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:22.587370 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5e50f-4810-4ddc-bf5a-67e38956a6e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:22.589243 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5e50f-4810-4ddc-bf5a-67e38956a6e1 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:22.613888 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1387/2758] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:13:22 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:13:22.618672 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ad5d1-3d6c-4593-82ff-0057cf41c81e admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:22.628923 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ad5d1-3d6c-4593-82ff-0057cf41c81e admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:22.688062 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f947d-f02b-42e0-a5a0-631ee0653268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:22.688732 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f947d-f02b-42e0-a5a0-631ee0653268 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:22.689010 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f947d-f02b-42e0-a5a0-631ee0653268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:22.689281 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f947d-f02b-42e0-a5a0-631ee0653268 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:22.689958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f947d-f02b-42e0-a5a0-631ee0653268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:22.691910 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f947d-f02b-42e0-a5a0-631ee0653268 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:22.711863 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1372/2759] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:13:22 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:13:22.717066 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5e50f-4810-4ddc-bf5a-67e38956a6e1 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:22.728042 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5e50f-4810-4ddc-bf5a-67e38956a6e1 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:22.732809 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ffd6a-5cc7-4fcd-ab24-feeeb86f41bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:22.733462 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ffd6a-5cc7-4fcd-ab24-feeeb86f41bd admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:22.733741 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ffd6a-5cc7-4fcd-ab24-feeeb86f41bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:22.734012 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ffd6a-5cc7-4fcd-ab24-feeeb86f41bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:22.734765 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ffd6a-5cc7-4fcd-ab24-feeeb86f41bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:22.736335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ffd6a-5cc7-4fcd-ab24-feeeb86f41bd admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:22.746606 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1388/2760] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:13:22.750914 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f947d-f02b-42e0-a5a0-631ee0653268 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:22.761127 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f947d-f02b-42e0-a5a0-631ee0653268 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:22.765955 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26096c61-ea8c-4809-8966-8ee5d4c3299c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:22.766819 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26096c61-ea8c-4809-8966-8ee5d4c3299c admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:22.767261 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26096c61-ea8c-4809-8966-8ee5d4c3299c admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:22.767554 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26096c61-ea8c-4809-8966-8ee5d4c3299c admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:22.768294 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26096c61-ea8c-4809-8966-8ee5d4c3299c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:22.769831 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26096c61-ea8c-4809-8966-8ee5d4c3299c admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:22.785278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1373/2761] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:13:22.787420 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ffd6a-5cc7-4fcd-ab24-feeeb86f41bd admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:22.798389 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ffd6a-5cc7-4fcd-ab24-feeeb86f41bd admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:22.803351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e448177-948b-4b48-a6de-21f0fac3949d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:22.804048 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e448177-948b-4b48-a6de-21f0fac3949d admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:22.804326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e448177-948b-4b48-a6de-21f0fac3949d admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:22.804598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e448177-948b-4b48-a6de-21f0fac3949d admin admin] PATH_INFO: `/v3/projects/3d75a711d37b405dbe801b38ff588db8/users/8d9c65ffe42e4070b215c210d5bafda6/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:22.818983 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e448177-948b-4b48-a6de-21f0fac3949d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d75a711d37b405dbe801b38ff588db8, user_id=8d9c65ffe42e4070b215c210d5bafda6, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:22.822275 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e448177-948b-4b48-a6de-21f0fac3949d admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:22.835955 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1389/2762] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:13:22 2022] PUT /identity/v3/projects/3d75a711d37b405dbe801b38ff588db8/users/8d9c65ffe42e4070b215c210d5bafda6/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:13:22.847238 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6e62d-63b7-45bd-a3e3-cf57dd65f8af None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:22.847766 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6e62d-63b7-45bd-a3e3-cf57dd65f8af None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:22.848050 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6e62d-63b7-45bd-a3e3-cf57dd65f8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:22.878449 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-8bf6e62d-63b7-45bd-a3e3-cf57dd65f8af None None] MFA Rules not processed for user `8d9c65ffe42e4070b215c210d5bafda6`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:13:22.879656 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-8bf6e62d-63b7-45bd-a3e3-cf57dd65f8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:22.945243 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1374/2763] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:13:22.956474 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e448177-948b-4b48-a6de-21f0fac3949d admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:22.958130 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-8e448177-948b-4b48-a6de-21f0fac3949d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:23.014580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e448177-948b-4b48-a6de-21f0fac3949d admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:23.018063 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297ce79-120d-4ffe-9e5f-325f40bd6f89 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada4e799ead24839b109377db3c6393b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:23.018733 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297ce79-120d-4ffe-9e5f-325f40bd6f89 service glance] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:23.019012 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297ce79-120d-4ffe-9e5f-325f40bd6f89 service glance] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:23.019283 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297ce79-120d-4ffe-9e5f-325f40bd6f89 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:23.027290 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297ce79-120d-4ffe-9e5f-325f40bd6f89 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:23.028755 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297ce79-120d-4ffe-9e5f-325f40bd6f89 service glance] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:23.038394 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1390/2764] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:13:22 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:13:34.980163 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e52779-dc21-4388-8869-b4b4075eb3e2 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:34.981097 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e52779-dc21-4388-8869-b4b4075eb3e2 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:34.981097 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e52779-dc21-4388-8869-b4b4075eb3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:35.014535 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-c1e52779-dc21-4388-8869-b4b4075eb3e2 None None] MFA Rules not processed for user `3069e17bfc5d4e34ab7f5c61f48d9f11`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:13:35.015747 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-c1e52779-dc21-4388-8869-b4b4075eb3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:35.085728 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1375/2765] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:13:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:13:35.392325 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297ce79-120d-4ffe-9e5f-325f40bd6f89 service glance] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:35.393778 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-8297ce79-120d-4ffe-9e5f-325f40bd6f89 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:35.492224 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297ce79-120d-4ffe-9e5f-325f40bd6f89 service glance] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:35.495826 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f38d4d-29df-4baa-8ea4-133047e0ae0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:35.496470 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f38d4d-29df-4baa-8ea4-133047e0ae0b service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:35.496757 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f38d4d-29df-4baa-8ea4-133047e0ae0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:35.497036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f38d4d-29df-4baa-8ea4-133047e0ae0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:35.499064 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f8f38d4d-29df-4baa-8ea4-133047e0ae0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:35.508255 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f38d4d-29df-4baa-8ea4-133047e0ae0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:35.509669 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f38d4d-29df-4baa-8ea4-133047e0ae0b service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:35.518073 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1391/2766] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:13:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:13:35.833174 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e52779-dc21-4388-8869-b4b4075eb3e2 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:35.835617 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-c1e52779-dc21-4388-8869-b4b4075eb3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:35.915351 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e52779-dc21-4388-8869-b4b4075eb3e2 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:35.920462 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33514a73-8dc0-47d5-a258-76c0f52fef78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4859a69a988a4b10b67187553d829b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:35.921109 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33514a73-8dc0-47d5-a258-76c0f52fef78 service placement] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:35.921391 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33514a73-8dc0-47d5-a258-76c0f52fef78 service placement] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:35.921667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33514a73-8dc0-47d5-a258-76c0f52fef78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:35.923420 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-33514a73-8dc0-47d5-a258-76c0f52fef78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:35.935179 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33514a73-8dc0-47d5-a258-76c0f52fef78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:35.936791 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33514a73-8dc0-47d5-a258-76c0f52fef78 service placement] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:35.946527 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1376/2767] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:13:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:13:44.632039 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f38d4d-29df-4baa-8ea4-133047e0ae0b service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:44.633540 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f8f38d4d-29df-4baa-8ea4-133047e0ae0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:44.707713 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f38d4d-29df-4baa-8ea4-133047e0ae0b service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:44.713086 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986ab9c-04f3-4ca6-a903-325ac9bdfd35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:44.713766 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986ab9c-04f3-4ca6-a903-325ac9bdfd35 service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:44.714059 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986ab9c-04f3-4ca6-a903-325ac9bdfd35 service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:44.714355 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986ab9c-04f3-4ca6-a903-325ac9bdfd35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:44.716784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c986ab9c-04f3-4ca6-a903-325ac9bdfd35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:44.728607 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986ab9c-04f3-4ca6-a903-325ac9bdfd35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:44.730171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986ab9c-04f3-4ca6-a903-325ac9bdfd35 service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:44.740881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1392/2768] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:13:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:13:49.148791 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068a674-b031-438c-8360-9174cf81ada7 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:49.149347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068a674-b031-438c-8360-9174cf81ada7 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:49.149347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068a674-b031-438c-8360-9174cf81ada7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:49.168083 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-b068a674-b031-438c-8360-9174cf81ada7 None None] MFA Rules not processed for user `da9685af6f6f47c8a59fb93df9bd0ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:13:49.169845 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-b068a674-b031-438c-8360-9174cf81ada7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:49.229167 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1377/2769] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:13:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:14:06.390210 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986ab9c-04f3-4ca6-a903-325ac9bdfd35 service nova] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:14:06.469008 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986ab9c-04f3-4ca6-a903-325ac9bdfd35 service nova] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:14:06.473580 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba9887-a32b-4ef0-b3fb-166515f904d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:14:06.474470 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba9887-a32b-4ef0-b3fb-166515f904d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:14:06.474756 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba9887-a32b-4ef0-b3fb-166515f904d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:14:06.475035 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba9887-a32b-4ef0-b3fb-166515f904d8 admin admin] PATH_INFO: `/v3/users/8d9c65ffe42e4070b215c210d5bafda6` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:14:06.476220 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba9887-a32b-4ef0-b3fb-166515f904d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d9c65ffe42e4070b215c210d5bafda6)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:14:06.478123 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba9887-a32b-4ef0-b3fb-166515f904d8 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:14:06.523533 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-15ba9887-a32b-4ef0-b3fb-166515f904d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d9c65ffe42e4070b215c210d5bafda6'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:14:06.524231 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-15ba9887-a32b-4ef0-b3fb-166515f904d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d9c65ffe42e4070b215c210d5bafda6'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:14:06.536295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-15ba9887-a32b-4ef0-b3fb-166515f904d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d9c65ffe42e4070b215c210d5bafda6'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:14:06.547061 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-15ba9887-a32b-4ef0-b3fb-166515f904d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d9c65ffe42e4070b215c210d5bafda6'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:14:06.553717 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-15ba9887-a32b-4ef0-b3fb-166515f904d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d9c65ffe42e4070b215c210d5bafda6'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:14:06.559876 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1393/2770] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:14:06 2022] DELETE /identity/v3/users/8d9c65ffe42e4070b215c210d5bafda6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:14:06.564591 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fef81d-0038-4ba5-b50d-c13897a64d41 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:14:06.565098 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fef81d-0038-4ba5-b50d-c13897a64d41 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:14:06.565210 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fef81d-0038-4ba5-b50d-c13897a64d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:14:06.610999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-d7fef81d-0038-4ba5-b50d-c13897a64d41 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:14:06.612072 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-d7fef81d-0038-4ba5-b50d-c13897a64d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:14:06.674843 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1378/2771] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:14:06.685298 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba9887-a32b-4ef0-b3fb-166515f904d8 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:14:06.686728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-15ba9887-a32b-4ef0-b3fb-166515f904d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:14:06.743523 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba9887-a32b-4ef0-b3fb-166515f904d8 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:14:06.747463 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20d486-7ed0-4a44-ac06-b1b1ba140a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:14:06.748909 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20d486-7ed0-4a44-ac06-b1b1ba140a56 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:14:06.749244 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20d486-7ed0-4a44-ac06-b1b1ba140a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:14:06.749517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20d486-7ed0-4a44-ac06-b1b1ba140a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:14:06.758701 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20d486-7ed0-4a44-ac06-b1b1ba140a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:14:06.760127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20d486-7ed0-4a44-ac06-b1b1ba140a56 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:14:06.769853 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1394/2772] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:14:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:14:07.309926 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fef81d-0038-4ba5-b50d-c13897a64d41 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:14:07.312695 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-d7fef81d-0038-4ba5-b50d-c13897a64d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:14:07.324536 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fef81d-0038-4ba5-b50d-c13897a64d41 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:14:07.331346 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a506b-730a-4a7f-9b8f-ceecb6e55a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:14:07.332218 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a506b-730a-4a7f-9b8f-ceecb6e55a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:14:07.332499 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a506b-730a-4a7f-9b8f-ceecb6e55a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:14:07.332776 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a506b-730a-4a7f-9b8f-ceecb6e55a08 admin admin] PATH_INFO: `/v3/projects/3d75a711d37b405dbe801b38ff588db8` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:14:07.334048 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a506b-730a-4a7f-9b8f-ceecb6e55a08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d75a711d37b405dbe801b38ff588db8)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:14:07.335999 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a506b-730a-4a7f-9b8f-ceecb6e55a08 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:14:07.385278 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-218a506b-730a-4a7f-9b8f-ceecb6e55a08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d75a711d37b405dbe801b38ff588db8', 'request_id': 'req-218a506b-730a-4a7f-9b8f-ceecb6e55a08'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:14:07.391832 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-218a506b-730a-4a7f-9b8f-ceecb6e55a08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d75a711d37b405dbe801b38ff588db8', 'request_id': 'req-218a506b-730a-4a7f-9b8f-ceecb6e55a08'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:14:07.397877 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-218a506b-730a-4a7f-9b8f-ceecb6e55a08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d75a711d37b405dbe801b38ff588db8', 'request_id': 'req-218a506b-730a-4a7f-9b8f-ceecb6e55a08'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:14:07.410135 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-218a506b-730a-4a7f-9b8f-ceecb6e55a08 admin admin] The token cache is being invalidate because project 3d75a711d37b405dbe801b38ff588db8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:14:07.410463 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-218a506b-730a-4a7f-9b8f-ceecb6e55a08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:14:07.411082 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-218a506b-730a-4a7f-9b8f-ceecb6e55a08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:14:07.412620 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1379/2773] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:14:07 2022] DELETE /identity/v3/projects/3d75a711d37b405dbe801b38ff588db8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:14:11.571616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20d486-7ed0-4a44-ac06-b1b1ba140a56 service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:14:11.580736 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20d486-7ed0-4a44-ac06-b1b1ba140a56 service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:14:11.631517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db374e-b00f-41aa-8e5d-066676d571d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:14:11.632172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db374e-b00f-41aa-8e5d-066676d571d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:14:11.632449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db374e-b00f-41aa-8e5d-066676d571d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:14:11.632721 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db374e-b00f-41aa-8e5d-066676d571d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:14:11.634524 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-e3db374e-b00f-41aa-8e5d-066676d571d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:14:11.693266 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db374e-b00f-41aa-8e5d-066676d571d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:14:11.694710 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db374e-b00f-41aa-8e5d-066676d571d1 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:14:11.704359 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1395/2774] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:14:11 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:15:00.018287 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a506b-730a-4a7f-9b8f-ceecb6e55a08 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:15:00.019695 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-218a506b-730a-4a7f-9b8f-ceecb6e55a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:15:00.118645 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a506b-730a-4a7f-9b8f-ceecb6e55a08 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:15:00.125127 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32a6c2-fe9f-4455-a5f3-aa0e2bf15b95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:15:00.125776 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32a6c2-fe9f-4455-a5f3-aa0e2bf15b95 service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:15:00.126062 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32a6c2-fe9f-4455-a5f3-aa0e2bf15b95 service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:15:00.126377 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32a6c2-fe9f-4455-a5f3-aa0e2bf15b95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:15:00.128162 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-ad32a6c2-fe9f-4455-a5f3-aa0e2bf15b95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:15:00.184271 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32a6c2-fe9f-4455-a5f3-aa0e2bf15b95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:15:00.186554 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32a6c2-fe9f-4455-a5f3-aa0e2bf15b95 service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:15:00.195419 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1380/2775] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:15:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:15:18.449974 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d78e1-cc77-491b-8736-71f0160375b4 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:15:18.450474 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d78e1-cc77-491b-8736-71f0160375b4 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:15:18.450589 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d78e1-cc77-491b-8736-71f0160375b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:15:18.481257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-e19d78e1-cc77-491b-8736-71f0160375b4 None None] MFA Rules not processed for user `686c869be43c40a9b63b3647bf689c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:15:18.482476 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-e19d78e1-cc77-491b-8736-71f0160375b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:15:18.538010 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1396/2776] 10.222.0.32 () {58 vars in 1009 bytes} [Tue May 10 14:15:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:15:18.585576 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32a6c2-fe9f-4455-a5f3-aa0e2bf15b95 service nova] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:15:18.587016 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-ad32a6c2-fe9f-4455-a5f3-aa0e2bf15b95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:15:18.658329 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32a6c2-fe9f-4455-a5f3-aa0e2bf15b95 service nova] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:15:18.663295 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef6abb-02d3-4c36-a3e1-0bba1bf3f4fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bbad5318b6417087d7ce6906f8281f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:15:18.663941 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef6abb-02d3-4c36-a3e1-0bba1bf3f4fd service swift] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:15:18.664235 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef6abb-02d3-4c36-a3e1-0bba1bf3f4fd service swift] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:15:18.664493 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef6abb-02d3-4c36-a3e1-0bba1bf3f4fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:15:18.674160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef6abb-02d3-4c36-a3e1-0bba1bf3f4fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:15:18.675775 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef6abb-02d3-4c36-a3e1-0bba1bf3f4fd service swift] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:15:18.684134 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1381/2777] 10.222.0.32 () {60 vars in 1384 bytes} [Tue May 10 14:15:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:15:30.183587 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d78e1-cc77-491b-8736-71f0160375b4 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:15:30.185240 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-e19d78e1-cc77-491b-8736-71f0160375b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:15:30.274868 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d78e1-cc77-491b-8736-71f0160375b4 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:15:30.280471 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b374b3f-6760-4934-b451-59c7306330e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4859a69a988a4b10b67187553d829b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:15:30.281122 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b374b3f-6760-4934-b451-59c7306330e8 service placement] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:15:30.281405 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b374b3f-6760-4934-b451-59c7306330e8 service placement] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:15:30.281683 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b374b3f-6760-4934-b451-59c7306330e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:15:30.283412 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-6b374b3f-6760-4934-b451-59c7306330e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:15:30.294829 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b374b3f-6760-4934-b451-59c7306330e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:15:30.296409 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b374b3f-6760-4934-b451-59c7306330e8 service placement] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:15:30.306354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1397/2778] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:15:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:15:32.051629 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02345bc6-41f9-440e-b4ab-f14136aac08b None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:15:32.052245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02345bc6-41f9-440e-b4ab-f14136aac08b None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:15:32.052245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02345bc6-41f9-440e-b4ab-f14136aac08b None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:15:32.053520 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1382/2779] 10.222.0.32 () {54 vars in 921 bytes} [Tue May 10 14:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:15:32.059939 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c759d5-f981-4826-8343-871b50b17bf9 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:15:32.060485 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c759d5-f981-4826-8343-871b50b17bf9 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:15:32.060833 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c759d5-f981-4826-8343-871b50b17bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:15:32.089595 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-d1c759d5-f981-4826-8343-871b50b17bf9 None None] MFA Rules not processed for user `e5d4fd26c21f4170a6790369344f8334`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:15:32.090960 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-d1c759d5-f981-4826-8343-871b50b17bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:15:32.101540 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1398/2780] 10.222.0.32 () {58 vars in 1018 bytes} [Tue May 10 14:15:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:15:32.114700 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02345bc6-41f9-440e-b4ab-f14136aac08b None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:15:32.116508 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-02345bc6-41f9-440e-b4ab-f14136aac08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:15:32.181063 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02345bc6-41f9-440e-b4ab-f14136aac08b None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:15:32.184607 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c10b68-13a2-4c12-a456-a65cc2770d2c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada4e799ead24839b109377db3c6393b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:15:32.185252 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c10b68-13a2-4c12-a456-a65cc2770d2c service glance] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:15:32.185797 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c10b68-13a2-4c12-a456-a65cc2770d2c service glance] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:15:32.185910 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c10b68-13a2-4c12-a456-a65cc2770d2c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:15:32.196072 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c10b68-13a2-4c12-a456-a65cc2770d2c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:15:32.197486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c10b68-13a2-4c12-a456-a65cc2770d2c service glance] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:15:32.207854 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1383/2781] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:15:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:15:32.275383 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78138f5-7945-4e52-8c7c-c1869f764dc2 None None] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:15:32.275670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78138f5-7945-4e52-8c7c-c1869f764dc2 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:15:32.275947 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78138f5-7945-4e52-8c7c-c1869f764dc2 None None] PATH_INFO: `/` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:15:32.277343 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1399/2782] 10.222.0.32 () {54 vars in 921 bytes} [Tue May 10 14:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:15:32.282699 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3fc80-0392-45d1-9014-39bd15bee524 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:15:32.282982 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3fc80-0392-45d1-9014-39bd15bee524 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:15:32.283252 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3fc80-0392-45d1-9014-39bd15bee524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:15:32.322874 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-60d3fc80-0392-45d1-9014-39bd15bee524 None None] MFA Rules not processed for user `12eb1c001b5e44d8b5b5bc658ed464f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:15:32.324100 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-60d3fc80-0392-45d1-9014-39bd15bee524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:15:32.332971 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1384/2783] 10.222.0.32 () {58 vars in 1018 bytes} [Tue May 10 14:15:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:15:32.345228 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78138f5-7945-4e52-8c7c-c1869f764dc2 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:15:32.346949 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c78138f5-7945-4e52-8c7c-c1869f764dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:15:32.363521 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78138f5-7945-4e52-8c7c-c1869f764dc2 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:15:32.367092 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba8d86-0dff-4eea-8f27-0dc08bc0b77b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:15:32.367741 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba8d86-0dff-4eea-8f27-0dc08bc0b77b service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:15:32.368026 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba8d86-0dff-4eea-8f27-0dc08bc0b77b service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:15:32.368303 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba8d86-0dff-4eea-8f27-0dc08bc0b77b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:15:32.376049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba8d86-0dff-4eea-8f27-0dc08bc0b77b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:15:32.377482 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba8d86-0dff-4eea-8f27-0dc08bc0b77b service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:15:32.385751 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1400/2784] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:15:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:15:32.472530 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656abbe-e2b7-4232-8452-b41bedb3579e None None] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:15:32.472874 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656abbe-e2b7-4232-8452-b41bedb3579e None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:15:32.473178 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656abbe-e2b7-4232-8452-b41bedb3579e None None] PATH_INFO: `/` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:15:32.474942 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1385/2785] 10.222.0.32 () {54 vars in 921 bytes} [Tue May 10 14:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:15:32.480571 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853bd8f-dc4d-468c-aa11-721297d3daeb None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:15:32.480863 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853bd8f-dc4d-468c-aa11-721297d3daeb None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:15:32.481146 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853bd8f-dc4d-468c-aa11-721297d3daeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:15:32.500588 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-9853bd8f-dc4d-468c-aa11-721297d3daeb None None] MFA Rules not processed for user `e5d4fd26c21f4170a6790369344f8334`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:15:32.501799 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-9853bd8f-dc4d-468c-aa11-721297d3daeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:15:32.511172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1401/2786] 10.222.0.32 () {58 vars in 1018 bytes} [Tue May 10 14:15:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:15:32.522493 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656abbe-e2b7-4232-8452-b41bedb3579e None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:15:32.534065 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656abbe-e2b7-4232-8452-b41bedb3579e None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:15:32.537700 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9db974-f554-40d2-87d2-37eba142d404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:15:32.538390 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9db974-f554-40d2-87d2-37eba142d404 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:15:32.538671 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9db974-f554-40d2-87d2-37eba142d404 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:15:32.538945 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9db974-f554-40d2-87d2-37eba142d404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:15:32.549901 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9db974-f554-40d2-87d2-37eba142d404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:15:32.551372 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9db974-f554-40d2-87d2-37eba142d404 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:15:32.562240 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1386/2787] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:15:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:15:34.225796 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4818e-cae4-4f44-a95d-e23f99de3770 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:15:34.226337 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4818e-cae4-4f44-a95d-e23f99de3770 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:15:34.226848 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4818e-cae4-4f44-a95d-e23f99de3770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:15:34.246778 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-eda4818e-cae4-4f44-a95d-e23f99de3770 None None] MFA Rules not processed for user `686c869be43c40a9b63b3647bf689c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:15:34.248009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-eda4818e-cae4-4f44-a95d-e23f99de3770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:15:34.255751 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1402/2788] 10.222.0.32 () {58 vars in 1009 bytes} [Tue May 10 14:15:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:15:34.267940 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9db974-f554-40d2-87d2-37eba142d404 service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:15:34.280576 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9db974-f554-40d2-87d2-37eba142d404 service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:15:34.285621 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f6b8a-1ffc-41dd-bd62-f647cd3eab19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bbad5318b6417087d7ce6906f8281f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:15:34.286298 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f6b8a-1ffc-41dd-bd62-f647cd3eab19 service swift] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:15:34.286586 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f6b8a-1ffc-41dd-bd62-f647cd3eab19 service swift] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:15:34.286859 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f6b8a-1ffc-41dd-bd62-f647cd3eab19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:15:34.295827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f6b8a-1ffc-41dd-bd62-f647cd3eab19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:15:34.297405 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f6b8a-1ffc-41dd-bd62-f647cd3eab19 service swift] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:15:34.305513 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1387/2789] 10.222.0.32 () {60 vars in 1384 bytes} [Tue May 10 14:15:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:15:51.173868 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5c85f-0481-47c5-9fdc-b1b0e1ac5ea9 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:15:51.174478 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5c85f-0481-47c5-9fdc-b1b0e1ac5ea9 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:15:51.174478 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5c85f-0481-47c5-9fdc-b1b0e1ac5ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:15:51.193219 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-20f5c85f-0481-47c5-9fdc-b1b0e1ac5ea9 None None] MFA Rules not processed for user `686c869be43c40a9b63b3647bf689c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:15:51.194644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-20f5c85f-0481-47c5-9fdc-b1b0e1ac5ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:15:51.203217 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1403/2790] 10.222.0.32 () {58 vars in 967 bytes} [Tue May 10 14:15:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:15:51.215609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f6b8a-1ffc-41dd-bd62-f647cd3eab19 service swift] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:15:51.226658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f6b8a-1ffc-41dd-bd62-f647cd3eab19 service swift] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:15:51.231982 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7b057-b5d6-426c-82e3-6b05515b9f85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bbad5318b6417087d7ce6906f8281f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:15:51.232880 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7b057-b5d6-426c-82e3-6b05515b9f85 service swift] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:15:51.233691 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7b057-b5d6-426c-82e3-6b05515b9f85 service swift] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:15:51.233974 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7b057-b5d6-426c-82e3-6b05515b9f85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:15:51.242599 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7b057-b5d6-426c-82e3-6b05515b9f85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:15:51.244180 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7b057-b5d6-426c-82e3-6b05515b9f85 service swift] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:15:51.253216 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1388/2791] 10.222.0.32 () {60 vars in 1384 bytes} [Tue May 10 14:15:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:16:31.677028 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42246eab-aae0-4db8-a65b-2c27f90e1c80 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:16:31.677533 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42246eab-aae0-4db8-a65b-2c27f90e1c80 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:16:31.677637 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42246eab-aae0-4db8-a65b-2c27f90e1c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:16:31.695942 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-42246eab-aae0-4db8-a65b-2c27f90e1c80 None None] MFA Rules not processed for user `da9685af6f6f47c8a59fb93df9bd0ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:16:31.697155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-42246eab-aae0-4db8-a65b-2c27f90e1c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:16:31.757247 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1404/2792] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:16:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:16:39.487139 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7b057-b5d6-426c-82e3-6b05515b9f85 service swift] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:16:39.496387 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7b057-b5d6-426c-82e3-6b05515b9f85 service swift] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:16:39.500185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee8edf-99c0-4cf2-8825-ea969b517f73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:16:39.501339 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee8edf-99c0-4cf2-8825-ea969b517f73 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:16:39.501616 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee8edf-99c0-4cf2-8825-ea969b517f73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:16:39.501875 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee8edf-99c0-4cf2-8825-ea969b517f73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:16:39.503664 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-1aee8edf-99c0-4cf2-8825-ea969b517f73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:16:39.517665 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee8edf-99c0-4cf2-8825-ea969b517f73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:16:39.519105 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee8edf-99c0-4cf2-8825-ea969b517f73 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:16:39.530096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1389/2793] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:16:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:16:45.421829 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42246eab-aae0-4db8-a65b-2c27f90e1c80 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:16:45.423272 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-42246eab-aae0-4db8-a65b-2c27f90e1c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:16:45.437618 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42246eab-aae0-4db8-a65b-2c27f90e1c80 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:16:45.443541 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf814f7d-28bf-4bf2-999a-4eb7c7014cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:16:45.444220 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf814f7d-28bf-4bf2-999a-4eb7c7014cdd service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:16:45.444503 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf814f7d-28bf-4bf2-999a-4eb7c7014cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:16:45.444779 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf814f7d-28bf-4bf2-999a-4eb7c7014cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:16:45.446659 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-cf814f7d-28bf-4bf2-999a-4eb7c7014cdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:16:45.461338 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf814f7d-28bf-4bf2-999a-4eb7c7014cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:16:45.462825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf814f7d-28bf-4bf2-999a-4eb7c7014cdd service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:16:45.477740 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1405/2794] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:16:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:16:56.373239 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee8edf-99c0-4cf2-8825-ea969b517f73 service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:16:56.383594 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee8edf-99c0-4cf2-8825-ea969b517f73 service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:16:56.387437 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392cc147-cdff-4794-bf16-cdaf3990afb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:16:56.388379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cc147-cdff-4794-bf16-cdaf3990afb8 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:16:56.388667 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cc147-cdff-4794-bf16-cdaf3990afb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:16:56.388942 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cc147-cdff-4794-bf16-cdaf3990afb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:16:56.390866 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-392cc147-cdff-4794-bf16-cdaf3990afb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:16:56.460116 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392cc147-cdff-4794-bf16-cdaf3990afb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:16:56.461470 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392cc147-cdff-4794-bf16-cdaf3990afb8 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:16:56.472138 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1390/2795] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:17:00.174277 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf814f7d-28bf-4bf2-999a-4eb7c7014cdd service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:00.176000 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-cf814f7d-28bf-4bf2-999a-4eb7c7014cdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:00.192808 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf814f7d-28bf-4bf2-999a-4eb7c7014cdd service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:00.197854 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019cb8c6-880b-42ca-b2e2-d553a3eb1151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:00.198793 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cb8c6-880b-42ca-b2e2-d553a3eb1151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:00.199075 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cb8c6-880b-42ca-b2e2-d553a3eb1151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:00.199495 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cb8c6-880b-42ca-b2e2-d553a3eb1151 admin admin] PATH_INFO: `/v3/users/3069e17bfc5d4e34ab7f5c61f48d9f11` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:00.200748 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cb8c6-880b-42ca-b2e2-d553a3eb1151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3069e17bfc5d4e34ab7f5c61f48d9f11)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:00.202728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cb8c6-880b-42ca-b2e2-d553a3eb1151 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:00.256996 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-019cb8c6-880b-42ca-b2e2-d553a3eb1151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3069e17bfc5d4e34ab7f5c61f48d9f11'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:00.257689 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-019cb8c6-880b-42ca-b2e2-d553a3eb1151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3069e17bfc5d4e34ab7f5c61f48d9f11'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:00.272586 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-019cb8c6-880b-42ca-b2e2-d553a3eb1151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3069e17bfc5d4e34ab7f5c61f48d9f11'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:00.280418 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-019cb8c6-880b-42ca-b2e2-d553a3eb1151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3069e17bfc5d4e34ab7f5c61f48d9f11'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:00.289172 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-019cb8c6-880b-42ca-b2e2-d553a3eb1151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3069e17bfc5d4e34ab7f5c61f48d9f11'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:00.295564 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1406/2796] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:17:00 2022] DELETE /identity/v3/users/3069e17bfc5d4e34ab7f5c61f48d9f11 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:17:00.488398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392cc147-cdff-4794-bf16-cdaf3990afb8 service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:00.498600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392cc147-cdff-4794-bf16-cdaf3990afb8 service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:00.560674 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67e180-0721-464b-9d81-819e12ae7126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:00.561569 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67e180-0721-464b-9d81-819e12ae7126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:00.561877 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67e180-0721-464b-9d81-819e12ae7126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:00.562160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67e180-0721-464b-9d81-819e12ae7126 admin admin] PATH_INFO: `/v3/projects/c251b9c401c6455da95be74c9119b8d2` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:00.563481 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67e180-0721-464b-9d81-819e12ae7126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c251b9c401c6455da95be74c9119b8d2)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:00.565516 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67e180-0721-464b-9d81-819e12ae7126 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:00.615517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-8e67e180-0721-464b-9d81-819e12ae7126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c251b9c401c6455da95be74c9119b8d2', 'request_id': 'req-8e67e180-0721-464b-9d81-819e12ae7126'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:00.620942 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-8e67e180-0721-464b-9d81-819e12ae7126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c251b9c401c6455da95be74c9119b8d2', 'request_id': 'req-8e67e180-0721-464b-9d81-819e12ae7126'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:00.627926 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-8e67e180-0721-464b-9d81-819e12ae7126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c251b9c401c6455da95be74c9119b8d2', 'request_id': 'req-8e67e180-0721-464b-9d81-819e12ae7126'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:00.640867 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-8e67e180-0721-464b-9d81-819e12ae7126 admin admin] The token cache is being invalidate because project c251b9c401c6455da95be74c9119b8d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:17:00.641156 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-8e67e180-0721-464b-9d81-819e12ae7126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:00.642025 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-8e67e180-0721-464b-9d81-819e12ae7126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:00.643814 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1391/2797] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:17:00 2022] DELETE /identity/v3/projects/c251b9c401c6455da95be74c9119b8d2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:17:00.650338 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1f235-7c72-49e8-99fa-1f6443197872 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:00.650666 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1f235-7c72-49e8-99fa-1f6443197872 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:00.651009 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1f235-7c72-49e8-99fa-1f6443197872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:00.693759 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-83a1f235-7c72-49e8-99fa-1f6443197872 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:17:00.694920 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-83a1f235-7c72-49e8-99fa-1f6443197872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:00.758845 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1407/2798] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:17:00.768024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23755f6c-e2dc-4f49-9c6d-8fb1c2003026 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:00.768291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23755f6c-e2dc-4f49-9c6d-8fb1c2003026 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:00.768537 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23755f6c-e2dc-4f49-9c6d-8fb1c2003026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:00.789034 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-23755f6c-e2dc-4f49-9c6d-8fb1c2003026 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:17:00.790366 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-23755f6c-e2dc-4f49-9c6d-8fb1c2003026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:00.799272 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1392/2799] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:17:00.803688 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1f235-7c72-49e8-99fa-1f6443197872 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:00.814062 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1f235-7c72-49e8-99fa-1f6443197872 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:00.819050 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc51695-d46b-4150-829e-31fd8703db86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:00.819731 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc51695-d46b-4150-829e-31fd8703db86 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:00.820016 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc51695-d46b-4150-829e-31fd8703db86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:00.820286 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc51695-d46b-4150-829e-31fd8703db86 admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:00.821025 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc51695-d46b-4150-829e-31fd8703db86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:17:00.821400 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc51695-d46b-4150-829e-31fd8703db86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:00.823049 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc51695-d46b-4150-829e-31fd8703db86 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:00.837354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1408/2800] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:17:00.841474 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23755f6c-e2dc-4f49-9c6d-8fb1c2003026 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:00.857387 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23755f6c-e2dc-4f49-9c6d-8fb1c2003026 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:00.863243 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd3249-61a8-4c71-a581-4fa23989aa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:00.863928 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd3249-61a8-4c71-a581-4fa23989aa93 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:00.864214 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd3249-61a8-4c71-a581-4fa23989aa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:00.864489 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd3249-61a8-4c71-a581-4fa23989aa93 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:00.865193 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd3249-61a8-4c71-a581-4fa23989aa93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:00.867145 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd3249-61a8-4c71-a581-4fa23989aa93 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:00.896183 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1393/2801] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:17:00 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:17:00.900412 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc51695-d46b-4150-829e-31fd8703db86 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:00.911874 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc51695-d46b-4150-829e-31fd8703db86 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:00.983291 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917151e-0b4b-464f-a7a5-067a6cce6b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:00.983911 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917151e-0b4b-464f-a7a5-067a6cce6b12 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:00.984195 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917151e-0b4b-464f-a7a5-067a6cce6b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:00.984469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917151e-0b4b-464f-a7a5-067a6cce6b12 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:00.985188 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917151e-0b4b-464f-a7a5-067a6cce6b12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:00.987532 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917151e-0b4b-464f-a7a5-067a6cce6b12 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:01.011866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1409/2802] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:17:00 2022] POST /identity/v3/users => generated 285 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:17:01.016058 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd3249-61a8-4c71-a581-4fa23989aa93 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:01.028126 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd3249-61a8-4c71-a581-4fa23989aa93 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:01.034764 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafe1e4-a26b-4aad-9e88-e1b0317a354f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:01.035493 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafe1e4-a26b-4aad-9e88-e1b0317a354f admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:01.035777 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafe1e4-a26b-4aad-9e88-e1b0317a354f admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:01.036050 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafe1e4-a26b-4aad-9e88-e1b0317a354f admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:01.036793 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafe1e4-a26b-4aad-9e88-e1b0317a354f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:01.038474 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafe1e4-a26b-4aad-9e88-e1b0317a354f admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:01.050066 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1394/2803] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:17:01.054477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917151e-0b4b-464f-a7a5-067a6cce6b12 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:01.067290 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917151e-0b4b-464f-a7a5-067a6cce6b12 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:01.072462 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de39c6-cf35-49b3-b89e-cc800cc34034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:01.073171 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de39c6-cf35-49b3-b89e-cc800cc34034 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:01.073456 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de39c6-cf35-49b3-b89e-cc800cc34034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:01.073736 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de39c6-cf35-49b3-b89e-cc800cc34034 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:01.074562 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de39c6-cf35-49b3-b89e-cc800cc34034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:01.076249 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de39c6-cf35-49b3-b89e-cc800cc34034 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:01.088297 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1410/2804] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:17:01.092658 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafe1e4-a26b-4aad-9e88-e1b0317a354f admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:01.104471 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafe1e4-a26b-4aad-9e88-e1b0317a354f admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:01.110424 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b641c91-c79b-4b01-a41a-3e17aa8e5946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:01.111719 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b641c91-c79b-4b01-a41a-3e17aa8e5946 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:01.112006 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b641c91-c79b-4b01-a41a-3e17aa8e5946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:01.112287 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b641c91-c79b-4b01-a41a-3e17aa8e5946 admin admin] PATH_INFO: `/v3/projects/d22cb034d8c4486caa3e53944fc3fbaf/users/30a6eaed7cd441f0a6989c16f67976ce/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:01.132644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b641c91-c79b-4b01-a41a-3e17aa8e5946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d22cb034d8c4486caa3e53944fc3fbaf, user_id=30a6eaed7cd441f0a6989c16f67976ce, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:01.135426 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b641c91-c79b-4b01-a41a-3e17aa8e5946 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:01.151703 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1395/2805] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:17:01 2022] PUT /identity/v3/projects/d22cb034d8c4486caa3e53944fc3fbaf/users/30a6eaed7cd441f0a6989c16f67976ce/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:17:01.163928 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff089c-b6c9-4085-9a01-60d2ba46ddcc None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:01.164199 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff089c-b6c9-4085-9a01-60d2ba46ddcc None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:01.164519 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff089c-b6c9-4085-9a01-60d2ba46ddcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:01.205613 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-5bff089c-b6c9-4085-9a01-60d2ba46ddcc None None] MFA Rules not processed for user `30a6eaed7cd441f0a6989c16f67976ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:17:01.207040 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-5bff089c-b6c9-4085-9a01-60d2ba46ddcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:01.284109 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1411/2806] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:17:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:17:01.289801 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b641c91-c79b-4b01-a41a-3e17aa8e5946 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:01.400508 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b641c91-c79b-4b01-a41a-3e17aa8e5946 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:01.407879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b7141-ea92-4e6f-b30e-f03f04bc6b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:01.409200 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b7141-ea92-4e6f-b30e-f03f04bc6b12 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:01.409660 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b7141-ea92-4e6f-b30e-f03f04bc6b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:01.410119 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b7141-ea92-4e6f-b30e-f03f04bc6b12 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:01.411311 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b7141-ea92-4e6f-b30e-f03f04bc6b12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:01.415031 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b7141-ea92-4e6f-b30e-f03f04bc6b12 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:01.453939 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1396/2807] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:17:01 2022] POST /identity/v3/projects => generated 369 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:17:01.459151 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff089c-b6c9-4085-9a01-60d2ba46ddcc None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:01.472205 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff089c-b6c9-4085-9a01-60d2ba46ddcc None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:01.537158 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830534ea-bd0c-483e-ad60-002d44d34f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:01.537750 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830534ea-bd0c-483e-ad60-002d44d34f83 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:01.538036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830534ea-bd0c-483e-ad60-002d44d34f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:01.538478 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830534ea-bd0c-483e-ad60-002d44d34f83 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:01.539199 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830534ea-bd0c-483e-ad60-002d44d34f83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:01.541136 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830534ea-bd0c-483e-ad60-002d44d34f83 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:01.563050 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1412/2808] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:17:01 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:17:01.567776 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b7141-ea92-4e6f-b30e-f03f04bc6b12 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:01.580710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b7141-ea92-4e6f-b30e-f03f04bc6b12 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:01.585470 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dfb5d-7f76-4e03-a064-fc9fe8d837e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:01.586151 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dfb5d-7f76-4e03-a064-fc9fe8d837e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:01.586463 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dfb5d-7f76-4e03-a064-fc9fe8d837e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:01.586735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dfb5d-7f76-4e03-a064-fc9fe8d837e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:01.587517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854dfb5d-7f76-4e03-a064-fc9fe8d837e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:01.589157 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854dfb5d-7f76-4e03-a064-fc9fe8d837e9 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:01.604850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1397/2809] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:17:01.609844 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830534ea-bd0c-483e-ad60-002d44d34f83 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:01.621450 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830534ea-bd0c-483e-ad60-002d44d34f83 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:01.627286 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405aa02-861b-4c85-9910-4eebf8bd1a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:01.628310 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405aa02-861b-4c85-9910-4eebf8bd1a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:01.628704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405aa02-861b-4c85-9910-4eebf8bd1a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:01.629261 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405aa02-861b-4c85-9910-4eebf8bd1a2c admin admin] PATH_INFO: `/v3/projects/b6770174a3d648c08af894450fbf765f/users/6e7255cd03fb40559924f24dc70046e6/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:01.649664 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405aa02-861b-4c85-9910-4eebf8bd1a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6770174a3d648c08af894450fbf765f, user_id=6e7255cd03fb40559924f24dc70046e6, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:01.652803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405aa02-861b-4c85-9910-4eebf8bd1a2c admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:01.672497 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1413/2810] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:17:01 2022] PUT /identity/v3/projects/b6770174a3d648c08af894450fbf765f/users/6e7255cd03fb40559924f24dc70046e6/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:17:01.677212 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dfb5d-7f76-4e03-a064-fc9fe8d837e9 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:01.687542 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dfb5d-7f76-4e03-a064-fc9fe8d837e9 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:01.754387 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f899e-f064-499a-bace-b6712151299d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:01.755065 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f899e-f064-499a-bace-b6712151299d admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:01.755348 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f899e-f064-499a-bace-b6712151299d admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:01.755618 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f899e-f064-499a-bace-b6712151299d admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:01.756346 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f899e-f064-499a-bace-b6712151299d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:01.758079 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f899e-f064-499a-bace-b6712151299d admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:01.769269 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1398/2811] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:17:01.774231 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405aa02-861b-4c85-9910-4eebf8bd1a2c admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:01.786866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405aa02-861b-4c85-9910-4eebf8bd1a2c admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:01.791742 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11a209-9aa8-45db-a231-3942f0f5b54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:01.792583 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11a209-9aa8-45db-a231-3942f0f5b54b admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:01.792865 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11a209-9aa8-45db-a231-3942f0f5b54b admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:01.793142 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11a209-9aa8-45db-a231-3942f0f5b54b admin admin] PATH_INFO: `/v3/projects/b6770174a3d648c08af894450fbf765f/users/6e7255cd03fb40559924f24dc70046e6/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:01.795253 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11a209-9aa8-45db-a231-3942f0f5b54b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6770174a3d648c08af894450fbf765f, user_id=6e7255cd03fb40559924f24dc70046e6, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:01.797952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11a209-9aa8-45db-a231-3942f0f5b54b admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:01.811404 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1414/2812] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:17:01 2022] PUT /identity/v3/projects/b6770174a3d648c08af894450fbf765f/users/6e7255cd03fb40559924f24dc70046e6/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:17:01.825130 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5618a35-e1b4-45a5-9804-4abe72021c70 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:01.825383 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5618a35-e1b4-45a5-9804-4abe72021c70 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:01.825631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5618a35-e1b4-45a5-9804-4abe72021c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:01.864310 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-f5618a35-e1b4-45a5-9804-4abe72021c70 None None] MFA Rules not processed for user `6e7255cd03fb40559924f24dc70046e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:17:01.866120 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-f5618a35-e1b4-45a5-9804-4abe72021c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:01.949379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1399/2813] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:17:01 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:17:01.960900 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11a209-9aa8-45db-a231-3942f0f5b54b admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:01.962838 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-5f11a209-9aa8-45db-a231-3942f0f5b54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:02.051871 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11a209-9aa8-45db-a231-3942f0f5b54b admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:02.055544 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedac85-4b9b-4626-a281-e4eadf0eeda2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:02.056199 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedac85-4b9b-4626-a281-e4eadf0eeda2 service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:02.056483 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedac85-4b9b-4626-a281-e4eadf0eeda2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:02.056762 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedac85-4b9b-4626-a281-e4eadf0eeda2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:02.067496 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedac85-4b9b-4626-a281-e4eadf0eeda2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:02.069007 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedac85-4b9b-4626-a281-e4eadf0eeda2 service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:02.079398 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1415/2814] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:17:01 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:17:03.606288 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5618a35-e1b4-45a5-9804-4abe72021c70 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:03.692509 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5618a35-e1b4-45a5-9804-4abe72021c70 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:03.697547 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382922b5-49d5-4b97-912a-e5376bc2380d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:03.698675 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382922b5-49d5-4b97-912a-e5376bc2380d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:03.699104 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382922b5-49d5-4b97-912a-e5376bc2380d admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:03.699513 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382922b5-49d5-4b97-912a-e5376bc2380d admin admin] PATH_INFO: `/v3/users/30a6eaed7cd441f0a6989c16f67976ce` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:03.701400 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382922b5-49d5-4b97-912a-e5376bc2380d admin admin] RBAC: Authorizing `identity:delete_user(user_id=30a6eaed7cd441f0a6989c16f67976ce)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:03.703786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382922b5-49d5-4b97-912a-e5376bc2380d admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:03.758619 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-382922b5-49d5-4b97-912a-e5376bc2380d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30a6eaed7cd441f0a6989c16f67976ce'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:03.768424 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-382922b5-49d5-4b97-912a-e5376bc2380d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30a6eaed7cd441f0a6989c16f67976ce'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:03.781095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-382922b5-49d5-4b97-912a-e5376bc2380d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30a6eaed7cd441f0a6989c16f67976ce'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:03.781790 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-382922b5-49d5-4b97-912a-e5376bc2380d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30a6eaed7cd441f0a6989c16f67976ce'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:03.783859 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-382922b5-49d5-4b97-912a-e5376bc2380d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30a6eaed7cd441f0a6989c16f67976ce'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:03.797173 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1400/2815] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:17:03 2022] DELETE /identity/v3/users/30a6eaed7cd441f0a6989c16f67976ce => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:17:03.802943 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c7a5e-8d78-4c27-b9fa-0f53e4726275 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:03.803724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c7a5e-8d78-4c27-b9fa-0f53e4726275 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:03.803724 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c7a5e-8d78-4c27-b9fa-0f53e4726275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:03.825874 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-c08c7a5e-8d78-4c27-b9fa-0f53e4726275 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:17:03.827272 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c08c7a5e-8d78-4c27-b9fa-0f53e4726275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:03.900351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1416/2816] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:17:03.910615 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382922b5-49d5-4b97-912a-e5376bc2380d admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:03.912083 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-382922b5-49d5-4b97-912a-e5376bc2380d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:03.979420 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382922b5-49d5-4b97-912a-e5376bc2380d admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:03.983194 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925e680-ceb6-4c18-9ffb-d866819fcb9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:03.983850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925e680-ceb6-4c18-9ffb-d866819fcb9a service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:03.984129 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925e680-ceb6-4c18-9ffb-d866819fcb9a service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:03.984406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925e680-ceb6-4c18-9ffb-d866819fcb9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:03.994396 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925e680-ceb6-4c18-9ffb-d866819fcb9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:03.995849 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925e680-ceb6-4c18-9ffb-d866819fcb9a service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:04.007757 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1401/2817] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:17:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:17:04.311518 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c7a5e-8d78-4c27-b9fa-0f53e4726275 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:04.313041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-c08c7a5e-8d78-4c27-b9fa-0f53e4726275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:04.327258 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c7a5e-8d78-4c27-b9fa-0f53e4726275 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:04.332988 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33530ed-ddb8-4143-b6fe-350e6f7da047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:04.333955 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33530ed-ddb8-4143-b6fe-350e6f7da047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:04.334353 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33530ed-ddb8-4143-b6fe-350e6f7da047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:04.334730 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33530ed-ddb8-4143-b6fe-350e6f7da047 admin admin] PATH_INFO: `/v3/projects/d22cb034d8c4486caa3e53944fc3fbaf` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:04.336401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33530ed-ddb8-4143-b6fe-350e6f7da047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d22cb034d8c4486caa3e53944fc3fbaf)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:04.338919 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33530ed-ddb8-4143-b6fe-350e6f7da047 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:04.390951 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f33530ed-ddb8-4143-b6fe-350e6f7da047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd22cb034d8c4486caa3e53944fc3fbaf', 'request_id': 'req-f33530ed-ddb8-4143-b6fe-350e6f7da047'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:04.398164 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f33530ed-ddb8-4143-b6fe-350e6f7da047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd22cb034d8c4486caa3e53944fc3fbaf', 'request_id': 'req-f33530ed-ddb8-4143-b6fe-350e6f7da047'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:04.407135 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f33530ed-ddb8-4143-b6fe-350e6f7da047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd22cb034d8c4486caa3e53944fc3fbaf', 'request_id': 'req-f33530ed-ddb8-4143-b6fe-350e6f7da047'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:04.430598 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f33530ed-ddb8-4143-b6fe-350e6f7da047 admin admin] The token cache is being invalidate because project d22cb034d8c4486caa3e53944fc3fbaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:17:04.430889 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f33530ed-ddb8-4143-b6fe-350e6f7da047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:04.431578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f33530ed-ddb8-4143-b6fe-350e6f7da047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:04.433198 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1417/2818] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:17:04 2022] DELETE /identity/v3/projects/d22cb034d8c4486caa3e53944fc3fbaf => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:17:04.437860 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925e680-ceb6-4c18-9ffb-d866819fcb9a service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:04.450896 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925e680-ceb6-4c18-9ffb-d866819fcb9a service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:04.513936 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43050f43-5ea4-4ec8-8bdb-de3003ad8ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:04.514762 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43050f43-5ea4-4ec8-8bdb-de3003ad8ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:04.515047 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43050f43-5ea4-4ec8-8bdb-de3003ad8ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:04.515318 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43050f43-5ea4-4ec8-8bdb-de3003ad8ac9 admin admin] PATH_INFO: `/v3/users/6e7255cd03fb40559924f24dc70046e6` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:04.516598 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43050f43-5ea4-4ec8-8bdb-de3003ad8ac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e7255cd03fb40559924f24dc70046e6)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:04.519055 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43050f43-5ea4-4ec8-8bdb-de3003ad8ac9 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:04.569009 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-43050f43-5ea4-4ec8-8bdb-de3003ad8ac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e7255cd03fb40559924f24dc70046e6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:04.577346 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-43050f43-5ea4-4ec8-8bdb-de3003ad8ac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e7255cd03fb40559924f24dc70046e6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:04.591330 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-43050f43-5ea4-4ec8-8bdb-de3003ad8ac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e7255cd03fb40559924f24dc70046e6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:04.592118 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-43050f43-5ea4-4ec8-8bdb-de3003ad8ac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e7255cd03fb40559924f24dc70046e6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:04.592666 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-43050f43-5ea4-4ec8-8bdb-de3003ad8ac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e7255cd03fb40559924f24dc70046e6'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:04.613906 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1402/2819] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:17:04 2022] DELETE /identity/v3/users/6e7255cd03fb40559924f24dc70046e6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:17:04.932554 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33530ed-ddb8-4143-b6fe-350e6f7da047 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:04.934034 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f33530ed-ddb8-4143-b6fe-350e6f7da047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:04.952241 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33530ed-ddb8-4143-b6fe-350e6f7da047 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:05.024269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732121a-1aa6-4527-a9db-1c03acf1df1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:05.024269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732121a-1aa6-4527-a9db-1c03acf1df1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:05.024269 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732121a-1aa6-4527-a9db-1c03acf1df1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:05.024719 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732121a-1aa6-4527-a9db-1c03acf1df1e admin admin] PATH_INFO: `/v3/projects/b6770174a3d648c08af894450fbf765f` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:05.025711 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732121a-1aa6-4527-a9db-1c03acf1df1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6770174a3d648c08af894450fbf765f)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:05.027661 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732121a-1aa6-4527-a9db-1c03acf1df1e admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:05.078122 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1732121a-1aa6-4527-a9db-1c03acf1df1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6770174a3d648c08af894450fbf765f', 'request_id': 'req-1732121a-1aa6-4527-a9db-1c03acf1df1e'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:05.084904 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1732121a-1aa6-4527-a9db-1c03acf1df1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6770174a3d648c08af894450fbf765f', 'request_id': 'req-1732121a-1aa6-4527-a9db-1c03acf1df1e'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:05.091574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1732121a-1aa6-4527-a9db-1c03acf1df1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6770174a3d648c08af894450fbf765f', 'request_id': 'req-1732121a-1aa6-4527-a9db-1c03acf1df1e'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:05.105362 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1732121a-1aa6-4527-a9db-1c03acf1df1e admin admin] The token cache is being invalidate because project b6770174a3d648c08af894450fbf765f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:17:05.105643 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1732121a-1aa6-4527-a9db-1c03acf1df1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:05.106316 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-1732121a-1aa6-4527-a9db-1c03acf1df1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:05.109611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1418/2820] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:17:04 2022] DELETE /identity/v3/projects/b6770174a3d648c08af894450fbf765f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:17:05.116314 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32cadb-4438-4942-8c69-832b1fdcd2ac None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:05.116904 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32cadb-4438-4942-8c69-832b1fdcd2ac None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:05.117399 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32cadb-4438-4942-8c69-832b1fdcd2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:05.147541 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-eb32cadb-4438-4942-8c69-832b1fdcd2ac None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:17:05.149590 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-eb32cadb-4438-4942-8c69-832b1fdcd2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:05.238819 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1403/2821] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:17:05.254879 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dafd3-f87a-4ad9-ba59-80a238618b58 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:05.255273 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dafd3-f87a-4ad9-ba59-80a238618b58 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:05.255574 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dafd3-f87a-4ad9-ba59-80a238618b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:05.276076 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-6b6dafd3-f87a-4ad9-ba59-80a238618b58 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:17:05.277203 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-6b6dafd3-f87a-4ad9-ba59-80a238618b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:05.286055 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1419/2822] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:17:05.290654 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32cadb-4438-4942-8c69-832b1fdcd2ac None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:05.301921 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32cadb-4438-4942-8c69-832b1fdcd2ac None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:05.307387 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1d6df-b797-4c69-b8ed-7bfd8c8fec2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:05.310305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1d6df-b797-4c69-b8ed-7bfd8c8fec2e admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:05.310305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1d6df-b797-4c69-b8ed-7bfd8c8fec2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:05.310305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1d6df-b797-4c69-b8ed-7bfd8c8fec2e admin admin] PATH_INFO: `/v3/domains` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:05.310305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1d6df-b797-4c69-b8ed-7bfd8c8fec2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:17:05.310305 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1d6df-b797-4c69-b8ed-7bfd8c8fec2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:05.312285 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1d6df-b797-4c69-b8ed-7bfd8c8fec2e admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:05.325293 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1404/2823] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:17:05.330433 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dafd3-f87a-4ad9-ba59-80a238618b58 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:05.352400 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dafd3-f87a-4ad9-ba59-80a238618b58 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:05.357467 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d0929-c24f-438a-bc5b-e04732cc1175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:05.358155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d0929-c24f-438a-bc5b-e04732cc1175 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:05.358475 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d0929-c24f-438a-bc5b-e04732cc1175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:05.358758 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d0929-c24f-438a-bc5b-e04732cc1175 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:05.359460 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d0929-c24f-438a-bc5b-e04732cc1175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:05.362132 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d0929-c24f-438a-bc5b-e04732cc1175 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:05.389825 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1420/2824] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:17:05 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:17:05.396112 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1d6df-b797-4c69-b8ed-7bfd8c8fec2e admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:05.406592 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1d6df-b797-4c69-b8ed-7bfd8c8fec2e admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:05.470624 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e8f55-59f3-4e89-8936-601fd107d5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:05.471336 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e8f55-59f3-4e89-8936-601fd107d5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:05.471648 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e8f55-59f3-4e89-8936-601fd107d5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:05.471922 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e8f55-59f3-4e89-8936-601fd107d5a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:05.472778 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e8f55-59f3-4e89-8936-601fd107d5a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:05.474727 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e8f55-59f3-4e89-8936-601fd107d5a9 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:05.495160 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1405/2825] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:17:05 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:17:05.500267 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d0929-c24f-438a-bc5b-e04732cc1175 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:05.512442 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d0929-c24f-438a-bc5b-e04732cc1175 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:05.518547 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba870e9-6183-41c0-aa0d-8ed002e37707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:05.519244 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba870e9-6183-41c0-aa0d-8ed002e37707 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:05.519524 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba870e9-6183-41c0-aa0d-8ed002e37707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:05.519807 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba870e9-6183-41c0-aa0d-8ed002e37707 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:05.520533 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba870e9-6183-41c0-aa0d-8ed002e37707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:05.522130 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba870e9-6183-41c0-aa0d-8ed002e37707 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:05.537531 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1421/2826] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:17:05.542484 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e8f55-59f3-4e89-8936-601fd107d5a9 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:05.553636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e8f55-59f3-4e89-8936-601fd107d5a9 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:05.558509 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757f26f-e778-4834-ac32-e1514a68e44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:05.559182 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757f26f-e778-4834-ac32-e1514a68e44b admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:05.559471 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757f26f-e778-4834-ac32-e1514a68e44b admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:05.559892 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757f26f-e778-4834-ac32-e1514a68e44b admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:05.560486 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757f26f-e778-4834-ac32-e1514a68e44b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:05.562085 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757f26f-e778-4834-ac32-e1514a68e44b admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:05.574235 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1406/2827] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:17:05.578384 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba870e9-6183-41c0-aa0d-8ed002e37707 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:05.589398 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba870e9-6183-41c0-aa0d-8ed002e37707 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:05.594309 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea203d-ff71-4a4e-a68b-6cf737c775d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:05.595822 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea203d-ff71-4a4e-a68b-6cf737c775d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:05.596237 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea203d-ff71-4a4e-a68b-6cf737c775d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:05.596517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea203d-ff71-4a4e-a68b-6cf737c775d9 admin admin] PATH_INFO: `/v3/projects/3d74b85ad4894c4096c3ddbf12b90a82/users/eba386d06fb34c52b13f981aac7d61d0/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:05.613270 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea203d-ff71-4a4e-a68b-6cf737c775d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d74b85ad4894c4096c3ddbf12b90a82, user_id=eba386d06fb34c52b13f981aac7d61d0, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:05.616020 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea203d-ff71-4a4e-a68b-6cf737c775d9 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:05.635417 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1422/2828] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:17:05 2022] PUT /identity/v3/projects/3d74b85ad4894c4096c3ddbf12b90a82/users/eba386d06fb34c52b13f981aac7d61d0/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:17:05.648032 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ba806-cc48-4af8-931a-967f5f758f2f None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:05.648651 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ba806-cc48-4af8-931a-967f5f758f2f None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:05.648651 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ba806-cc48-4af8-931a-967f5f758f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:05.684694 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-f20ba806-cc48-4af8-931a-967f5f758f2f None None] MFA Rules not processed for user `eba386d06fb34c52b13f981aac7d61d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:17:05.684694 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-f20ba806-cc48-4af8-931a-967f5f758f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:05.752651 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1407/2829] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:17:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:17:05.757711 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea203d-ff71-4a4e-a68b-6cf737c775d9 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:05.828182 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea203d-ff71-4a4e-a68b-6cf737c775d9 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:05.835699 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca293c3-6ca1-4468-a011-9d8e6329a100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:05.836392 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca293c3-6ca1-4468-a011-9d8e6329a100 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:05.836848 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca293c3-6ca1-4468-a011-9d8e6329a100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:05.837134 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca293c3-6ca1-4468-a011-9d8e6329a100 admin admin] PATH_INFO: `/v3/projects` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:05.837852 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca293c3-6ca1-4468-a011-9d8e6329a100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:05.839853 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca293c3-6ca1-4468-a011-9d8e6329a100 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:05.874347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1423/2830] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:17:05 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:17:05.878836 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ba806-cc48-4af8-931a-967f5f758f2f None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:05.889414 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ba806-cc48-4af8-931a-967f5f758f2f None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:05.949897 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d44e4-cef0-477b-bc80-50632baaf45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:05.950630 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d44e4-cef0-477b-bc80-50632baaf45b admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:05.950894 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d44e4-cef0-477b-bc80-50632baaf45b admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:05.951170 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d44e4-cef0-477b-bc80-50632baaf45b admin admin] PATH_INFO: `/v3/users` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:05.951881 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d44e4-cef0-477b-bc80-50632baaf45b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:05.953836 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d44e4-cef0-477b-bc80-50632baaf45b admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:05.978586 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1408/2831] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:17:05 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:17:05.983137 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca293c3-6ca1-4468-a011-9d8e6329a100 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:05.996020 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca293c3-6ca1-4468-a011-9d8e6329a100 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:06.001933 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b9a78-9cf9-4594-8834-7e9e15fb461b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:06.002773 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b9a78-9cf9-4594-8834-7e9e15fb461b admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:06.003056 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b9a78-9cf9-4594-8834-7e9e15fb461b admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:06.003333 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b9a78-9cf9-4594-8834-7e9e15fb461b admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:06.004086 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b9a78-9cf9-4594-8834-7e9e15fb461b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:06.005744 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b9a78-9cf9-4594-8834-7e9e15fb461b admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:06.017515 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1424/2832] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:17:06.022579 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d44e4-cef0-477b-bc80-50632baaf45b admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:06.034236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d44e4-cef0-477b-bc80-50632baaf45b admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:06.039167 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ed0e0-d5fb-4d2f-a407-b58b90702276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:06.040072 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ed0e0-d5fb-4d2f-a407-b58b90702276 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:06.040359 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ed0e0-d5fb-4d2f-a407-b58b90702276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:06.040636 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ed0e0-d5fb-4d2f-a407-b58b90702276 admin admin] PATH_INFO: `/v3/projects/1a9c937f6b1d48d8b8e6b1077039075b/users/7e1f50d5e83346a1936f549c3d062f50/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:06.057517 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ed0e0-d5fb-4d2f-a407-b58b90702276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9c937f6b1d48d8b8e6b1077039075b, user_id=7e1f50d5e83346a1936f549c3d062f50, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:06.060223 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ed0e0-d5fb-4d2f-a407-b58b90702276 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:06.076376 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1409/2833] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:17:06 2022] PUT /identity/v3/projects/1a9c937f6b1d48d8b8e6b1077039075b/users/7e1f50d5e83346a1936f549c3d062f50/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:17:06.081358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b9a78-9cf9-4594-8834-7e9e15fb461b admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:06.095069 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b9a78-9cf9-4594-8834-7e9e15fb461b admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:06.166071 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b96e0-9118-4097-9405-6179cd59e3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:06.166784 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b96e0-9118-4097-9405-6179cd59e3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:06.167069 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b96e0-9118-4097-9405-6179cd59e3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:06.167401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b96e0-9118-4097-9405-6179cd59e3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:06.168391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b96e0-9118-4097-9405-6179cd59e3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:06.170317 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b96e0-9118-4097-9405-6179cd59e3c2 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:06.182704 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1425/2834] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:17:06.187038 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ed0e0-d5fb-4d2f-a407-b58b90702276 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:06.199609 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ed0e0-d5fb-4d2f-a407-b58b90702276 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:06.205121 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a74f1-7c73-42a0-8839-e1cd3feb06a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:06.206176 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a74f1-7c73-42a0-8839-e1cd3feb06a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:06.206490 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a74f1-7c73-42a0-8839-e1cd3feb06a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:06.206768 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a74f1-7c73-42a0-8839-e1cd3feb06a0 admin admin] PATH_INFO: `/v3/projects/1a9c937f6b1d48d8b8e6b1077039075b/users/7e1f50d5e83346a1936f549c3d062f50/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:06.208812 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a74f1-7c73-42a0-8839-e1cd3feb06a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9c937f6b1d48d8b8e6b1077039075b, user_id=7e1f50d5e83346a1936f549c3d062f50, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:06.211503 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a74f1-7c73-42a0-8839-e1cd3feb06a0 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:06.223175 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1410/2835] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:17:06 2022] PUT /identity/v3/projects/1a9c937f6b1d48d8b8e6b1077039075b/users/7e1f50d5e83346a1936f549c3d062f50/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:17:06.233771 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9fdf4-88fb-4cf9-b91d-2127e28b23f0 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:06.234055 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9fdf4-88fb-4cf9-b91d-2127e28b23f0 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:06.234358 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9fdf4-88fb-4cf9-b91d-2127e28b23f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:06.264547 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-81f9fdf4-88fb-4cf9-b91d-2127e28b23f0 None None] MFA Rules not processed for user `7e1f50d5e83346a1936f549c3d062f50`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:17:06.265754 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-81f9fdf4-88fb-4cf9-b91d-2127e28b23f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:06.338578 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1426/2836] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:17:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:17:06.349949 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a74f1-7c73-42a0-8839-e1cd3feb06a0 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:06.351684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-930a74f1-7c73-42a0-8839-e1cd3feb06a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:06.414755 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a74f1-7c73-42a0-8839-e1cd3feb06a0 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:06.418473 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355c831-4c0e-4e26-b9c7-28a198585b87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:06.419129 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355c831-4c0e-4e26-b9c7-28a198585b87 service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:06.419410 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355c831-4c0e-4e26-b9c7-28a198585b87 service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:06.419687 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355c831-4c0e-4e26-b9c7-28a198585b87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:06.431737 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355c831-4c0e-4e26-b9c7-28a198585b87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:06.433184 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355c831-4c0e-4e26-b9c7-28a198585b87 service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:06.444501 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1411/2837] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:17:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:17:06.516532 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9fdf4-88fb-4cf9-b91d-2127e28b23f0 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:06.585268 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9fdf4-88fb-4cf9-b91d-2127e28b23f0 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:06.590168 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c55069-b699-49eb-946c-d419fa89ab13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:06.591078 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c55069-b699-49eb-946c-d419fa89ab13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:06.591351 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c55069-b699-49eb-946c-d419fa89ab13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:06.591620 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c55069-b699-49eb-946c-d419fa89ab13 admin admin] PATH_INFO: `/v3/users/eba386d06fb34c52b13f981aac7d61d0` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:06.596444 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c55069-b699-49eb-946c-d419fa89ab13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eba386d06fb34c52b13f981aac7d61d0)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:06.598545 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c55069-b699-49eb-946c-d419fa89ab13 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:06.659851 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f3c55069-b699-49eb-946c-d419fa89ab13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eba386d06fb34c52b13f981aac7d61d0'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:06.660626 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f3c55069-b699-49eb-946c-d419fa89ab13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eba386d06fb34c52b13f981aac7d61d0'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:06.678014 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f3c55069-b699-49eb-946c-d419fa89ab13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eba386d06fb34c52b13f981aac7d61d0'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:06.687587 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f3c55069-b699-49eb-946c-d419fa89ab13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eba386d06fb34c52b13f981aac7d61d0'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:06.696012 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-f3c55069-b699-49eb-946c-d419fa89ab13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eba386d06fb34c52b13f981aac7d61d0'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:06.702151 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1427/2838] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:17:06 2022] DELETE /identity/v3/users/eba386d06fb34c52b13f981aac7d61d0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:17:06.708347 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0fc4c-f45b-4c3e-8fcd-9a6d16f87c71 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:06.708879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0fc4c-f45b-4c3e-8fcd-9a6d16f87c71 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:06.708879 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0fc4c-f45b-4c3e-8fcd-9a6d16f87c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:06.729113 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-a6d0fc4c-f45b-4c3e-8fcd-9a6d16f87c71 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:17:06.730394 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a6d0fc4c-f45b-4c3e-8fcd-9a6d16f87c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:06.824996 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1412/2839] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:17:06.837670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c55069-b699-49eb-946c-d419fa89ab13 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:06.839190 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-f3c55069-b699-49eb-946c-d419fa89ab13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:06.923441 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c55069-b699-49eb-946c-d419fa89ab13 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:06.928347 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef535a04-c887-44f5-afda-e9882bb78199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:06.929075 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef535a04-c887-44f5-afda-e9882bb78199 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:06.929405 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef535a04-c887-44f5-afda-e9882bb78199 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:06.929696 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef535a04-c887-44f5-afda-e9882bb78199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:06.940868 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef535a04-c887-44f5-afda-e9882bb78199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:06.942395 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef535a04-c887-44f5-afda-e9882bb78199 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:06.953763 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1428/2840] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:17:07.273862 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0fc4c-f45b-4c3e-8fcd-9a6d16f87c71 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:07.275329 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a6d0fc4c-f45b-4c3e-8fcd-9a6d16f87c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:07.290570 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0fc4c-f45b-4c3e-8fcd-9a6d16f87c71 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:07.296851 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78513d7-08cd-4240-b86d-9bab0f7de614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:07.299045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78513d7-08cd-4240-b86d-9bab0f7de614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:07.299368 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78513d7-08cd-4240-b86d-9bab0f7de614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:07.299807 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78513d7-08cd-4240-b86d-9bab0f7de614 admin admin] PATH_INFO: `/v3/projects/3d74b85ad4894c4096c3ddbf12b90a82` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:07.301675 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78513d7-08cd-4240-b86d-9bab0f7de614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d74b85ad4894c4096c3ddbf12b90a82)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:07.303786 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78513d7-08cd-4240-b86d-9bab0f7de614 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:07.364236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-d78513d7-08cd-4240-b86d-9bab0f7de614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d74b85ad4894c4096c3ddbf12b90a82', 'request_id': 'req-d78513d7-08cd-4240-b86d-9bab0f7de614'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:07.371121 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-d78513d7-08cd-4240-b86d-9bab0f7de614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d74b85ad4894c4096c3ddbf12b90a82', 'request_id': 'req-d78513d7-08cd-4240-b86d-9bab0f7de614'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:07.381766 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-d78513d7-08cd-4240-b86d-9bab0f7de614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d74b85ad4894c4096c3ddbf12b90a82', 'request_id': 'req-d78513d7-08cd-4240-b86d-9bab0f7de614'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:07.398578 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-d78513d7-08cd-4240-b86d-9bab0f7de614 admin admin] The token cache is being invalidate because project 3d74b85ad4894c4096c3ddbf12b90a82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:17:07.398967 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-d78513d7-08cd-4240-b86d-9bab0f7de614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:07.399902 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-d78513d7-08cd-4240-b86d-9bab0f7de614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:07.401775 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1413/2841] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:17:07 2022] DELETE /identity/v3/projects/3d74b85ad4894c4096c3ddbf12b90a82 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:17:07.408393 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef535a04-c887-44f5-afda-e9882bb78199 service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:07.419036 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef535a04-c887-44f5-afda-e9882bb78199 service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:07.490329 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be341fb-dc03-4e06-9262-20d537dbf504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:07.491231 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be341fb-dc03-4e06-9262-20d537dbf504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:07.491509 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be341fb-dc03-4e06-9262-20d537dbf504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:07.491782 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be341fb-dc03-4e06-9262-20d537dbf504 admin admin] PATH_INFO: `/v3/users/7e1f50d5e83346a1936f549c3d062f50` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:07.493059 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be341fb-dc03-4e06-9262-20d537dbf504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e1f50d5e83346a1936f549c3d062f50)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:07.495013 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be341fb-dc03-4e06-9262-20d537dbf504 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:07.549468 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-4be341fb-dc03-4e06-9262-20d537dbf504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e1f50d5e83346a1936f549c3d062f50'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:07.550417 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-4be341fb-dc03-4e06-9262-20d537dbf504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e1f50d5e83346a1936f549c3d062f50'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:07.564673 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-4be341fb-dc03-4e06-9262-20d537dbf504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e1f50d5e83346a1936f549c3d062f50'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:07.573969 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-4be341fb-dc03-4e06-9262-20d537dbf504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e1f50d5e83346a1936f549c3d062f50'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:07.586058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-4be341fb-dc03-4e06-9262-20d537dbf504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e1f50d5e83346a1936f549c3d062f50'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:07.592513 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1429/2842] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:17:07 2022] DELETE /identity/v3/users/7e1f50d5e83346a1936f549c3d062f50 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:17:07.926421 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78513d7-08cd-4240-b86d-9bab0f7de614 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:07.928004 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-d78513d7-08cd-4240-b86d-9bab0f7de614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:07.943850 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78513d7-08cd-4240-b86d-9bab0f7de614 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:08.015751 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ddbad-b178-4998-ac74-20856324c607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:08.017262 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ddbad-b178-4998-ac74-20856324c607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:08.017754 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ddbad-b178-4998-ac74-20856324c607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:08.018299 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ddbad-b178-4998-ac74-20856324c607 admin admin] PATH_INFO: `/v3/projects/1a9c937f6b1d48d8b8e6b1077039075b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:08.020220 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ddbad-b178-4998-ac74-20856324c607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a9c937f6b1d48d8b8e6b1077039075b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:08.022998 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ddbad-b178-4998-ac74-20856324c607 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:08.073581 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-6e7ddbad-b178-4998-ac74-20856324c607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a9c937f6b1d48d8b8e6b1077039075b', 'request_id': 'req-6e7ddbad-b178-4998-ac74-20856324c607'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:08.079633 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-6e7ddbad-b178-4998-ac74-20856324c607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a9c937f6b1d48d8b8e6b1077039075b', 'request_id': 'req-6e7ddbad-b178-4998-ac74-20856324c607'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:08.086810 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-6e7ddbad-b178-4998-ac74-20856324c607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a9c937f6b1d48d8b8e6b1077039075b', 'request_id': 'req-6e7ddbad-b178-4998-ac74-20856324c607'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:08.112355 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-6e7ddbad-b178-4998-ac74-20856324c607 admin admin] The token cache is being invalidate because project 1a9c937f6b1d48d8b8e6b1077039075b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:17:08.112640 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-6e7ddbad-b178-4998-ac74-20856324c607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:08.113291 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-6e7ddbad-b178-4998-ac74-20856324c607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:08.114886 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1414/2843] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:17:07 2022] DELETE /identity/v3/projects/1a9c937f6b1d48d8b8e6b1077039075b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:17:08.120534 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf41f6-d263-4809-89a2-00dafc3a8cda None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:08.121001 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf41f6-d263-4809-89a2-00dafc3a8cda None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:08.121452 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf41f6-d263-4809-89a2-00dafc3a8cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:08.149285 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-51cf41f6-d263-4809-89a2-00dafc3a8cda None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:17:08.150945 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-51cf41f6-d263-4809-89a2-00dafc3a8cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:08.222557 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1430/2844] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:17:08.231807 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178c441-1085-40c6-9df8-a846a2aa82f1 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:08.232097 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178c441-1085-40c6-9df8-a846a2aa82f1 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:08.232436 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178c441-1085-40c6-9df8-a846a2aa82f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:08.252914 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-9178c441-1085-40c6-9df8-a846a2aa82f1 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:17:08.254184 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-9178c441-1085-40c6-9df8-a846a2aa82f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:08.262472 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1415/2845] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:17:08.268162 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf41f6-d263-4809-89a2-00dafc3a8cda None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:08.278443 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf41f6-d263-4809-89a2-00dafc3a8cda None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:08.284253 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5089d05-79e6-4d48-bdb0-5334910a3bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:08.284741 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5089d05-79e6-4d48-bdb0-5334910a3bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:08.285025 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5089d05-79e6-4d48-bdb0-5334910a3bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:08.285295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5089d05-79e6-4d48-bdb0-5334910a3bf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:08.286041 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5089d05-79e6-4d48-bdb0-5334910a3bf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:17:08.286391 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5089d05-79e6-4d48-bdb0-5334910a3bf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:08.287995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5089d05-79e6-4d48-bdb0-5334910a3bf8 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:08.300184 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1431/2846] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:17:08.304654 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178c441-1085-40c6-9df8-a846a2aa82f1 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:08.315150 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178c441-1085-40c6-9df8-a846a2aa82f1 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:08.320779 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ff7af-2e7f-4b65-bbb1-a7023e1b1032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:08.321702 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ff7af-2e7f-4b65-bbb1-a7023e1b1032 admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:08.321996 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ff7af-2e7f-4b65-bbb1-a7023e1b1032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:08.322306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ff7af-2e7f-4b65-bbb1-a7023e1b1032 admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:08.323016 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ff7af-2e7f-4b65-bbb1-a7023e1b1032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:08.325062 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ff7af-2e7f-4b65-bbb1-a7023e1b1032 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:08.361804 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1416/2847] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:17:08 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:17:08.367294 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5089d05-79e6-4d48-bdb0-5334910a3bf8 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:08.378669 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5089d05-79e6-4d48-bdb0-5334910a3bf8 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:08.451449 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb779fb-89b7-46c4-9f9e-1b20d310d267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:08.452156 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb779fb-89b7-46c4-9f9e-1b20d310d267 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:08.452452 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb779fb-89b7-46c4-9f9e-1b20d310d267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:08.452774 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb779fb-89b7-46c4-9f9e-1b20d310d267 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:08.453517 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb779fb-89b7-46c4-9f9e-1b20d310d267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:08.455690 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb779fb-89b7-46c4-9f9e-1b20d310d267 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:08.486223 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1432/2848] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:17:08 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:17:08.492028 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ff7af-2e7f-4b65-bbb1-a7023e1b1032 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:08.504388 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ff7af-2e7f-4b65-bbb1-a7023e1b1032 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:08.509463 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8f956-e0d4-4122-937e-f9f8b3f36376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:08.510187 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8f956-e0d4-4122-937e-f9f8b3f36376 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:08.510513 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8f956-e0d4-4122-937e-f9f8b3f36376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:08.510798 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8f956-e0d4-4122-937e-f9f8b3f36376 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:08.511591 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8f956-e0d4-4122-937e-f9f8b3f36376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:08.513316 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8f956-e0d4-4122-937e-f9f8b3f36376 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:08.526735 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1417/2849] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:17:08.533051 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb779fb-89b7-46c4-9f9e-1b20d310d267 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:08.545504 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb779fb-89b7-46c4-9f9e-1b20d310d267 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:08.551792 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f964006-8799-4f4d-a343-8046c7de3b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:08.552515 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f964006-8799-4f4d-a343-8046c7de3b5a admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:08.552828 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f964006-8799-4f4d-a343-8046c7de3b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:08.553116 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f964006-8799-4f4d-a343-8046c7de3b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:08.553913 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f964006-8799-4f4d-a343-8046c7de3b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:08.555635 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f964006-8799-4f4d-a343-8046c7de3b5a admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:08.568484 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1433/2850] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:17:08.574002 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8f956-e0d4-4122-937e-f9f8b3f36376 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:08.586504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8f956-e0d4-4122-937e-f9f8b3f36376 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:08.591342 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991093e0-2f72-49bf-bf58-2fe9b8467b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:08.592257 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991093e0-2f72-49bf-bf58-2fe9b8467b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:08.592541 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991093e0-2f72-49bf-bf58-2fe9b8467b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:08.592820 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991093e0-2f72-49bf-bf58-2fe9b8467b42 admin admin] PATH_INFO: `/v3/projects/fbf79c3cce8c465ba0305d01d9fe2f81/users/e496ac849cdb4b64b9ea03c88aae3914/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:08.612837 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991093e0-2f72-49bf-bf58-2fe9b8467b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf79c3cce8c465ba0305d01d9fe2f81, user_id=e496ac849cdb4b64b9ea03c88aae3914, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:08.615586 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991093e0-2f72-49bf-bf58-2fe9b8467b42 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:08.631925 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1418/2851] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:17:08 2022] PUT /identity/v3/projects/fbf79c3cce8c465ba0305d01d9fe2f81/users/e496ac849cdb4b64b9ea03c88aae3914/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:17:08.643627 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed136b4-76da-457b-8ae2-00c4c08513ba None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:08.643909 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed136b4-76da-457b-8ae2-00c4c08513ba None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:08.644183 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed136b4-76da-457b-8ae2-00c4c08513ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:08.676375 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-aed136b4-76da-457b-8ae2-00c4c08513ba None None] MFA Rules not processed for user `e496ac849cdb4b64b9ea03c88aae3914`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:17:08.678354 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-aed136b4-76da-457b-8ae2-00c4c08513ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:08.757253 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1434/2852] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:17:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:17:08.771370 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991093e0-2f72-49bf-bf58-2fe9b8467b42 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:08.774070 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-991093e0-2f72-49bf-bf58-2fe9b8467b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:08.845290 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991093e0-2f72-49bf-bf58-2fe9b8467b42 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:08.849045 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dc236-fd2d-413e-ae34-b4aa7a83f8fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:08.849690 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dc236-fd2d-413e-ae34-b4aa7a83f8fc service cinder] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:08.849970 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dc236-fd2d-413e-ae34-b4aa7a83f8fc service cinder] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:08.850276 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dc236-fd2d-413e-ae34-b4aa7a83f8fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:08.860547 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7dc236-fd2d-413e-ae34-b4aa7a83f8fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:08.861982 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7dc236-fd2d-413e-ae34-b4aa7a83f8fc service cinder] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:08.873496 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1419/2853] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:17:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:17:31.887589 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed136b4-76da-457b-8ae2-00c4c08513ba None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:31.966494 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed136b4-76da-457b-8ae2-00c4c08513ba None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:31.971046 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3496510-693c-4ec4-9cd6-2112ebe0a7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:31.972723 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3496510-693c-4ec4-9cd6-2112ebe0a7a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:31.973024 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3496510-693c-4ec4-9cd6-2112ebe0a7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:31.973276 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3496510-693c-4ec4-9cd6-2112ebe0a7a3 admin admin] PATH_INFO: `/v3/users/e496ac849cdb4b64b9ea03c88aae3914` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:31.974509 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3496510-693c-4ec4-9cd6-2112ebe0a7a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e496ac849cdb4b64b9ea03c88aae3914)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:31.976425 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3496510-693c-4ec4-9cd6-2112ebe0a7a3 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:32.032346 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d3496510-693c-4ec4-9cd6-2112ebe0a7a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e496ac849cdb4b64b9ea03c88aae3914'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:32.032970 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d3496510-693c-4ec4-9cd6-2112ebe0a7a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e496ac849cdb4b64b9ea03c88aae3914'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:32.047588 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d3496510-693c-4ec4-9cd6-2112ebe0a7a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e496ac849cdb4b64b9ea03c88aae3914'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:32.055810 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d3496510-693c-4ec4-9cd6-2112ebe0a7a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e496ac849cdb4b64b9ea03c88aae3914'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:32.062938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d3496510-693c-4ec4-9cd6-2112ebe0a7a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e496ac849cdb4b64b9ea03c88aae3914'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:32.069327 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1435/2854] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:17:31 2022] DELETE /identity/v3/users/e496ac849cdb4b64b9ea03c88aae3914 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:17:32.074430 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728def7-e1cf-4c39-a997-c901e899c5fa None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:32.074950 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728def7-e1cf-4c39-a997-c901e899c5fa None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:32.074950 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728def7-e1cf-4c39-a997-c901e899c5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:32.093061 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-a728def7-e1cf-4c39-a997-c901e899c5fa None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:17:32.094318 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a728def7-e1cf-4c39-a997-c901e899c5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:32.154488 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1420/2855] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:17:32.164866 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3496510-693c-4ec4-9cd6-2112ebe0a7a3 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:32.166295 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-d3496510-693c-4ec4-9cd6-2112ebe0a7a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:32.229730 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3496510-693c-4ec4-9cd6-2112ebe0a7a3 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:32.233451 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0487f-be9d-4ad8-a976-8ad41c0d508d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:32.234103 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0487f-be9d-4ad8-a976-8ad41c0d508d service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:32.234424 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0487f-be9d-4ad8-a976-8ad41c0d508d service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:32.234702 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0487f-be9d-4ad8-a976-8ad41c0d508d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:32.244730 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0487f-be9d-4ad8-a976-8ad41c0d508d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:32.246178 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0487f-be9d-4ad8-a976-8ad41c0d508d service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:32.257664 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1436/2856] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:17:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:17:32.555230 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728def7-e1cf-4c39-a997-c901e899c5fa None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:32.556801 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-a728def7-e1cf-4c39-a997-c901e899c5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:32.569559 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728def7-e1cf-4c39-a997-c901e899c5fa None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:32.575039 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33e70d-a3a3-4c57-b74d-bb67c876c30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:32.575955 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33e70d-a3a3-4c57-b74d-bb67c876c30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:32.576248 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33e70d-a3a3-4c57-b74d-bb67c876c30f admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:32.576523 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33e70d-a3a3-4c57-b74d-bb67c876c30f admin admin] PATH_INFO: `/v3/projects/fbf79c3cce8c465ba0305d01d9fe2f81` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:32.578580 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33e70d-a3a3-4c57-b74d-bb67c876c30f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf79c3cce8c465ba0305d01d9fe2f81)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:32.580783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33e70d-a3a3-4c57-b74d-bb67c876c30f admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:32.642629 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9e33e70d-a3a3-4c57-b74d-bb67c876c30f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf79c3cce8c465ba0305d01d9fe2f81', 'request_id': 'req-9e33e70d-a3a3-4c57-b74d-bb67c876c30f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:32.648692 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9e33e70d-a3a3-4c57-b74d-bb67c876c30f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf79c3cce8c465ba0305d01d9fe2f81', 'request_id': 'req-9e33e70d-a3a3-4c57-b74d-bb67c876c30f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:32.655733 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9e33e70d-a3a3-4c57-b74d-bb67c876c30f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf79c3cce8c465ba0305d01d9fe2f81', 'request_id': 'req-9e33e70d-a3a3-4c57-b74d-bb67c876c30f'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:32.671448 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9e33e70d-a3a3-4c57-b74d-bb67c876c30f admin admin] The token cache is being invalidate because project fbf79c3cce8c465ba0305d01d9fe2f81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:17:32.671747 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9e33e70d-a3a3-4c57-b74d-bb67c876c30f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:32.673306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-9e33e70d-a3a3-4c57-b74d-bb67c876c30f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:17:32.675707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1421/2857] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:17:32 2022] DELETE /identity/v3/projects/fbf79c3cce8c465ba0305d01d9fe2f81 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:17:32.682662 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe25539-d66f-41a3-9177-9ad98ddb165f None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:32.683127 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe25539-d66f-41a3-9177-9ad98ddb165f None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:32.683558 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe25539-d66f-41a3-9177-9ad98ddb165f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:32.706369 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-bbe25539-d66f-41a3-9177-9ad98ddb165f None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:17:32.707699 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-bbe25539-d66f-41a3-9177-9ad98ddb165f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:32.783281 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1437/2858] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:17:32.792405 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a260267-3b66-4d76-b7a8-e97a45060f9f None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:32.792690 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a260267-3b66-4d76-b7a8-e97a45060f9f None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:32.792968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a260267-3b66-4d76-b7a8-e97a45060f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:32.813400 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-4a260267-3b66-4d76-b7a8-e97a45060f9f None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:17:32.814649 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-4a260267-3b66-4d76-b7a8-e97a45060f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:32.822787 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1422/2859] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:17:32.827161 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe25539-d66f-41a3-9177-9ad98ddb165f None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:32.837608 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe25539-d66f-41a3-9177-9ad98ddb165f None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:32.843615 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a67b7-dfda-43be-9052-f936549b20ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:32.843615 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a67b7-dfda-43be-9052-f936549b20ad admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:32.843615 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a67b7-dfda-43be-9052-f936549b20ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:32.843615 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a67b7-dfda-43be-9052-f936549b20ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:32.844339 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a67b7-dfda-43be-9052-f936549b20ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:17:32.844499 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a67b7-dfda-43be-9052-f936549b20ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:32.846091 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a67b7-dfda-43be-9052-f936549b20ad admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:32.859903 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1438/2860] 10.222.0.32 () {58 vars in 1152 bytes} [Tue May 10 14:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:17:32.864739 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a260267-3b66-4d76-b7a8-e97a45060f9f None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:32.875103 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a260267-3b66-4d76-b7a8-e97a45060f9f None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:32.880997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e785fb6-2fa5-4095-96b3-1b64cff9a52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:32.881710 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e785fb6-2fa5-4095-96b3-1b64cff9a52b admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:32.881991 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e785fb6-2fa5-4095-96b3-1b64cff9a52b admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:32.882302 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e785fb6-2fa5-4095-96b3-1b64cff9a52b admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:32.883091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e785fb6-2fa5-4095-96b3-1b64cff9a52b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:32.885025 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e785fb6-2fa5-4095-96b3-1b64cff9a52b admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:32.919028 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1423/2861] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:17:32 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:17:32.923263 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a67b7-dfda-43be-9052-f936549b20ad admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:32.938723 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a67b7-dfda-43be-9052-f936549b20ad admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:32.998720 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c6b6c-bf48-4c87-8997-c648ea521296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:32.999401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c6b6c-bf48-4c87-8997-c648ea521296 admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:32.999932 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c6b6c-bf48-4c87-8997-c648ea521296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:33.000213 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c6b6c-bf48-4c87-8997-c648ea521296 admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:33.000922 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c6b6c-bf48-4c87-8997-c648ea521296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:33.003625 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c6b6c-bf48-4c87-8997-c648ea521296 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:33.026477 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1439/2862] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:17:32 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:17:33.032987 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e785fb6-2fa5-4095-96b3-1b64cff9a52b admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:33.042888 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e785fb6-2fa5-4095-96b3-1b64cff9a52b admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:33.047780 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe02b32-2ba1-4d77-a4e6-047d7e9ab4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:33.048449 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe02b32-2ba1-4d77-a4e6-047d7e9ab4ba admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:33.048726 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe02b32-2ba1-4d77-a4e6-047d7e9ab4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:33.048997 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe02b32-2ba1-4d77-a4e6-047d7e9ab4ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:33.050326 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe02b32-2ba1-4d77-a4e6-047d7e9ab4ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:33.051984 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe02b32-2ba1-4d77-a4e6-047d7e9ab4ba admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:33.065185 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1424/2863] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:17:33.068639 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c6b6c-bf48-4c87-8997-c648ea521296 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:33.079135 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c6b6c-bf48-4c87-8997-c648ea521296 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:33.085173 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c98ce-be0e-4453-9c00-2e21381778e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:33.085930 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c98ce-be0e-4453-9c00-2e21381778e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:33.086239 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c98ce-be0e-4453-9c00-2e21381778e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:33.086526 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c98ce-be0e-4453-9c00-2e21381778e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:33.087267 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c98ce-be0e-4453-9c00-2e21381778e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:33.088970 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c98ce-be0e-4453-9c00-2e21381778e6 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:33.100896 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1440/2864] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:17:33.104958 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe02b32-2ba1-4d77-a4e6-047d7e9ab4ba admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:33.116638 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe02b32-2ba1-4d77-a4e6-047d7e9ab4ba admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:33.121534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88344aa6-a438-49ec-ac12-3410533a6fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:33.122472 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88344aa6-a438-49ec-ac12-3410533a6fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:33.122756 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88344aa6-a438-49ec-ac12-3410533a6fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:33.123040 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88344aa6-a438-49ec-ac12-3410533a6fc4 admin admin] PATH_INFO: `/v3/projects/18c7a906c7bf4b5fbc769d1d77e50e44/users/06330ab526264eaab0ee1454d30378b0/roles/34ef75b7c6d54c5e81edbfee2f4b362d` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:33.150630 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88344aa6-a438-49ec-ac12-3410533a6fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c7a906c7bf4b5fbc769d1d77e50e44, user_id=06330ab526264eaab0ee1454d30378b0, role_id=34ef75b7c6d54c5e81edbfee2f4b362d)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:33.153468 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88344aa6-a438-49ec-ac12-3410533a6fc4 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:33.169680 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1425/2865] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:17:33 2022] PUT /identity/v3/projects/18c7a906c7bf4b5fbc769d1d77e50e44/users/06330ab526264eaab0ee1454d30378b0/roles/34ef75b7c6d54c5e81edbfee2f4b362d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:17:33.175641 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d82ec-2c91-4752-b772-83b7d627bde8 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:33.175995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d82ec-2c91-4752-b772-83b7d627bde8 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:33.176331 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d82ec-2c91-4752-b772-83b7d627bde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:33.196599 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-d52d82ec-2c91-4752-b772-83b7d627bde8 None None] MFA Rules not processed for user `2917275ac848431ab364bc258730628d`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:17:33.197832 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-d52d82ec-2c91-4752-b772-83b7d627bde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:33.277719 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1441/2866] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:17:33.288344 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88344aa6-a438-49ec-ac12-3410533a6fc4 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:33.290272 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-88344aa6-a438-49ec-ac12-3410533a6fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:33.366169 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88344aa6-a438-49ec-ac12-3410533a6fc4 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:33.373205 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583b385-d7ae-440e-a2b1-ff5f9305e874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:33.373864 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583b385-d7ae-440e-a2b1-ff5f9305e874 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:33.374141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583b385-d7ae-440e-a2b1-ff5f9305e874 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:33.374439 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583b385-d7ae-440e-a2b1-ff5f9305e874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:33.385369 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583b385-d7ae-440e-a2b1-ff5f9305e874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:33.386858 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583b385-d7ae-440e-a2b1-ff5f9305e874 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:33.398485 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1426/2867] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:17:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:17:37.701749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab3e9f-a234-4940-afe6-62783609b383 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:37.702327 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab3e9f-a234-4940-afe6-62783609b383 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:37.702327 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab3e9f-a234-4940-afe6-62783609b383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:37.735287 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-8fab3e9f-a234-4940-afe6-62783609b383 None None] MFA Rules not processed for user `06330ab526264eaab0ee1454d30378b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:17:37.736536 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-8fab3e9f-a234-4940-afe6-62783609b383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:37.810311 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1442/2868] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:17:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:17:37.814783 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583b385-d7ae-440e-a2b1-ff5f9305e874 service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:37.825612 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583b385-d7ae-440e-a2b1-ff5f9305e874 service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:37.834491 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b1bda-f18f-44a0-9557-5eeb41584c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:37.835481 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b1bda-f18f-44a0-9557-5eeb41584c4f admin admin] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:37.836129 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b1bda-f18f-44a0-9557-5eeb41584c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:37.836504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b1bda-f18f-44a0-9557-5eeb41584c4f admin admin] PATH_INFO: `/v3/projects` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:37.837449 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b1bda-f18f-44a0-9557-5eeb41584c4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:37.839504 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b1bda-f18f-44a0-9557-5eeb41584c4f admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:37.873455 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1427/2869] 10.222.0.32 () {60 vars in 1152 bytes} [Tue May 10 14:17:37 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:17:37.874581 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab3e9f-a234-4940-afe6-62783609b383 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:37.887326 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab3e9f-a234-4940-afe6-62783609b383 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:37.949710 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04917fa8-0c12-4995-b5f5-30a08b1a454a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:37.950458 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04917fa8-0c12-4995-b5f5-30a08b1a454a admin admin] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:37.950716 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04917fa8-0c12-4995-b5f5-30a08b1a454a admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:37.950994 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04917fa8-0c12-4995-b5f5-30a08b1a454a admin admin] PATH_INFO: `/v3/users` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:37.951693 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04917fa8-0c12-4995-b5f5-30a08b1a454a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:37.953605 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04917fa8-0c12-4995-b5f5-30a08b1a454a admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:37.975366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1443/2870] 10.222.0.32 () {60 vars in 1143 bytes} [Tue May 10 14:17:37 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:17:37.979626 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b1bda-f18f-44a0-9557-5eeb41584c4f admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:37.990387 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b1bda-f18f-44a0-9557-5eeb41584c4f admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:37.995024 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d706144-7ba0-465f-a515-6d8a783da24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:37.995681 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d706144-7ba0-465f-a515-6d8a783da24f admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:37.995964 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d706144-7ba0-465f-a515-6d8a783da24f admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:37.996236 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d706144-7ba0-465f-a515-6d8a783da24f admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:37.996961 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d706144-7ba0-465f-a515-6d8a783da24f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:37.998753 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d706144-7ba0-465f-a515-6d8a783da24f admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:38.013500 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1428/2871] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:17:38.016971 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04917fa8-0c12-4995-b5f5-30a08b1a454a admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:38.028672 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04917fa8-0c12-4995-b5f5-30a08b1a454a admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:38.033544 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b50957-fcd9-4975-9477-97099992fbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:38.035201 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b50957-fcd9-4975-9477-97099992fbc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:38.035401 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b50957-fcd9-4975-9477-97099992fbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:38.035830 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b50957-fcd9-4975-9477-97099992fbc2 admin admin] PATH_INFO: `/v3/projects/076f8a844eb44faaac6d1008b9ccd2db/users/acde2ea845ee496ba0c51561fada1095/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:38.052023 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b50957-fcd9-4975-9477-97099992fbc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=076f8a844eb44faaac6d1008b9ccd2db, user_id=acde2ea845ee496ba0c51561fada1095, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:38.054908 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b50957-fcd9-4975-9477-97099992fbc2 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:38.069220 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1444/2872] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:17:38 2022] PUT /identity/v3/projects/076f8a844eb44faaac6d1008b9ccd2db/users/acde2ea845ee496ba0c51561fada1095/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:17:38.076534 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d706144-7ba0-465f-a515-6d8a783da24f admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:38.104074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d706144-7ba0-465f-a515-6d8a783da24f admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:38.175306 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ab8b4-0182-4563-b1e0-e293bb4307e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:38.175988 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ab8b4-0182-4563-b1e0-e293bb4307e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:38.176269 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ab8b4-0182-4563-b1e0-e293bb4307e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:38.176542 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ab8b4-0182-4563-b1e0-e293bb4307e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:38.177274 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ab8b4-0182-4563-b1e0-e293bb4307e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:38.178956 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ab8b4-0182-4563-b1e0-e293bb4307e0 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:38.189366 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1429/2873] 10.222.0.32 () {58 vars in 1121 bytes} [Tue May 10 14:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:17:38.194088 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b50957-fcd9-4975-9477-97099992fbc2 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:38.204803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b50957-fcd9-4975-9477-97099992fbc2 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:38.214152 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9de38c-d9e8-41c3-a39d-e30be44d1d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:38.215276 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9de38c-d9e8-41c3-a39d-e30be44d1d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:38.215624 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9de38c-d9e8-41c3-a39d-e30be44d1d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:38.215968 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9de38c-d9e8-41c3-a39d-e30be44d1d97 admin admin] PATH_INFO: `/v3/projects/076f8a844eb44faaac6d1008b9ccd2db/users/acde2ea845ee496ba0c51561fada1095/roles/17e40821fc444dd0b040dcfce3eb222b` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:38.218104 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9de38c-d9e8-41c3-a39d-e30be44d1d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=076f8a844eb44faaac6d1008b9ccd2db, user_id=acde2ea845ee496ba0c51561fada1095, role_id=17e40821fc444dd0b040dcfce3eb222b)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:38.220949 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9de38c-d9e8-41c3-a39d-e30be44d1d97 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:38.233387 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1445/2874] 10.222.0.32 () {60 vars in 1482 bytes} [Tue May 10 14:17:38 2022] PUT /identity/v3/projects/076f8a844eb44faaac6d1008b9ccd2db/users/acde2ea845ee496ba0c51561fada1095/roles/17e40821fc444dd0b040dcfce3eb222b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:17:43.454827 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aba074-ba94-4d17-9f64-0672cd75e574 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:43.455451 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aba074-ba94-4d17-9f64-0672cd75e574 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:43.455727 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aba074-ba94-4d17-9f64-0672cd75e574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:43.486129 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-46aba074-ba94-4d17-9f64-0672cd75e574 None None] MFA Rules not processed for user `acde2ea845ee496ba0c51561fada1095`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:17:43.488707 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-46aba074-ba94-4d17-9f64-0672cd75e574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:43.569411 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1430/2875] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:17:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:17:43.578397 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9de38c-d9e8-41c3-a39d-e30be44d1d97 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:43.582293 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-4b9de38c-d9e8-41c3-a39d-e30be44d1d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:43.643344 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9de38c-d9e8-41c3-a39d-e30be44d1d97 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:43.646979 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b82e75-47d2-49b7-ae6c-5e482bd3d43b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ada4e799ead24839b109377db3c6393b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:43.647633 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b82e75-47d2-49b7-ae6c-5e482bd3d43b service glance] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:43.647910 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b82e75-47d2-49b7-ae6c-5e482bd3d43b service glance] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:43.648177 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b82e75-47d2-49b7-ae6c-5e482bd3d43b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:43.744258 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b82e75-47d2-49b7-ae6c-5e482bd3d43b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:43.745761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b82e75-47d2-49b7-ae6c-5e482bd3d43b service glance] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:43.759341 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1446/2876] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:17:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:17:43.914245 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587f7b1-7bb5-42f3-95da-81302c84708a None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:43.914744 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587f7b1-7bb5-42f3-95da-81302c84708a None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:43.915089 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587f7b1-7bb5-42f3-95da-81302c84708a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:43.938118 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-1587f7b1-7bb5-42f3-95da-81302c84708a None None] MFA Rules not processed for user `686c869be43c40a9b63b3647bf689c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:17:43.939398 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-1587f7b1-7bb5-42f3-95da-81302c84708a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:44.026664 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1431/2877] 10.222.0.32 () {58 vars in 1009 bytes} [Tue May 10 14:17:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:17:44.089366 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b82e75-47d2-49b7-ae6c-5e482bd3d43b service glance] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:44.090807 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-26b82e75-47d2-49b7-ae6c-5e482bd3d43b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:44.176112 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b82e75-47d2-49b7-ae6c-5e482bd3d43b service glance] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:44.179957 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c68ffa-11ad-4b33-9e85-579d690f9e98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bbad5318b6417087d7ce6906f8281f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:44.180625 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c68ffa-11ad-4b33-9e85-579d690f9e98 service swift] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:44.180909 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c68ffa-11ad-4b33-9e85-579d690f9e98 service swift] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:44.181186 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c68ffa-11ad-4b33-9e85-579d690f9e98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:44.190328 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c68ffa-11ad-4b33-9e85-579d690f9e98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:44.191979 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c68ffa-11ad-4b33-9e85-579d690f9e98 service swift] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:44.201170 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1447/2878] 10.222.0.32 () {60 vars in 1384 bytes} [Tue May 10 14:17:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 14:17:45.605375 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587f7b1-7bb5-42f3-95da-81302c84708a None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:45.607159 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-1587f7b1-7bb5-42f3-95da-81302c84708a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:45.685632 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587f7b1-7bb5-42f3-95da-81302c84708a None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:45.691952 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78855cd-cef9-4f51-a547-6b3f2fd617d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:45.692677 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78855cd-cef9-4f51-a547-6b3f2fd617d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:45.692962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78855cd-cef9-4f51-a547-6b3f2fd617d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:45.693469 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78855cd-cef9-4f51-a547-6b3f2fd617d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:45.695367 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-f78855cd-cef9-4f51-a547-6b3f2fd617d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:45.708820 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78855cd-cef9-4f51-a547-6b3f2fd617d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:45.710335 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78855cd-cef9-4f51-a547-6b3f2fd617d8 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:45.722141 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1432/2879] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:17:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:17:53.852254 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd3a54-deee-4119-9e34-b9ee77809898 None None] REQUEST_METHOD: `POST` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:53.852821 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd3a54-deee-4119-9e34-b9ee77809898 None None] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:53.852821 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd3a54-deee-4119-9e34-b9ee77809898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:53.870091 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.auth.core [None req-e7bd3a54-deee-4119-9e34-b9ee77809898 None None] MFA Rules not processed for user `06330ab526264eaab0ee1454d30378b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:17:53.871310 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-e7bd3a54-deee-4119-9e34-b9ee77809898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:53.878837 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1448/2880] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:17:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:17:55.662806 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf2d88-c932-4540-9861-5ac8be5b6c9b None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:55.663292 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf2d88-c932-4540-9861-5ac8be5b6c9b None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:55.663406 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf2d88-c932-4540-9861-5ac8be5b6c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:55.683989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-5cbf2d88-c932-4540-9861-5ac8be5b6c9b None None] MFA Rules not processed for user `686c869be43c40a9b63b3647bf689c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:17:55.685253 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-5cbf2d88-c932-4540-9861-5ac8be5b6c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:17:55.693756 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1433/2881] 10.222.0.32 () {58 vars in 1009 bytes} [Tue May 10 14:17:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:17:55.709501 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd3a54-deee-4119-9e34-b9ee77809898 None None] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:17:55.723791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd3a54-deee-4119-9e34-b9ee77809898 None None] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:17:55.728881 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7208c2-a718-475a-9f74-224e7c5f8242 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bbad5318b6417087d7ce6906f8281f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:17:55.729628 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7208c2-a718-475a-9f74-224e7c5f8242 service swift] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:17:55.730136 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7208c2-a718-475a-9f74-224e7c5f8242 service swift] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:17:55.730707 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7208c2-a718-475a-9f74-224e7c5f8242 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:17:55.740418 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7208c2-a718-475a-9f74-224e7c5f8242 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:17:55.742189 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7208c2-a718-475a-9f74-224e7c5f8242 service swift] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:17:55.751118 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1449/2882] 10.222.0.32 () {60 vars in 1384 bytes} [Tue May 10 14:17:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:18:07.310520 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf2d88-c932-4540-9861-5ac8be5b6c9b None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:18:07.312674 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-5cbf2d88-c932-4540-9861-5ac8be5b6c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:18:07.407904 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf2d88-c932-4540-9861-5ac8be5b6c9b None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:18:07.413915 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08c3d4-cdd8-4693-a180-a0ccbdd9ec86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:18:07.414555 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08c3d4-cdd8-4693-a180-a0ccbdd9ec86 service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:18:07.414874 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08c3d4-cdd8-4693-a180-a0ccbdd9ec86 service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:18:07.415096 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08c3d4-cdd8-4693-a180-a0ccbdd9ec86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:18:07.416891 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-fe08c3d4-cdd8-4693-a180-a0ccbdd9ec86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:18:07.445420 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08c3d4-cdd8-4693-a180-a0ccbdd9ec86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:18:07.447108 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08c3d4-cdd8-4693-a180-a0ccbdd9ec86 service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:18:07.461383 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1434/2883] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:18:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:18:24.674999 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7208c2-a718-475a-9f74-224e7c5f8242 service swift] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:18:24.684791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7208c2-a718-475a-9f74-224e7c5f8242 service swift] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:18:24.688431 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185e3de-518d-413d-9cfc-84bee29a8a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:18:24.689066 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185e3de-518d-413d-9cfc-84bee29a8a65 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:18:24.689345 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185e3de-518d-413d-9cfc-84bee29a8a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:18:24.689616 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185e3de-518d-413d-9cfc-84bee29a8a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:18:24.699121 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185e3de-518d-413d-9cfc-84bee29a8a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:18:24.700651 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185e3de-518d-413d-9cfc-84bee29a8a65 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:18:24.711100 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1450/2884] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:18:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:18:26.650968 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08c3d4-cdd8-4693-a180-a0ccbdd9ec86 service nova] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:18:26.666074 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08c3d4-cdd8-4693-a180-a0ccbdd9ec86 service nova] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:18:26.672807 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb2f12-0acf-457e-9fe9-d4fdc808b50f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:18:26.673573 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb2f12-0acf-457e-9fe9-d4fdc808b50f service nova] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:18:26.673914 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb2f12-0acf-457e-9fe9-d4fdc808b50f service nova] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:18:26.674379 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb2f12-0acf-457e-9fe9-d4fdc808b50f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:18:26.676770 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-05eb2f12-0acf-457e-9fe9-d4fdc808b50f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:18:26.690574 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb2f12-0acf-457e-9fe9-d4fdc808b50f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:18:26.693541 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb2f12-0acf-457e-9fe9-d4fdc808b50f service nova] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:18:26.704928 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1435/2885] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:18:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:19:04.388844 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185e3de-518d-413d-9cfc-84bee29a8a65 service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:19:04.390248 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-8185e3de-518d-413d-9cfc-84bee29a8a65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:19:04.446892 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185e3de-518d-413d-9cfc-84bee29a8a65 service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:19:04.450654 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc694c-aef3-4660-ac1d-88bd33f2546a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42629678b7dd40fe8013b9644ac337d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:19:04.451300 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc694c-aef3-4660-ac1d-88bd33f2546a service cinder] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:19:04.451584 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc694c-aef3-4660-ac1d-88bd33f2546a service cinder] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:19:04.451859 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc694c-aef3-4660-ac1d-88bd33f2546a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:19:04.453699 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-5edc694c-aef3-4660-ac1d-88bd33f2546a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:19:04.512932 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc694c-aef3-4660-ac1d-88bd33f2546a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:19:04.514436 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc694c-aef3-4660-ac1d-88bd33f2546a service cinder] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:19:04.523207 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1451/2886] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:19:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:19:14.484049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970693d-261e-4b17-9ab2-1cb7d1240ed8 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:19:14.484644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970693d-261e-4b17-9ab2-1cb7d1240ed8 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:19:14.484644 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970693d-261e-4b17-9ab2-1cb7d1240ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:19:14.504935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-6970693d-261e-4b17-9ab2-1cb7d1240ed8 None None] MFA Rules not processed for user `da9685af6f6f47c8a59fb93df9bd0ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:19:14.506144 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-6970693d-261e-4b17-9ab2-1cb7d1240ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:19:14.514225 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1436/2887] 10.222.0.32 () {58 vars in 957 bytes} [Tue May 10 14:19:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:19:14.836803 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc694c-aef3-4660-ac1d-88bd33f2546a service cinder] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:19:14.846715 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc694c-aef3-4660-ac1d-88bd33f2546a service cinder] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:19:14.850258 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f2973-c6ae-494f-aee0-f261e579a7b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:19:14.850921 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f2973-c6ae-494f-aee0-f261e579a7b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:19:14.851202 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f2973-c6ae-494f-aee0-f261e579a7b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:19:14.851474 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f2973-c6ae-494f-aee0-f261e579a7b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:19:14.853236 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-794f2973-c6ae-494f-aee0-f261e579a7b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:19:14.864360 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f2973-c6ae-494f-aee0-f261e579a7b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:19:14.865788 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f2973-c6ae-494f-aee0-f261e579a7b3 service neutron] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:19:14.874644 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1452/2888] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:19:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:19:15.308521 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970693d-261e-4b17-9ab2-1cb7d1240ed8 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:19:15.312116 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-6970693d-261e-4b17-9ab2-1cb7d1240ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:19:15.386962 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970693d-261e-4b17-9ab2-1cb7d1240ed8 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:19:15.391935 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321852c-fbc0-4e1b-8a28-d8f3d69b7b1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4859a69a988a4b10b67187553d829b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:19:15.392582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321852c-fbc0-4e1b-8a28-d8f3d69b7b1d service placement] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:19:15.392860 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321852c-fbc0-4e1b-8a28-d8f3d69b7b1d service placement] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:19:15.393137 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321852c-fbc0-4e1b-8a28-d8f3d69b7b1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:19:15.394902 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-5321852c-fbc0-4e1b-8a28-d8f3d69b7b1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:19:15.407182 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321852c-fbc0-4e1b-8a28-d8f3d69b7b1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:19:15.408769 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321852c-fbc0-4e1b-8a28-d8f3d69b7b1d service placement] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:19:15.419223 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1437/2889] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:19:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:19:30.171008 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f2973-c6ae-494f-aee0-f261e579a7b3 service neutron] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:19:30.185506 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f2973-c6ae-494f-aee0-f261e579a7b3 service neutron] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:19:30.191148 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b46be8-8b07-4213-9d43-292f4a1674c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d4fd26c21f4170a6790369344f8334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:19:30.191810 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b46be8-8b07-4213-9d43-292f4a1674c4 service nova] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:19:30.192093 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b46be8-8b07-4213-9d43-292f4a1674c4 service nova] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:19:30.192371 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b46be8-8b07-4213-9d43-292f4a1674c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:19:30.194155 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-49b46be8-8b07-4213-9d43-292f4a1674c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:19:30.209661 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b46be8-8b07-4213-9d43-292f4a1674c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:19:30.211923 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b46be8-8b07-4213-9d43-292f4a1674c4 service nova] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:19:30.224845 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1453/2890] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:19:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:19:33.260512 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321852c-fbc0-4e1b-8a28-d8f3d69b7b1d service placement] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:19:33.270030 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321852c-fbc0-4e1b-8a28-d8f3d69b7b1d service placement] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:19:33.273724 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11441e-60ea-4100-bfb4-09c6692291d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:19:33.274403 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11441e-60ea-4100-bfb4-09c6692291d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:19:33.274684 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11441e-60ea-4100-bfb4-09c6692291d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:19:33.274955 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11441e-60ea-4100-bfb4-09c6692291d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:19:33.277219 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-bd11441e-60ea-4100-bfb4-09c6692291d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:19:33.341314 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11441e-60ea-4100-bfb4-09c6692291d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:19:33.343681 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11441e-60ea-4100-bfb4-09c6692291d8 service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:19:33.353886 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1438/2891] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:19:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:20:45.384761 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b46be8-8b07-4213-9d43-292f4a1674c4 service nova] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:20:45.386749 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-49b46be8-8b07-4213-9d43-292f4a1674c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:20:45.402656 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b46be8-8b07-4213-9d43-292f4a1674c4 service nova] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:20:45.408158 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334774dd-6482-42ba-8bdd-ccce77a81735 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4859a69a988a4b10b67187553d829b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:20:45.408805 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334774dd-6482-42ba-8bdd-ccce77a81735 service placement] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:20:45.409090 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334774dd-6482-42ba-8bdd-ccce77a81735 service placement] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:20:45.409365 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334774dd-6482-42ba-8bdd-ccce77a81735 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:20:45.411153 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-334774dd-6482-42ba-8bdd-ccce77a81735 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:20:45.423507 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334774dd-6482-42ba-8bdd-ccce77a81735 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:20:45.425084 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334774dd-6482-42ba-8bdd-ccce77a81735 service placement] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:20:45.435963 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1454/2892] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:20:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:21:06.161302 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2a4ae-8727-4305-a6af-2cf834b73320 None None] REQUEST_METHOD: `POST` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:21:06.161928 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2a4ae-8727-4305-a6af-2cf834b73320 None None] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:21:06.162054 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2a4ae-8727-4305-a6af-2cf834b73320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:21:06.185055 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.auth.core [None req-fdb2a4ae-8727-4305-a6af-2cf834b73320 None None] MFA Rules not processed for user `686c869be43c40a9b63b3647bf689c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:21:06.186350 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-fdb2a4ae-8727-4305-a6af-2cf834b73320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:21:06.194093 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1439/2893] 10.222.0.32 () {58 vars in 967 bytes} [Tue May 10 14:21:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:21:06.256091 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334774dd-6482-42ba-8bdd-ccce77a81735 service placement] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:21:06.268926 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334774dd-6482-42ba-8bdd-ccce77a81735 service placement] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:21:06.274069 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1baf18-84e7-4a92-94c2-366bd00531a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bbad5318b6417087d7ce6906f8281f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:21:06.274793 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1baf18-84e7-4a92-94c2-366bd00531a8 service swift] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:21:06.275077 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1baf18-84e7-4a92-94c2-366bd00531a8 service swift] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:21:06.275349 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1baf18-84e7-4a92-94c2-366bd00531a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:21:06.285728 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1baf18-84e7-4a92-94c2-366bd00531a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:21:06.287398 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1baf18-84e7-4a92-94c2-366bd00531a8 service swift] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:21:06.297131 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1455/2894] 10.222.0.32 () {60 vars in 1384 bytes} [Tue May 10 14:21:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:21:13.592583 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2a4ae-8727-4305-a6af-2cf834b73320 None None] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:21:13.657689 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2a4ae-8727-4305-a6af-2cf834b73320 None None] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:21:13.662102 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34aa95-d358-4429-b7c0-1ab5db032619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:21:13.663032 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34aa95-d358-4429-b7c0-1ab5db032619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:21:13.663313 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34aa95-d358-4429-b7c0-1ab5db032619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:21:13.663586 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34aa95-d358-4429-b7c0-1ab5db032619 admin admin] PATH_INFO: `/v3/users/06330ab526264eaab0ee1454d30378b0` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:21:13.664829 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34aa95-d358-4429-b7c0-1ab5db032619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06330ab526264eaab0ee1454d30378b0)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:21:13.667443 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34aa95-d358-4429-b7c0-1ab5db032619 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:21:13.715888 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2b34aa95-d358-4429-b7c0-1ab5db032619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06330ab526264eaab0ee1454d30378b0'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:13.723325 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2b34aa95-d358-4429-b7c0-1ab5db032619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06330ab526264eaab0ee1454d30378b0'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:13.737822 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2b34aa95-d358-4429-b7c0-1ab5db032619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06330ab526264eaab0ee1454d30378b0'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:13.738660 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2b34aa95-d358-4429-b7c0-1ab5db032619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06330ab526264eaab0ee1454d30378b0'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:13.739346 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-2b34aa95-d358-4429-b7c0-1ab5db032619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06330ab526264eaab0ee1454d30378b0'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:13.754124 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1440/2895] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:21:13 2022] DELETE /identity/v3/users/06330ab526264eaab0ee1454d30378b0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:21:14.211467 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1baf18-84e7-4a92-94c2-366bd00531a8 service swift] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:21:14.224685 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1baf18-84e7-4a92-94c2-366bd00531a8 service swift] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:21:14.290904 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378af33-3f89-4193-91da-b6a1a8734793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:21:14.291952 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378af33-3f89-4193-91da-b6a1a8734793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:21:14.292480 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378af33-3f89-4193-91da-b6a1a8734793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:21:14.292791 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378af33-3f89-4193-91da-b6a1a8734793 admin admin] PATH_INFO: `/v3/projects/18c7a906c7bf4b5fbc769d1d77e50e44` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:21:14.294023 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0378af33-3f89-4193-91da-b6a1a8734793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c7a906c7bf4b5fbc769d1d77e50e44)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:21:14.295995 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0378af33-3f89-4193-91da-b6a1a8734793 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:21:14.344722 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0378af33-3f89-4193-91da-b6a1a8734793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c7a906c7bf4b5fbc769d1d77e50e44', 'request_id': 'req-0378af33-3f89-4193-91da-b6a1a8734793'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:14.350075 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0378af33-3f89-4193-91da-b6a1a8734793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c7a906c7bf4b5fbc769d1d77e50e44', 'request_id': 'req-0378af33-3f89-4193-91da-b6a1a8734793'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:14.357095 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0378af33-3f89-4193-91da-b6a1a8734793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c7a906c7bf4b5fbc769d1d77e50e44', 'request_id': 'req-0378af33-3f89-4193-91da-b6a1a8734793'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:14.372605 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0378af33-3f89-4193-91da-b6a1a8734793 admin admin] The token cache is being invalidate because project 18c7a906c7bf4b5fbc769d1d77e50e44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:21:14.373294 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0378af33-3f89-4193-91da-b6a1a8734793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:14.373994 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-0378af33-3f89-4193-91da-b6a1a8734793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:14.375576 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1456/2896] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:21:14 2022] DELETE /identity/v3/projects/18c7a906c7bf4b5fbc769d1d77e50e44 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:21:14.379839 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34aa95-d358-4429-b7c0-1ab5db032619 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:21:14.381508 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-2b34aa95-d358-4429-b7c0-1ab5db032619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:21:14.396427 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34aa95-d358-4429-b7c0-1ab5db032619 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:21:14.458131 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30062d2a-200c-4ee8-85b0-9e80ee9db37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:21:14.459048 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30062d2a-200c-4ee8-85b0-9e80ee9db37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:21:14.459327 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30062d2a-200c-4ee8-85b0-9e80ee9db37b admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:21:14.459600 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30062d2a-200c-4ee8-85b0-9e80ee9db37b admin admin] PATH_INFO: `/v3/users/acde2ea845ee496ba0c51561fada1095` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:21:14.461095 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30062d2a-200c-4ee8-85b0-9e80ee9db37b admin admin] RBAC: Authorizing `identity:delete_user(user_id=acde2ea845ee496ba0c51561fada1095)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:21:14.463166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30062d2a-200c-4ee8-85b0-9e80ee9db37b admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:21:14.517794 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-30062d2a-200c-4ee8-85b0-9e80ee9db37b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acde2ea845ee496ba0c51561fada1095'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:14.533091 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-30062d2a-200c-4ee8-85b0-9e80ee9db37b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acde2ea845ee496ba0c51561fada1095'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:14.547199 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-30062d2a-200c-4ee8-85b0-9e80ee9db37b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acde2ea845ee496ba0c51561fada1095'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:14.547888 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-30062d2a-200c-4ee8-85b0-9e80ee9db37b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acde2ea845ee496ba0c51561fada1095'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:14.548492 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-30062d2a-200c-4ee8-85b0-9e80ee9db37b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acde2ea845ee496ba0c51561fada1095'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:14.562049 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1441/2897] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:21:14 2022] DELETE /identity/v3/users/acde2ea845ee496ba0c51561fada1095 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:21:14.768091 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378af33-3f89-4193-91da-b6a1a8734793 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:21:14.769832 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-0378af33-3f89-4193-91da-b6a1a8734793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:21:14.796759 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378af33-3f89-4193-91da-b6a1a8734793 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:21:14.858710 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f5e73-063d-4011-9097-72892f0ab123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:21:14.859596 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f5e73-063d-4011-9097-72892f0ab123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:21:14.859889 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f5e73-063d-4011-9097-72892f0ab123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:21:14.860126 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f5e73-063d-4011-9097-72892f0ab123 admin admin] PATH_INFO: `/v3/projects/076f8a844eb44faaac6d1008b9ccd2db` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:21:14.861335 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f5e73-063d-4011-9097-72892f0ab123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=076f8a844eb44faaac6d1008b9ccd2db)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:21:14.863274 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f5e73-063d-4011-9097-72892f0ab123 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:21:14.914187 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-400f5e73-063d-4011-9097-72892f0ab123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '076f8a844eb44faaac6d1008b9ccd2db', 'request_id': 'req-400f5e73-063d-4011-9097-72892f0ab123'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:14.921841 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-400f5e73-063d-4011-9097-72892f0ab123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '076f8a844eb44faaac6d1008b9ccd2db', 'request_id': 'req-400f5e73-063d-4011-9097-72892f0ab123'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:14.931611 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-400f5e73-063d-4011-9097-72892f0ab123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '076f8a844eb44faaac6d1008b9ccd2db', 'request_id': 'req-400f5e73-063d-4011-9097-72892f0ab123'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:14.949509 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-400f5e73-063d-4011-9097-72892f0ab123 admin admin] The token cache is being invalidate because project 076f8a844eb44faaac6d1008b9ccd2db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:21:14.949941 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-400f5e73-063d-4011-9097-72892f0ab123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:14.950902 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-400f5e73-063d-4011-9097-72892f0ab123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:14.953193 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1457/2898] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:21:14 2022] DELETE /identity/v3/projects/076f8a844eb44faaac6d1008b9ccd2db => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:21:37.663591 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30062d2a-200c-4ee8-85b0-9e80ee9db37b admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:21:37.665300 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-30062d2a-200c-4ee8-85b0-9e80ee9db37b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:21:37.732471 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30062d2a-200c-4ee8-85b0-9e80ee9db37b admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:21:37.785674 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365cbb1-5e51-4739-9d10-1e5af3cd242f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12eb1c001b5e44d8b5b5bc658ed464f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:21:37.786373 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365cbb1-5e51-4739-9d10-1e5af3cd242f service neutron] REQUEST_METHOD: `GET` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:21:37.786654 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365cbb1-5e51-4739-9d10-1e5af3cd242f service neutron] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:21:37.786924 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365cbb1-5e51-4739-9d10-1e5af3cd242f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:21:37.788754 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-1365cbb1-5e51-4739-9d10-1e5af3cd242f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:21:37.857761 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365cbb1-5e51-4739-9d10-1e5af3cd242f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:21:37.857761 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365cbb1-5e51-4739-9d10-1e5af3cd242f service neutron] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:21:37.868428 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1442/2899] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:21:45.014670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f5e73-063d-4011-9097-72892f0ab123 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:21:45.015946 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-400f5e73-063d-4011-9097-72892f0ab123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:21:45.031285 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f5e73-063d-4011-9097-72892f0ab123 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:21:45.036967 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5384572-45d4-4243-89d8-071146f394a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:21:45.037956 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5384572-45d4-4243-89d8-071146f394a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:21:45.038411 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5384572-45d4-4243-89d8-071146f394a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:21:45.038903 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5384572-45d4-4243-89d8-071146f394a4 admin admin] PATH_INFO: `/v3/users/da9685af6f6f47c8a59fb93df9bd0ec1` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:21:45.040638 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5384572-45d4-4243-89d8-071146f394a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da9685af6f6f47c8a59fb93df9bd0ec1)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:21:45.043317 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5384572-45d4-4243-89d8-071146f394a4 admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:21:45.097143 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d5384572-45d4-4243-89d8-071146f394a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da9685af6f6f47c8a59fb93df9bd0ec1'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:45.097802 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d5384572-45d4-4243-89d8-071146f394a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da9685af6f6f47c8a59fb93df9bd0ec1'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:45.111089 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d5384572-45d4-4243-89d8-071146f394a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da9685af6f6f47c8a59fb93df9bd0ec1'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:45.120882 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d5384572-45d4-4243-89d8-071146f394a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da9685af6f6f47c8a59fb93df9bd0ec1'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:45.128388 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-d5384572-45d4-4243-89d8-071146f394a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da9685af6f6f47c8a59fb93df9bd0ec1'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:45.134604 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1458/2900] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:21:45 2022] DELETE /identity/v3/users/da9685af6f6f47c8a59fb93df9bd0ec1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:21:45.332554 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365cbb1-5e51-4739-9d10-1e5af3cd242f service neutron] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:21:45.342814 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365cbb1-5e51-4739-9d10-1e5af3cd242f service neutron] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:21:45.406727 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9265c-8a37-454b-a903-fc6369132474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:21:45.407513 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9265c-8a37-454b-a903-fc6369132474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:21:45.407789 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9265c-8a37-454b-a903-fc6369132474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:21:45.408059 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9265c-8a37-454b-a903-fc6369132474 admin admin] PATH_INFO: `/v3/projects/6350c410027a478988e364b17696da95` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:21:45.409277 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9265c-8a37-454b-a903-fc6369132474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6350c410027a478988e364b17696da95)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:21:45.411224 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9265c-8a37-454b-a903-fc6369132474 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:21:45.461631 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f9a9265c-8a37-454b-a903-fc6369132474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6350c410027a478988e364b17696da95', 'request_id': 'req-f9a9265c-8a37-454b-a903-fc6369132474'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:45.468166 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f9a9265c-8a37-454b-a903-fc6369132474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6350c410027a478988e364b17696da95', 'request_id': 'req-f9a9265c-8a37-454b-a903-fc6369132474'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:45.477892 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f9a9265c-8a37-454b-a903-fc6369132474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6350c410027a478988e364b17696da95', 'request_id': 'req-f9a9265c-8a37-454b-a903-fc6369132474'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:45.492984 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f9a9265c-8a37-454b-a903-fc6369132474 admin admin] The token cache is being invalidate because project 6350c410027a478988e364b17696da95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:21:45.493269 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f9a9265c-8a37-454b-a903-fc6369132474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:45.493898 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-f9a9265c-8a37-454b-a903-fc6369132474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:45.495555 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1443/2901] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:21:45 2022] DELETE /identity/v3/projects/6350c410027a478988e364b17696da95 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:21:45.499936 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5384572-45d4-4243-89d8-071146f394a4 admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:21:45.501376 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-d5384572-45d4-4243-89d8-071146f394a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:21:45.515469 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5384572-45d4-4243-89d8-071146f394a4 admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:21:45.575338 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707ca45-cfaa-470d-86d1-d4321ac4c85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:21:45.576221 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707ca45-cfaa-470d-86d1-d4321ac4c85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:21:45.576504 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707ca45-cfaa-470d-86d1-d4321ac4c85e admin admin] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:21:45.576783 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707ca45-cfaa-470d-86d1-d4321ac4c85e admin admin] PATH_INFO: `/v3/users/01760d8c7d6b4fbd86610dae0279c702` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:21:45.578032 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707ca45-cfaa-470d-86d1-d4321ac4c85e admin admin] RBAC: Authorizing `identity:delete_user(user_id=01760d8c7d6b4fbd86610dae0279c702)` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:21:45.579988 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707ca45-cfaa-470d-86d1-d4321ac4c85e admin admin] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:21:45.629046 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-9707ca45-cfaa-470d-86d1-d4321ac4c85e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01760d8c7d6b4fbd86610dae0279c702'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:45.629709 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-9707ca45-cfaa-470d-86d1-d4321ac4c85e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01760d8c7d6b4fbd86610dae0279c702'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:45.643189 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-9707ca45-cfaa-470d-86d1-d4321ac4c85e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01760d8c7d6b4fbd86610dae0279c702'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:45.652272 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-9707ca45-cfaa-470d-86d1-d4321ac4c85e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01760d8c7d6b4fbd86610dae0279c702'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:45.660058 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.notifications [None req-9707ca45-cfaa-470d-86d1-d4321ac4c85e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01760d8c7d6b4fbd86610dae0279c702'} {{(pid=79936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:45.667527 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1459/2902] 10.222.0.32 () {58 vars in 1223 bytes} [Tue May 10 14:21:45 2022] DELETE /identity/v3/users/01760d8c7d6b4fbd86610dae0279c702 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:21:45.846153 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9265c-8a37-454b-a903-fc6369132474 admin admin] Authenticating user token {{(pid=79937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:21:45.847622 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.fernet_utils [None req-f9a9265c-8a37-454b-a903-fc6369132474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:21:45.864773 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9265c-8a37-454b-a903-fc6369132474 admin admin] Validating token access rules against request {{(pid=79937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:21:45.926977 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d2caa-7cb0-4518-83f4-17609784a736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2917275ac848431ab364bc258730628d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83c1c4876b14f72a0e3d2113130a776', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:21:45.927781 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d2caa-7cb0-4518-83f4-17609784a736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:21:45.928666 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d2caa-7cb0-4518-83f4-17609784a736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:21:45.928941 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d2caa-7cb0-4518-83f4-17609784a736 admin admin] PATH_INFO: `/v3/projects/1003748f1422448fa4680c87337e862b` {{(pid=79937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:21:45.930229 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d2caa-7cb0-4518-83f4-17609784a736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1003748f1422448fa4680c87337e862b)` {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:21:45.932906 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d2caa-7cb0-4518-83f4-17609784a736 admin admin] RBAC: Authorization granted {{(pid=79937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:21:45.980381 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-a03d2caa-7cb0-4518-83f4-17609784a736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1003748f1422448fa4680c87337e862b', 'request_id': 'req-a03d2caa-7cb0-4518-83f4-17609784a736'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:45.986582 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-a03d2caa-7cb0-4518-83f4-17609784a736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1003748f1422448fa4680c87337e862b', 'request_id': 'req-a03d2caa-7cb0-4518-83f4-17609784a736'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:45.993470 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-a03d2caa-7cb0-4518-83f4-17609784a736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1003748f1422448fa4680c87337e862b', 'request_id': 'req-a03d2caa-7cb0-4518-83f4-17609784a736'} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:46.007989 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-a03d2caa-7cb0-4518-83f4-17609784a736 admin admin] The token cache is being invalidate because project 1003748f1422448fa4680c87337e862b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:21:46.008275 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-a03d2caa-7cb0-4518-83f4-17609784a736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:46.008927 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: DEBUG keystone.notifications [None req-a03d2caa-7cb0-4518-83f4-17609784a736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:21:46.010613 dv-cinder-835881-9-iscsi devstack@keystone.service[79937]: [pid: 79937|app: 0|req: 1444/2903] 10.222.0.32 () {58 vars in 1232 bytes} [Tue May 10 14:21:45 2022] DELETE /identity/v3/projects/1003748f1422448fa4680c87337e862b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:25:49.265202 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707ca45-cfaa-470d-86d1-d4321ac4c85e admin admin] Authenticating user token {{(pid=79936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:25:49.266670 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-9707ca45-cfaa-470d-86d1-d4321ac4c85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:25:49.418106 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707ca45-cfaa-470d-86d1-d4321ac4c85e admin admin] Validating token access rules against request {{(pid=79936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:25:49.488917 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8f6de-e9d1-4fbe-818e-65f81e4acfcf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4859a69a988a4b10b67187553d829b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1cda14bca5c497dba2d18685dfe6cc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:25:49.489675 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8f6de-e9d1-4fbe-818e-65f81e4acfcf service placement] REQUEST_METHOD: `GET` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:25:49.489978 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8f6de-e9d1-4fbe-818e-65f81e4acfcf service placement] SCRIPT_NAME: `/identity` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:25:49.490257 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8f6de-e9d1-4fbe-818e-65f81e4acfcf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:25:49.492108 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.fernet_utils [None req-7cd8f6de-e9d1-4fbe-818e-65f81e4acfcf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:25:49.503972 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8f6de-e9d1-4fbe-818e-65f81e4acfcf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:25:49.506470 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8f6de-e9d1-4fbe-818e-65f81e4acfcf service placement] RBAC: Authorization granted {{(pid=79936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:25:49.516938 dv-cinder-835881-9-iscsi devstack@keystone.service[79936]: [pid: 79936|app: 0|req: 1460/2904] 10.222.0.32 () {60 vars in 1365 bytes} [Tue May 10 14:25:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0)